-- Logs begin at Tue 2022-05-17 17:22:57 UTC, end at Tue 2022-05-17 18:41:37 UTC. -- May 17 18:02:34.877167 dv-cinder-837362-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 17 18:02:34.884435 dv-cinder-837362-2-iscsi devstack@keystone.service[80004]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 17 18:02:34.888407 dv-cinder-837362-2-iscsi devstack@keystone.service[80004]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 17 18:02:34 2022] *** May 17 18:02:34.888407 dv-cinder-837362-2-iscsi devstack@keystone.service[80004]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 17 18:02:34.888407 dv-cinder-837362-2-iscsi devstack@keystone.service[80004]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 17 18:02:34.888407 dv-cinder-837362-2-iscsi devstack@keystone.service[80004]: nodename: dv-cinder-837362-2-iscsi May 17 18:02:34.888407 dv-cinder-837362-2-iscsi devstack@keystone.service[80004]: machine: x86_64 May 17 18:02:34.888407 dv-cinder-837362-2-iscsi devstack@keystone.service[80004]: clock source: unix May 17 18:02:34.888407 dv-cinder-837362-2-iscsi devstack@keystone.service[80004]: pcre jit disabled May 17 18:02:34.888407 dv-cinder-837362-2-iscsi devstack@keystone.service[80004]: detected number of CPU cores: 4 May 17 18:02:34.888407 dv-cinder-837362-2-iscsi devstack@keystone.service[80004]: current working directory: / May 17 18:02:34.888407 dv-cinder-837362-2-iscsi devstack@keystone.service[80004]: detected binary path: /usr/bin/uwsgi-core May 17 18:02:34.888407 dv-cinder-837362-2-iscsi devstack@keystone.service[80004]: your processes number limit is 47680 May 17 18:02:34.888407 dv-cinder-837362-2-iscsi devstack@keystone.service[80004]: your memory page size is 4096 bytes May 17 18:02:34.888407 dv-cinder-837362-2-iscsi devstack@keystone.service[80004]: detected max file descriptor number: 2048 May 17 18:02:34.888407 dv-cinder-837362-2-iscsi devstack@keystone.service[80004]: lock engine: pthread robust mutexes May 17 18:02:34.888407 dv-cinder-837362-2-iscsi devstack@keystone.service[80004]: thunder lock: enabled May 17 18:02:34.888407 dv-cinder-837362-2-iscsi devstack@keystone.service[80004]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 17 18:02:34.888407 dv-cinder-837362-2-iscsi devstack@keystone.service[80004]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 17 18:02:34.932521 dv-cinder-837362-2-iscsi devstack@keystone.service[80004]: Python main interpreter initialized at 0x564e02f6a9c0 May 17 18:02:34.932521 dv-cinder-837362-2-iscsi devstack@keystone.service[80004]: python threads support enabled May 17 18:02:34.932521 dv-cinder-837362-2-iscsi devstack@keystone.service[80004]: your server socket listen backlog is limited to 100 connections May 17 18:02:34.932521 dv-cinder-837362-2-iscsi devstack@keystone.service[80004]: your mercy for graceful operations on workers is 90 seconds May 17 18:02:34.932881 dv-cinder-837362-2-iscsi devstack@keystone.service[80004]: mapped 403077 bytes (393 KB) for 2 cores May 17 18:02:34.932944 dv-cinder-837362-2-iscsi devstack@keystone.service[80004]: *** Operational MODE: preforking *** May 17 18:02:34.933202 dv-cinder-837362-2-iscsi devstack@keystone.service[80004]: *** uWSGI is running in multiple interpreter mode *** May 17 18:02:34.933202 dv-cinder-837362-2-iscsi devstack@keystone.service[80004]: spawned uWSGI master process (pid: 80004) May 17 18:02:34.933416 dv-cinder-837362-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 17 18:02:34.937482 dv-cinder-837362-2-iscsi devstack@keystone.service[80004]: spawned uWSGI worker 1 (pid: 80017, cores: 1) May 17 18:02:34.937482 dv-cinder-837362-2-iscsi devstack@keystone.service[80004]: spawned uWSGI worker 2 (pid: 80018, cores: 1) May 17 18:02:34.937482 dv-cinder-837362-2-iscsi devstack@keystone.service[80004]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 17 18:02:40.646423 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 18:02:40.646423 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: from cryptography.utils import int_from_bytes May 17 18:02:40.647771 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 18:02:40.647771 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: from cryptography.utils import int_from_bytes May 17 18:02:40.697846 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 17 18:02:40.698088 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 17 18:02:40.698247 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] command line args: [] {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 17 18:02:40.698492 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 17 18:02:40.698672 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] ================================================================================ {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 17 18:02:40.698928 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] admin_token = **** {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.699174 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] config_dir = [] {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.699364 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.699548 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] config_source = [] {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.699731 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] debug = True {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.699930 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.701756 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.701756 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.701756 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.701756 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.701756 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] list_limit = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.701756 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] log_config_append = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.701756 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.701756 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] log_dir = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.702178 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] log_file = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.702178 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.702279 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.703125 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.703125 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.703125 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.703125 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.703406 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.703627 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.703798 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.704022 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.704763 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.705005 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.705359 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.705647 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.705905 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.706397 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.65/identity {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.706591 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] publish_errors = False {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.706808 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.707010 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 18:02:40.707010 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: from cryptography.utils import int_from_bytes May 17 18:02:40.707921 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.707921 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.707921 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.707921 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.707921 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] standard_threads = False {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.708825 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.708996 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 18:02:40.708996 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: from cryptography.utils import int_from_bytes May 17 18:02:40.709268 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.709268 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.709268 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] use_journal = False {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.709268 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] use_json = False {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.709268 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] use_stderr = False {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.709268 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] use_syslog = False {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.710081 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.710081 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.710081 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.710081 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.710590 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.710590 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.710840 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.711023 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.711261 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.711510 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.711757 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.712088 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.712240 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.712463 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.712701 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.712948 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.713196 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.713434 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.713711 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.713964 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.714262 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.714440 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.714695 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.714958 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.715213 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.715467 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.715701 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.715931 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.716163 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.716401 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.716650 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.716899 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.717131 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.717361 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.717631 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.717880 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.718120 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.718368 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.718603 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.718840 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.719077 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.719311 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.719544 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.719775 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.720613 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.720854 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.721106 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.721340 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.721601 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.721828 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.722060 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.722297 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.722546 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.722778 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.723018 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.723257 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.723495 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.723732 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.723971 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.724203 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.724452 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.724688 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.724927 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.725159 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.725419 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.725677 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.725902 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.726139 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.726375 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.726643 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.726882 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.727247 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.727496 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.727737 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.727974 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.728210 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.728463 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.728707 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.728946 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.729191 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.729432 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.729693 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.729930 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.730168 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.730407 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.730670 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.730916 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.731156 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.731396 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.731640 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.731881 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.732119 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.732357 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.732588 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.732820 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.733051 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.733288 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.733539 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.733784 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.734021 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.734271 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.734509 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.734766 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.735027 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.735270 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.735558 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] auth.external = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.735795 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.736095 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.736328 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.736560 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] auth.password = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.736791 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] auth.token = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.737032 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.737268 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.737538 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.737774 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.738022 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.738269 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.738502 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.738739 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] credential.caching = True {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.738988 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.739237 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.739484 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.739722 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.739968 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.740205 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.740472 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.740726 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.740963 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.741216 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.741517 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.741764 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.742028 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.742273 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.742531 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.742769 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] federation.caching = True {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.743008 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.743255 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.743502 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.743781 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.744085 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.744508 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.744937 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.745384 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.745923 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.746378 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.746852 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.747285 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] identity.caching = True {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.748722 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.748722 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.748722 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.749263 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.749562 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.749977 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.750464 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.751026 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.751564 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.751956 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.752378 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.752929 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.753388 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.754046 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.754366 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.754853 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.755326 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.755690 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.755956 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.756212 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.756458 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.756709 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.756953 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.757201 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.757453 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.757726 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.757984 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.758139 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 17 18:02:40.758271 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 17 18:02:40.758405 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.758534 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] command line args: [] {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 17 18:02:40.758659 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.758823 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 17 18:02:40.758986 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.759113 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] ================================================================================ {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 17 18:02:40.759250 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.759379 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] admin_token = **** {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.759505 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.759638 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] config_dir = [] {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.759638 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.759888 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.760024 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] config_source = [] {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.760152 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.760280 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] debug = True {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.760408 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.760535 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.760702 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.760840 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.760969 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.761102 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.761235 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.761369 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.761549 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.761685 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.761812 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.762000 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] list_limit = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.762135 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.762263 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] log_config_append = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.762263 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.762519 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.762654 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] log_dir = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.762782 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.762910 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] log_file = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.763036 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.763172 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.763300 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.763439 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.763566 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.763693 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.763819 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.764024 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.764160 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.764294 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.764424 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.764551 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.764690 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.764818 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.765011 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] ldap.user = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.765158 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.765286 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.765414 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.765575 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.765706 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.765833 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.765960 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.766092 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.766229 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.766365 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.766494 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.766629 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.767265 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.767407 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.767407 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.767657 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.767795 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.767795 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.768042 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.65/identity {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.768176 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.768312 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] publish_errors = False {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.768440 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.768573 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.768701 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.768834 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.768962 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.769097 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.769236 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.769364 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.769554 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.769690 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.769817 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.769955 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] standard_threads = False {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.770084 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.770211 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.770338 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.770474 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.770602 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.770742 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.770742 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] use_journal = False {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.771023 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.771165 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] use_json = False {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.771294 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.771421 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] use_stderr = False {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.771549 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.771677 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] use_syslog = False {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.771810 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.771952 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:02:40.772081 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.772209 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.772342 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.772471 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.772607 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.772736 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.772876 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.773004 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.773132 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.773260 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.773400 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.773553 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.773683 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.773683 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.773937 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.774065 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.774201 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.774330 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.774458 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.774585 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.774729 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.774857 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.774994 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.775122 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] resource.caching = True {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.775250 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.775383 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.775512 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.775639 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.775779 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.775956 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.776090 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.776218 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.776345 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.776595 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.776769 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.776904 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.777034 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.777162 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.777298 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.777427 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.777602 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.777734 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.777863 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.777990 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] role.caching = True {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.778120 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.778248 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] role.driver = sql {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.778385 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.778524 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.778661 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.778789 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.778917 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.779045 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.779185 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.779314 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.779442 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.779570 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.779698 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.779825 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.780032 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.780165 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.780305 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.780434 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.780434 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.780682 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.780819 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.780948 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.781075 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.781204 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.781332 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.781477 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.781623 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.781761 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.781899 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.782043 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.782043 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.782301 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.783023 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.783163 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.783293 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.783429 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.783559 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.783695 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.783825 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.783953 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.784081 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.784208 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.784337 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.784522 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.784659 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.784796 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.784925 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.785056 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.785185 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.785322 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.785452 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.785606 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.785734 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.785862 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.785990 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.786128 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.786269 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.786397 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.786527 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.786654 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.786782 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.786919 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.787048 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.787175 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.787303 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.787431 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.787559 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.787695 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.787824 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.787951 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] token.caching = True {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.788089 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.788217 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.788352 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.788489 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.788619 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.788747 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.788874 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.789002 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.789130 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.789274 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.789404 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.789568 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.789568 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.789825 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.789963 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.790100 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.790229 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.790356 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.790485 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.790614 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.790741 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.790877 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.791006 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.791141 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.791269 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.791396 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.791524 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.791672 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.791801 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.791939 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.792067 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.792195 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.792322 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.792461 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.792591 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] database.connection = **** {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.792729 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.792866 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.792996 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.793123 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.793259 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.793406 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.793659 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.793790 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.793919 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.794056 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.794056 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.794308 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.794437 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.794565 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.794692 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.794820 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.794955 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.795091 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.795221 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.795361 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.795489 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.795617 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.795745 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.795745 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.796003 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.796132 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.796260 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.796387 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.796515 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.796652 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.796782 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.796910 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.797039 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.797185 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.797185 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80018) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 17 18:02:40.797437 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.797437 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.797437 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.797437 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.797437 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.797437 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.797437 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.797437 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.797437 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.799036 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.799036 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.799036 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.799036 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.799036 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.799036 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.799036 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] auth.external = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.799036 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.799036 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.800098 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.800098 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] auth.password = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.800098 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] auth.token = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.800098 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.800098 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.800098 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.800098 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.800098 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.800098 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.801147 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.801147 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] credential.caching = True {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.801147 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.801147 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.801147 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.801147 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.801909 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.801909 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.801909 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.802271 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.802271 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.802521 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.802792 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.803039 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.803302 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.803546 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.803824 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.804085 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] federation.caching = True {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.804366 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.804639 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.804917 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.805180 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.805519 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.805733 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.806011 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.806269 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.806526 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.806767 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.807034 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.807292 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] identity.caching = True {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.807579 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.807833 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.808093 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.808361 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.808614 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.808848 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.809094 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.809369 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.809664 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.809921 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.810181 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.810424 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.810678 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.810948 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.811217 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.811509 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.811778 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.812069 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.812347 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.812609 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.812879 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.813122 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.813389 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.813698 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.813946 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.814256 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.814438 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.814651 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.814909 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.815158 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.815396 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.815642 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.815888 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.816118 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.816357 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.816585 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.817104 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.817365 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.817672 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.817933 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.818184 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.818455 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.818727 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.818987 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.819242 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.819515 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.819790 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.820067 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.820327 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.820570 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.820813 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] ldap.user = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.821073 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.821333 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.821588 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.821838 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.822087 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.822333 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.822568 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.822798 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.823034 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.823268 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.823506 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.823736 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.824004 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.824284 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.824426 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 18:02:40.824560 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.824690 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 18:02:40.824829 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 18:02:40.825098 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.825098 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.825353 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.825575 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.825816 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.826052 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.826310 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.826569 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.826816 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.827064 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.827304 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.827584 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.827823 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.828096 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.828360 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.828601 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.828852 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.829105 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.829916 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.830175 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.830418 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.830681 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] resource.caching = True {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.831028 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.831226 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.831515 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.831789 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.832076 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.832316 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.832603 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.832863 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.833123 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.833382 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] role.caching = True {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.833687 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] role.driver = sql {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.833941 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.834653 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.834653 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.834653 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.835017 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.835153 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.835386 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.835634 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.835883 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.836138 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.836409 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.836693 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.836944 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.837213 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.837704 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.837945 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.838196 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.838474 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.838724 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 18:02:40.838871 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.839007 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.839252 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.839535 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.839810 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.840055 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.840288 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.840520 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.840753 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.841009 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.841266 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.841537 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.841779 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.842017 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.842250 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.842488 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] token.caching = True {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.842732 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.843011 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.845633 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.845633 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.845633 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.845633 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.845633 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.845633 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.845633 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.845633 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.845633 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.846817 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.846817 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.846817 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.846817 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.846817 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.847465 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.847465 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] database.connection = **** {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.847465 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.848053 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.848053 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.848316 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.848316 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.848570 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.848777 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.849014 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.849261 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.849525 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.849774 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.850011 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.850262 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.850501 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.850771 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.851027 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.851308 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.851577 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:02:40.851749 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80017) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 17 18:02:40.870134 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 18:02:40.870368 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 18:02:40.880861 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 18:02:40.881115 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 18:02:40.881364 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 18:02:40.890685 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 18:02:40.910042 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 18:02:40.910253 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 18:02:40.924159 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 18:02:40.950416 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 18:02:40.975386 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 18:02:40.975621 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 18:02:40.990769 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 18:02:40.991004 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 18:02:41.045156 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 18:02:41.045365 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 18:02:41.045498 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 18:02:41.045623 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 18:02:41.045745 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 18:02:41.045826 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 18:02:41.046030 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 18:02:41.046126 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 18:02:41.046243 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 18:02:41.046361 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 18:02:41.046700 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 18:02:41.046979 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 18:02:41.070010 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 18:02:41.070246 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 18:02:41.070463 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 18:02:41.070586 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 18:02:41.070675 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 18:02:41.070889 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 18:02:41.070980 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 18:02:41.071124 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 18:02:41.071207 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 18:02:41.071337 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 18:02:41.071417 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 18:02:41.071583 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 18:02:41.071800 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 18:02:41.072014 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 18:02:41.083225 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 18:02:41.083869 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 18:02:41.098911 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 18:02:41.099087 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 18:02:41.099156 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 18:02:41.099348 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 18:02:41.099431 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 18:02:41.099494 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 18:02:41.099575 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 18:02:41.099739 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 18:02:41.099821 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 18:02:41.099884 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 18:02:41.099944 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 18:02:41.100104 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 18:02:41.100186 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80017) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 18:02:41.100315 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80018) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 18:02:41.117631 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.117839 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 17 18:02:41.118175 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.118260 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.118402 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 17 18:02:41.118485 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 17 18:02:41.118620 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.118701 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.118878 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.119029 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 17 18:02:41.119158 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.119287 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.119415 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.119544 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.119682 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.119862 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.130797 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.131072 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.131329 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.131486 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.131620 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.131749 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.131877 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.132129 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.139630 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80017) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 18:02:41.140238 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80018) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 18:02:41.143008 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80017) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 18:02:41.143287 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.143579 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80018) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 18:02:41.143734 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.143866 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.144043 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.144181 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.144494 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.144631 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.144769 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.144936 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.145086 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.145264 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.145399 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.145567 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.145812 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.145948 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.146078 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.146206 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.146345 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.146565 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.147039 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.173925 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.175538 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80018) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 18:02:41.175817 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.176258 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.179001 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80017) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 18:02:41.179298 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.181216 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80018) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 18:02:41.181512 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.181795 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.185147 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80017) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 18:02:41.185424 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.185724 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.189661 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80018) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 18:02:41.189941 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.193839 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80017) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 18:02:41.194119 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.194815 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80018) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 18:02:41.195101 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.195380 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.195659 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.195932 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.196206 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.196474 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.196737 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.198716 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80017) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 18:02:41.199003 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.199282 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.199561 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.199832 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.200102 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.200369 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.200633 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.215812 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.216086 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.219689 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.219988 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.220629 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80018) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 18:02:41.224238 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.224462 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80017) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 18:02:41.224609 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.228061 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.228354 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.229439 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80018) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 18:02:41.232985 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80018) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 18:02:41.233256 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80017) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 18:02:41.236719 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.236870 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80017) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 18:02:41.237008 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.237284 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.237592 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.237870 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.238145 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.240509 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.240801 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.241079 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.241358 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.241656 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.241932 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.257434 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80018) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 18:02:41.257830 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.258099 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.258365 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.261283 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80017) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 18:02:41.261676 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.261946 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.262208 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.266324 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.268602 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.268873 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.270613 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.272040 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80018) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 18:02:41.272322 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.272466 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.272613 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.272748 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.272883 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.273137 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.275608 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80017) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 18:02:41.275888 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.276179 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.276470 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.276746 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.286572 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80018) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 18:02:41.286858 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.287133 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.287420 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.287699 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.287991 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.288261 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.290097 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80017) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 18:02:41.290371 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.290647 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.290937 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.291214 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.291490 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.291761 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.306222 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80018) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 18:02:41.309448 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80018) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 18:02:41.309680 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80017) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 18:02:41.312770 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.312915 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80017) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 18:02:41.314923 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.316547 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80018) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 18:02:41.316694 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.317105 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.317360 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.318536 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.320153 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80017) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 18:02:41.320436 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.320712 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.324762 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.326399 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80018) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 18:02:41.328069 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.330172 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.330327 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80017) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 18:02:41.330475 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.330726 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.330997 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.333481 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.333769 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.334049 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.334322 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.340197 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80018) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 18:02:41.340490 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.340768 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.343455 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80017) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 18:02:41.343740 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.344016 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.348877 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80018) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 18:02:41.349154 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.349432 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.350817 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.350817 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.350817 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.350817 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.351770 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.351770 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.351770 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.351770 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.352602 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80017) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 18:02:41.352743 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.352880 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.353025 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.353214 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.353353 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80018) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.353520 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.353520 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.353520 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.353936 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.353936 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.354207 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.354400 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.354667 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.354937 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.355204 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.355458 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80017) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 18:02:41.392499 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x564e02f6a9c0 pid: 80018 (default app) May 17 18:02:41.394928 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x564e02f6a9c0 pid: 80017 (default app) May 17 18:02:41.395861 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e5480-dede-43b2-884b-c4c7bc50581c None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:41.396152 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e5480-dede-43b2-884b-c4c7bc50581c None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:41.396428 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e5480-dede-43b2-884b-c4c7bc50581c None None] PATH_INFO: `/v3` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:41.400608 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1/1] 10.222.0.65 () {50 vars in 791 bytes} [Tue May 17 18:02:41 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:02:49.678731 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3461d235-9811-45ad-b59e-3205010a06cd None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:49.679315 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3461d235-9811-45ad-b59e-3205010a06cd None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:49.679315 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3461d235-9811-45ad-b59e-3205010a06cd None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:49.683537 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1/2] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:02:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:02:49.688702 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e09cf9-9b9f-43f0-acc9-d415877b72e3 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:49.689144 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e09cf9-9b9f-43f0-acc9-d415877b72e3 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:49.689316 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e09cf9-9b9f-43f0-acc9-d415877b72e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:49.720568 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG oslo_db.sqlalchemy.engines [None req-66e09cf9-9b9f-43f0-acc9-d415877b72e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80018) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 18:02:49.904658 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG passlib.handlers.bcrypt [None req-66e09cf9-9b9f-43f0-acc9-d415877b72e3 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80018) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 17 18:02:49.905081 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG passlib.handlers.bcrypt [None req-66e09cf9-9b9f-43f0-acc9-d415877b72e3 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80018) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 17 18:02:49.962328 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-66e09cf9-9b9f-43f0-acc9-d415877b72e3 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:02:49.963906 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-66e09cf9-9b9f-43f0-acc9-d415877b72e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:02:50.095846 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 2/3] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:02:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 17 18:02:50.238477 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3461d235-9811-45ad-b59e-3205010a06cd None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:50.272364 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG oslo_db.sqlalchemy.engines [None req-3461d235-9811-45ad-b59e-3205010a06cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80017) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 18:02:50.401796 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3461d235-9811-45ad-b59e-3205010a06cd None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:50.405990 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178377df-6b35-4a86-a1db-4a2b89c8bf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:50.406642 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178377df-6b35-4a86-a1db-4a2b89c8bf3f admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:50.406919 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178377df-6b35-4a86-a1db-4a2b89c8bf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:50.407223 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178377df-6b35-4a86-a1db-4a2b89c8bf3f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:50.415326 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178377df-6b35-4a86-a1db-4a2b89c8bf3f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:50.466583 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: WARNING keystone.common.rbac_enforcer.enforcer [None req-178377df-6b35-4a86-a1db-4a2b89c8bf3f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 17 18:02:50.466918 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178377df-6b35-4a86-a1db-4a2b89c8bf3f admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:50.476838 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 2/4] 10.222.0.65 () {58 vars in 1324 bytes} [Tue May 17 18:02:50 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 17 18:02:50.482589 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e09cf9-9b9f-43f0-acc9-d415877b72e3 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:50.497076 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e09cf9-9b9f-43f0-acc9-d415877b72e3 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:50.501905 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98e66f4-e5b7-4c7e-b70a-813d55add6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:50.503021 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e66f4-e5b7-4c7e-b70a-813d55add6b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:50.503300 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e66f4-e5b7-4c7e-b70a-813d55add6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:50.503569 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e66f4-e5b7-4c7e-b70a-813d55add6b9 admin admin] PATH_INFO: `/v3/projects/22a045ecfd2045b79def0497d463b2a3` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:50.505053 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98e66f4-e5b7-4c7e-b70a-813d55add6b9 admin admin] RBAC: Authorizing `identity:get_project(project_id=22a045ecfd2045b79def0497d463b2a3)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:50.554426 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f98e66f4-e5b7-4c7e-b70a-813d55add6b9 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 17 18:02:50.554762 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98e66f4-e5b7-4c7e-b70a-813d55add6b9 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:50.559343 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 3/5] 10.222.0.65 () {56 vars in 1207 bytes} [Tue May 17 18:02:50 2022] GET /identity/v3/projects/22a045ecfd2045b79def0497d463b2a3 => generated 344 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:02:52.778452 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0f6f4-db95-40bf-9bb9-ce5640a34b2d None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:52.778991 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0f6f4-db95-40bf-9bb9-ce5640a34b2d None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:52.778991 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0f6f4-db95-40bf-9bb9-ce5640a34b2d None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:52.783686 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 3/6] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:02:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:02:52.789181 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd621b69-25d7-4a00-bfe1-727809d2300d None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:52.789609 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd621b69-25d7-4a00-bfe1-727809d2300d None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:52.789776 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd621b69-25d7-4a00-bfe1-727809d2300d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:52.809315 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-cd621b69-25d7-4a00-bfe1-727809d2300d None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:02:52.810854 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-cd621b69-25d7-4a00-bfe1-727809d2300d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:02:52.818964 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 4/7] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:02:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 17 18:02:52.841915 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e0f6f4-db95-40bf-9bb9-ce5640a34b2d None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:52.854469 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e0f6f4-db95-40bf-9bb9-ce5640a34b2d None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:52.858619 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2edd0d-4e41-4212-988d-c3d385d0657b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:52.859250 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2edd0d-4e41-4212-988d-c3d385d0657b admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:52.859528 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2edd0d-4e41-4212-988d-c3d385d0657b admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:52.859820 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2edd0d-4e41-4212-988d-c3d385d0657b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:52.867366 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2edd0d-4e41-4212-988d-c3d385d0657b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:52.869134 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2edd0d-4e41-4212-988d-c3d385d0657b admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:52.877718 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 4/8] 10.222.0.65 () {58 vars in 1324 bytes} [Tue May 17 18:02:52 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 18:02:52.883269 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd621b69-25d7-4a00-bfe1-727809d2300d None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:52.892650 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd621b69-25d7-4a00-bfe1-727809d2300d None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:52.897011 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6342489-6416-4b74-b7a3-21f73a23dead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:52.897898 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6342489-6416-4b74-b7a3-21f73a23dead admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:52.898178 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6342489-6416-4b74-b7a3-21f73a23dead admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:52.898450 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6342489-6416-4b74-b7a3-21f73a23dead admin admin] PATH_INFO: `/v3/users/8763b2e915c44d8688900867e35dfda6` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:52.899842 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6342489-6416-4b74-b7a3-21f73a23dead admin admin] RBAC: Authorizing `identity:get_user(user_id=8763b2e915c44d8688900867e35dfda6)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:52.901671 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6342489-6416-4b74-b7a3-21f73a23dead admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:52.903225 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 5/9] 10.222.0.65 () {56 vars in 1198 bytes} [Tue May 17 18:02:52 2022] GET /identity/v3/users/8763b2e915c44d8688900867e35dfda6 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:02:55.178498 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351e160-8fd3-4a55-81ee-c0f2a236ed54 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:55.179028 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351e160-8fd3-4a55-81ee-c0f2a236ed54 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:55.179028 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351e160-8fd3-4a55-81ee-c0f2a236ed54 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:55.180385 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 5/10] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:02:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:02:55.185624 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0cc2db-d647-48eb-a467-582867e7d5ff None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:55.186023 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0cc2db-d647-48eb-a467-582867e7d5ff None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:55.186178 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0cc2db-d647-48eb-a467-582867e7d5ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:55.212276 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b425964-a355-4dba-b754-25bb1e7d4bcb None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:55.212553 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b425964-a355-4dba-b754-25bb1e7d4bcb None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:55.212998 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b425964-a355-4dba-b754-25bb1e7d4bcb None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:55.214686 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 6/11] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:02:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 18:02:55.221074 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c27d5-da99-4346-b77e-1c5b5aa837a5 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:55.221352 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c27d5-da99-4346-b77e-1c5b5aa837a5 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:55.221817 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c27d5-da99-4346-b77e-1c5b5aa837a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:55.262800 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG passlib.handlers.bcrypt [None req-f61c27d5-da99-4346-b77e-1c5b5aa837a5 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80017) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 17 18:02:55.263232 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG passlib.handlers.bcrypt [None req-f61c27d5-da99-4346-b77e-1c5b5aa837a5 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80017) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 17 18:02:55.311740 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-f61c27d5-da99-4346-b77e-1c5b5aa837a5 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:02:55.313367 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-f61c27d5-da99-4346-b77e-1c5b5aa837a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:02:55.313717 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-5b0cc2db-d647-48eb-a467-582867e7d5ff None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:02:55.314919 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-5b0cc2db-d647-48eb-a467-582867e7d5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:02:55.403720 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 6/12] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:02:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:02:55.423269 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 7/13] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:02:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 18:02:55.426999 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0cc2db-d647-48eb-a467-582867e7d5ff None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:55.446102 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c27d5-da99-4346-b77e-1c5b5aa837a5 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:55.527372 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0cc2db-d647-48eb-a467-582867e7d5ff None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:55.549748 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c27d5-da99-4346-b77e-1c5b5aa837a5 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:55.559722 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8075aba-79b3-4c30-b893-32a483fbdf09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:55.560518 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8075aba-79b3-4c30-b893-32a483fbdf09 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:55.560796 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8075aba-79b3-4c30-b893-32a483fbdf09 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:55.561071 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8075aba-79b3-4c30-b893-32a483fbdf09 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:55.572035 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8075aba-79b3-4c30-b893-32a483fbdf09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:02:55.580992 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b3c52f-fa87-499d-92e0-721a390fa62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:55.581918 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3c52f-fa87-499d-92e0-721a390fa62f None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:55.582203 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3c52f-fa87-499d-92e0-721a390fa62f None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:55.582478 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3c52f-fa87-499d-92e0-721a390fa62f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:55.583292 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-a8075aba-79b3-4c30-b893-32a483fbdf09 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:02:55.583292 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:02:55.583292 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:02:55.583292 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:02:55.583292 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:02:55.583292 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:02:55.583292 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:02:55.583292 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:02:55.583292 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:02:55.583292 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:02:55.583292 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:02:55.583292 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:02:55.583292 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:02:55.583292 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:02:55.583292 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:02:55.583292 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:02:55.584346 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:02:55.584346 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:02:55.584346 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:02:55.584346 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:02:55.584346 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:02:55.584346 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:02:55.584346 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:02:55.584346 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:02:55.584346 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:02:55.584346 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:02:55.584346 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:02:55.584346 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:02:55.584346 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:02:55.584346 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:02:55.584346 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:02:55.584346 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:02:55.585364 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:02:55.585364 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:02:55.585364 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:02:55.585364 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:02:55.585364 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:02:55.585364 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:02:55.585364 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:02:55.585364 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:02:55.585364 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:02:55.585364 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:02:55.585364 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:02:55.585364 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:02:55.585364 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 7/14] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 17 18:02:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:02:55.590193 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8075aba-79b3-4c30-b893-32a483fbdf09 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:55.649412 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b3c52f-fa87-499d-92e0-721a390fa62f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:55.650951 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b3c52f-fa87-499d-92e0-721a390fa62f None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:55.682682 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8075aba-79b3-4c30-b893-32a483fbdf09 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:55.715100 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61efeb8-6baf-41c7-b5b8-cbc911c20871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:55.715687 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61efeb8-6baf-41c7-b5b8-cbc911c20871 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:55.715964 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61efeb8-6baf-41c7-b5b8-cbc911c20871 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:55.716235 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61efeb8-6baf-41c7-b5b8-cbc911c20871 None admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:55.716971 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61efeb8-6baf-41c7-b5b8-cbc911c20871 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:02:55.717271 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61efeb8-6baf-41c7-b5b8-cbc911c20871 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:55.718678 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61efeb8-6baf-41c7-b5b8-cbc911c20871 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:55.730005 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 8/15] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 17 18:02:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:02:55.735874 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61efeb8-6baf-41c7-b5b8-cbc911c20871 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:55.741812 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 8/16] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 17 18:02:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 17 18:02:55.747109 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b3c52f-fa87-499d-92e0-721a390fa62f None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:55.827481 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61efeb8-6baf-41c7-b5b8-cbc911c20871 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:55.839938 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b3c52f-fa87-499d-92e0-721a390fa62f None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:55.863735 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3226ad-7f92-4698-a33b-65bca3560cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:55.864602 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3226ad-7f92-4698-a33b-65bca3560cca None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:55.864882 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3226ad-7f92-4698-a33b-65bca3560cca None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:55.865155 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3226ad-7f92-4698-a33b-65bca3560cca None admin] PATH_INFO: `/v3/users/8763b2e915c44d8688900867e35dfda6` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:55.866385 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3226ad-7f92-4698-a33b-65bca3560cca None admin] RBAC: Authorizing `identity:get_user(user_id=8763b2e915c44d8688900867e35dfda6)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:55.867832 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3226ad-7f92-4698-a33b-65bca3560cca None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:55.873669 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 9/17] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 17 18:02:55 2022] GET /identity/v3/users/8763b2e915c44d8688900867e35dfda6 => generated 247 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:02:55.873806 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553160ac-a35e-4622-907c-0bf671ef6478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:55.873806 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553160ac-a35e-4622-907c-0bf671ef6478 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:55.873806 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553160ac-a35e-4622-907c-0bf671ef6478 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:55.873806 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553160ac-a35e-4622-907c-0bf671ef6478 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:55.874597 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3226ad-7f92-4698-a33b-65bca3560cca None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:55.973541 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3226ad-7f92-4698-a33b-65bca3560cca None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:55.998783 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553160ac-a35e-4622-907c-0bf671ef6478 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:56.000247 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553160ac-a35e-4622-907c-0bf671ef6478 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:56.007136 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6915782-454a-4171-9fa0-e70db0d06995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:56.007919 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6915782-454a-4171-9fa0-e70db0d06995 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:56.008192 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6915782-454a-4171-9fa0-e70db0d06995 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:56.008458 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6915782-454a-4171-9fa0-e70db0d06995 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:56.009654 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6915782-454a-4171-9fa0-e70db0d06995 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:56.011060 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6915782-454a-4171-9fa0-e70db0d06995 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:56.012652 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 10/18] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:02:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:02:56.018225 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6915782-454a-4171-9fa0-e70db0d06995 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:56.021286 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-553160ac-a35e-4622-907c-0bf671ef6478 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:02:56.021286 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:02:56.021286 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:02:56.021286 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:02:56.021286 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:02:56.021286 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:02:56.021286 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:02:56.021286 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:02:56.021286 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:02:56.021286 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:02:56.021286 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:02:56.021286 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:02:56.021286 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:02:56.021286 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:02:56.021286 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:02:56.022216 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:02:56.022216 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:02:56.022216 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:02:56.022216 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:02:56.022216 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:02:56.022216 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:02:56.022216 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:02:56.022216 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:02:56.022216 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:02:56.022216 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:02:56.022216 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:02:56.022216 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:02:56.022216 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:02:56.022216 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:02:56.022216 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:02:56.022216 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:02:56.022216 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:02:56.023034 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:02:56.023034 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:02:56.023034 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:02:56.023034 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:02:56.023034 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 9/19] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:02:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:02:56.028171 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553160ac-a35e-4622-907c-0bf671ef6478 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:56.109250 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6915782-454a-4171-9fa0-e70db0d06995 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:56.122547 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553160ac-a35e-4622-907c-0bf671ef6478 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:56.140827 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a2c00b-eb3f-4f35-be79-2b6dd59c4103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:56.141483 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2c00b-eb3f-4f35-be79-2b6dd59c4103 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:56.141778 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2c00b-eb3f-4f35-be79-2b6dd59c4103 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:56.142053 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2c00b-eb3f-4f35-be79-2b6dd59c4103 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:56.142881 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a2c00b-eb3f-4f35-be79-2b6dd59c4103 None admin] RBAC: Adding query filter params (role.id=332c8d70fd0f41e2beea20aaead5daa5, scope.domain.id=default, user.id=8763b2e915c44d8688900867e35dfda6) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:02:56.143189 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a2c00b-eb3f-4f35-be79-2b6dd59c4103 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:56.144603 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a2c00b-eb3f-4f35-be79-2b6dd59c4103 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:56.151252 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 11/20] 10.222.0.65 () {56 vars in 1322 bytes} [Tue May 17 18:02:56 2022] GET /identity/v3/role_assignments?user.id=8763b2e915c44d8688900867e35dfda6&scope.domain.id=default&role.id=332c8d70fd0f41e2beea20aaead5daa5 => generated 233 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:02:56.153992 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e73ce-6071-4253-8b12-9ae61935890b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:56.154655 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e73ce-6071-4253-8b12-9ae61935890b None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:56.154932 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e73ce-6071-4253-8b12-9ae61935890b None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:56.155203 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e73ce-6071-4253-8b12-9ae61935890b None admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:56.155934 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481e73ce-6071-4253-8b12-9ae61935890b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:02:56.156263 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481e73ce-6071-4253-8b12-9ae61935890b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:56.158259 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481e73ce-6071-4253-8b12-9ae61935890b None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:56.178170 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 10/21] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:02:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:02:58.535456 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ee69f-8b4c-4e0c-a4e3-bf63a19b6a49 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:58.536459 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ee69f-8b4c-4e0c-a4e3-bf63a19b6a49 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:58.536947 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ee69f-8b4c-4e0c-a4e3-bf63a19b6a49 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:58.538864 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 12/22] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:02:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:02:58.544384 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27af34b-9107-4b0e-8ef3-6f507e9df9b3 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:58.545229 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27af34b-9107-4b0e-8ef3-6f507e9df9b3 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:58.545784 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27af34b-9107-4b0e-8ef3-6f507e9df9b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:58.568025 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-f27af34b-9107-4b0e-8ef3-6f507e9df9b3 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:02:58.573657 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-f27af34b-9107-4b0e-8ef3-6f507e9df9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:02:58.660454 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 11/23] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:02:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 18:02:58.707148 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ee69f-8b4c-4e0c-a4e3-bf63a19b6a49 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:58.826309 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ee69f-8b4c-4e0c-a4e3-bf63a19b6a49 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:58.869387 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aa0ce4-e799-44eb-bc2c-38244f036b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:58.870218 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa0ce4-e799-44eb-bc2c-38244f036b3e None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:58.870500 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa0ce4-e799-44eb-bc2c-38244f036b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:58.870773 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa0ce4-e799-44eb-bc2c-38244f036b3e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:58.886711 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aa0ce4-e799-44eb-bc2c-38244f036b3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:02:58.895112 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-64aa0ce4-e799-44eb-bc2c-38244f036b3e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:02:58.895112 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:02:58.895112 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:02:58.895112 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:02:58.895112 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:02:58.895112 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:02:58.895112 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:02:58.895112 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:02:58.895112 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:02:58.895112 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:02:58.895112 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:02:58.895112 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:02:58.895112 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:02:58.895112 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:02:58.895112 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:02:58.895112 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:02:58.896021 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:02:58.896021 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:02:58.896021 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:02:58.896021 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:02:58.896021 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:02:58.896021 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:02:58.896021 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:02:58.896021 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:02:58.896021 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:02:58.896021 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:02:58.896021 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:02:58.896021 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:02:58.896021 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:02:58.896021 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:02:58.896021 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:02:58.896021 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:02:58.896772 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:02:58.896772 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:02:58.896772 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:02:58.896772 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:02:58.896772 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:02:58.896772 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:02:58.896772 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:02:58.896772 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:02:58.896772 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:02:58.896772 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:02:58.896772 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:02:58.896772 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:02:58.900853 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 13/24] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 17 18:02:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:02:58.902166 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27af34b-9107-4b0e-8ef3-6f507e9df9b3 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:59.009154 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27af34b-9107-4b0e-8ef3-6f507e9df9b3 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:59.021437 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e753c3-51d1-438a-97e1-356298fae0b1 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:59.022077 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e753c3-51d1-438a-97e1-356298fae0b1 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:59.022563 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e753c3-51d1-438a-97e1-356298fae0b1 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:59.024978 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 14/25] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:02:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 18:02:59.030865 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fdfd1a-84f9-49eb-ada2-834a38753436 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:59.031506 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fdfd1a-84f9-49eb-ada2-834a38753436 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:59.032023 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fdfd1a-84f9-49eb-ada2-834a38753436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:59.057504 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0373a041-fe09-4436-b8d5-74394fb48c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:59.057504 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373a041-fe09-4436-b8d5-74394fb48c1a None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:59.057504 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373a041-fe09-4436-b8d5-74394fb48c1a None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:59.057504 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0373a041-fe09-4436-b8d5-74394fb48c1a None admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:59.057904 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0373a041-fe09-4436-b8d5-74394fb48c1a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:02:59.057904 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0373a041-fe09-4436-b8d5-74394fb48c1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:59.057904 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0373a041-fe09-4436-b8d5-74394fb48c1a None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:59.065099 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-45fdfd1a-84f9-49eb-ada2-834a38753436 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:02:59.069323 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 12/26] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 17 18:02:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:02:59.070763 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-45fdfd1a-84f9-49eb-ada2-834a38753436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:02:59.074366 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0373a041-fe09-4436-b8d5-74394fb48c1a None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:59.211174 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 15/27] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:02:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:02:59.241204 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0373a041-fe09-4436-b8d5-74394fb48c1a None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:59.248971 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fdfd1a-84f9-49eb-ada2-834a38753436 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:59.284624 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46fe8c3-2b7a-4cdf-bcaa-c81a176eb4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:59.285530 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46fe8c3-2b7a-4cdf-bcaa-c81a176eb4c4 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:59.285812 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46fe8c3-2b7a-4cdf-bcaa-c81a176eb4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:59.286081 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46fe8c3-2b7a-4cdf-bcaa-c81a176eb4c4 None admin] PATH_INFO: `/v3/users/8763b2e915c44d8688900867e35dfda6` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:59.294541 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46fe8c3-2b7a-4cdf-bcaa-c81a176eb4c4 None admin] RBAC: Authorizing `identity:get_user(user_id=8763b2e915c44d8688900867e35dfda6)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:59.296025 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46fe8c3-2b7a-4cdf-bcaa-c81a176eb4c4 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:59.298587 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 13/28] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 17 18:02:59 2022] GET /identity/v3/users/8763b2e915c44d8688900867e35dfda6 => generated 247 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:02:59.299804 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449dcb29-eca1-4a54-99fe-11db1ede8761 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:59.300090 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449dcb29-eca1-4a54-99fe-11db1ede8761 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:59.300366 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449dcb29-eca1-4a54-99fe-11db1ede8761 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:59.301957 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 14/29] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:02:59.310818 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3576eee0-8ec5-4cc8-b2b5-86bea2a9b3c1 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:59.311105 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3576eee0-8ec5-4cc8-b2b5-86bea2a9b3c1 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:59.311384 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3576eee0-8ec5-4cc8-b2b5-86bea2a9b3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:59.346535 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-3576eee0-8ec5-4cc8-b2b5-86bea2a9b3c1 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:02:59.347747 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-3576eee0-8ec5-4cc8-b2b5-86bea2a9b3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:02:59.357706 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fdfd1a-84f9-49eb-ada2-834a38753436 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:59.393127 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994bead4-086e-49d8-beff-99ac5dda219e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:59.394004 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994bead4-086e-49d8-beff-99ac5dda219e None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:59.394290 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994bead4-086e-49d8-beff-99ac5dda219e None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:59.394566 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994bead4-086e-49d8-beff-99ac5dda219e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:59.404741 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994bead4-086e-49d8-beff-99ac5dda219e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:59.406414 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994bead4-086e-49d8-beff-99ac5dda219e None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:59.426012 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 15/30] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:02:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 18:02:59.426865 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3576eee0-8ec5-4cc8-b2b5-86bea2a9b3c1 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:59.426969 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-994bead4-086e-49d8-beff-99ac5dda219e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:02:59.426969 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:02:59.426969 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:02:59.426969 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:02:59.426969 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:02:59.426969 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:02:59.426969 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:02:59.426969 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:02:59.426969 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:02:59.426969 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:02:59.426969 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:02:59.426969 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:02:59.426969 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:02:59.426969 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:02:59.426969 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:02:59.427696 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:02:59.427696 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:02:59.427696 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:02:59.427696 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:02:59.427696 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:02:59.427696 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:02:59.427696 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:02:59.427696 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:02:59.427696 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:02:59.427696 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:02:59.427696 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:02:59.427696 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:02:59.427696 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:02:59.427696 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:02:59.427696 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:02:59.427696 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:02:59.427696 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:02:59.428491 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:02:59.428491 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:02:59.428491 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:02:59.428491 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:02:59.428491 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 16/31] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:02:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:02:59.431503 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe63312-4b85-415c-8384-b61c66792865 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:59.431503 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe63312-4b85-415c-8384-b61c66792865 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:59.431503 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe63312-4b85-415c-8384-b61c66792865 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:59.431901 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 17/32] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:02:59.437343 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d67fc-6e9e-4e9f-b472-ef0154a3dfdf None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:59.437719 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d67fc-6e9e-4e9f-b472-ef0154a3dfdf None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:59.437929 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d67fc-6e9e-4e9f-b472-ef0154a3dfdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:59.457122 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-147d67fc-6e9e-4e9f-b472-ef0154a3dfdf None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:02:59.458927 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-147d67fc-6e9e-4e9f-b472-ef0154a3dfdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:02:59.555762 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 18/33] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:02:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:02:59.556565 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147d67fc-6e9e-4e9f-b472-ef0154a3dfdf None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:59.567854 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3576eee0-8ec5-4cc8-b2b5-86bea2a9b3c1 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:59.616498 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d3584-a4cf-4221-ad97-845561067a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:59.617546 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d3584-a4cf-4221-ad97-845561067a8d None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:59.618063 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d3584-a4cf-4221-ad97-845561067a8d None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:59.618473 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45d3584-a4cf-4221-ad97-845561067a8d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:59.619802 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45d3584-a4cf-4221-ad97-845561067a8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:59.621376 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45d3584-a4cf-4221-ad97-845561067a8d None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:59.623461 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 16/34] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:02:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:02:59.624396 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d3584-a4cf-4221-ad97-845561067a8d None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:59.660363 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147d67fc-6e9e-4e9f-b472-ef0154a3dfdf None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:59.695388 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fbba41-6ce6-4ba5-96d0-e497930f01ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:59.696642 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fbba41-6ce6-4ba5-96d0-e497930f01ad None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:59.696642 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fbba41-6ce6-4ba5-96d0-e497930f01ad None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:59.696642 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fbba41-6ce6-4ba5-96d0-e497930f01ad None admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:59.697308 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fbba41-6ce6-4ba5-96d0-e497930f01ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:02:59.697643 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fbba41-6ce6-4ba5-96d0-e497930f01ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:59.699032 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fbba41-6ce6-4ba5-96d0-e497930f01ad None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:59.721114 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 19/35] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:02:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:02:59.721114 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fbba41-6ce6-4ba5-96d0-e497930f01ad None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:59.731826 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45d3584-a4cf-4221-ad97-845561067a8d None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:59.766967 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c97fb3a-78d8-47aa-92f7-a39f7b0bc05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:59.767859 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97fb3a-78d8-47aa-92f7-a39f7b0bc05e None admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:59.768276 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97fb3a-78d8-47aa-92f7-a39f7b0bc05e None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:59.768708 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97fb3a-78d8-47aa-92f7-a39f7b0bc05e None admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:59.769689 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c97fb3a-78d8-47aa-92f7-a39f7b0bc05e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:59.771296 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c97fb3a-78d8-47aa-92f7-a39f7b0bc05e None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:59.817387 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fbba41-6ce6-4ba5-96d0-e497930f01ad None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:59.852280 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1b6ba-578d-441f-9cfd-093a76e0e04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:59.852957 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1b6ba-578d-441f-9cfd-093a76e0e04c None admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:59.853238 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1b6ba-578d-441f-9cfd-093a76e0e04c None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:59.853542 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1b6ba-578d-441f-9cfd-093a76e0e04c None admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:59.854294 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec1b6ba-578d-441f-9cfd-093a76e0e04c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:59.855691 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec1b6ba-578d-441f-9cfd-093a76e0e04c None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:59.908170 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 17/36] 10.222.0.65 () {60 vars in 1131 bytes} [Tue May 17 18:02:59 2022] POST /identity/v3/roles => generated 219 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:02:59.909380 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c97fb3a-78d8-47aa-92f7-a39f7b0bc05e None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:00.004596 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 20/37] 10.222.0.65 () {60 vars in 1131 bytes} [Tue May 17 18:02:59 2022] POST /identity/v3/roles => generated 225 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:03:00.009612 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1b6ba-578d-441f-9cfd-093a76e0e04c None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:00.030267 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c97fb3a-78d8-47aa-92f7-a39f7b0bc05e None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:00.091094 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a0907-3079-4112-9503-a554e1feb8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:00.092368 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a0907-3079-4112-9503-a554e1feb8f6 None admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:00.092846 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a0907-3079-4112-9503-a554e1feb8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:00.093322 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a0907-3079-4112-9503-a554e1feb8f6 None admin] PATH_INFO: `/v3/domains/default/users/8763b2e915c44d8688900867e35dfda6/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:00.099504 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2a0907-3079-4112-9503-a554e1feb8f6 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=8763b2e915c44d8688900867e35dfda6, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:00.101498 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2a0907-3079-4112-9503-a554e1feb8f6 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:00.120215 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1b6ba-578d-441f-9cfd-093a76e0e04c None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:00.148633 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 18/38] 10.222.0.65 () {58 vars in 1361 bytes} [Tue May 17 18:02:59 2022] PUT /identity/v3/domains/default/users/8763b2e915c44d8688900867e35dfda6/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:03:00.169578 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14f593-c60c-4718-87e1-ec502110c638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:00.170334 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14f593-c60c-4718-87e1-ec502110c638 None admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:00.170625 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14f593-c60c-4718-87e1-ec502110c638 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:00.170954 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14f593-c60c-4718-87e1-ec502110c638 None admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:00.171689 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f14f593-c60c-4718-87e1-ec502110c638 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:00.174095 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f14f593-c60c-4718-87e1-ec502110c638 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:00.227222 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 21/39] 10.222.0.65 () {60 vars in 1141 bytes} [Tue May 17 18:03:00 2022] POST /identity/v3/projects => generated 301 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:03:00.340740 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3daafe3-3c26-4c3b-b178-a0853f3405e7 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:00.341401 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3daafe3-3c26-4c3b-b178-a0853f3405e7 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:00.341882 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3daafe3-3c26-4c3b-b178-a0853f3405e7 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:00.343603 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 19/40] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:03:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:03:00.350132 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c7bc5-fbbc-4c8e-a0d3-870a962b9974 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:00.350474 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c7bc5-fbbc-4c8e-a0d3-870a962b9974 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:00.350763 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c7bc5-fbbc-4c8e-a0d3-870a962b9974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:00.372459 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-a48c7bc5-fbbc-4c8e-a0d3-870a962b9974 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:03:00.374571 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-a48c7bc5-fbbc-4c8e-a0d3-870a962b9974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:03:00.452475 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 22/41] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:03:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:03:00.482598 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3daafe3-3c26-4c3b-b178-a0853f3405e7 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:00.605961 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3daafe3-3c26-4c3b-b178-a0853f3405e7 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:00.640508 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c154934-b8df-4af2-8c2c-4830fe1491e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:00.641226 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c154934-b8df-4af2-8c2c-4830fe1491e0 None admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:00.642585 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c154934-b8df-4af2-8c2c-4830fe1491e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:00.642585 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c154934-b8df-4af2-8c2c-4830fe1491e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:00.643026 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c154934-b8df-4af2-8c2c-4830fe1491e0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:00.644393 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c154934-b8df-4af2-8c2c-4830fe1491e0 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:00.659970 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 20/42] 10.222.0.65 () {60 vars in 1131 bytes} [Tue May 17 18:03:00 2022] POST /identity/v3/roles => generated 223 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:03:00.910699 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c98430-c61d-4dd8-8bb2-189e601045a2 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:00.911223 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c98430-c61d-4dd8-8bb2-189e601045a2 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:00.911679 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c98430-c61d-4dd8-8bb2-189e601045a2 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:00.914421 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 23/43] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:03:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:03:00.920676 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813801c-6e18-419f-9107-e35d659f4c09 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:00.920968 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813801c-6e18-419f-9107-e35d659f4c09 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:00.921668 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813801c-6e18-419f-9107-e35d659f4c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:00.944865 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-0813801c-6e18-419f-9107-e35d659f4c09 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:03:00.946438 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-0813801c-6e18-419f-9107-e35d659f4c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:03:01.008511 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 21/44] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:03:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:03:01.032573 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c98430-c61d-4dd8-8bb2-189e601045a2 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:01.133252 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c98430-c61d-4dd8-8bb2-189e601045a2 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:01.166437 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f3361-6a73-436c-a519-5a572f37ea5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:01.167262 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f3361-6a73-436c-a519-5a572f37ea5a None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:01.167553 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f3361-6a73-436c-a519-5a572f37ea5a None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:01.167829 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f3361-6a73-436c-a519-5a572f37ea5a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:01.169015 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f3361-6a73-436c-a519-5a572f37ea5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:01.170508 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f3361-6a73-436c-a519-5a572f37ea5a None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:01.172133 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 24/45] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:03:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:01.177766 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813801c-6e18-419f-9107-e35d659f4c09 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:01.279871 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813801c-6e18-419f-9107-e35d659f4c09 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:01.311776 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b549b-0685-4736-b8a7-6771a671dedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:01.312433 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b549b-0685-4736-b8a7-6771a671dedd None admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:01.312724 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b549b-0685-4736-b8a7-6771a671dedd None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:01.313005 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b549b-0685-4736-b8a7-6771a671dedd None admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:01.313757 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6b549b-0685-4736-b8a7-6771a671dedd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:01.315293 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6b549b-0685-4736-b8a7-6771a671dedd None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:01.341091 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 22/46] 10.222.0.65 () {60 vars in 1141 bytes} [Tue May 17 18:03:01 2022] POST /identity/v3/projects => generated 312 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:03:02.529837 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b9f49-676b-49d1-9380-448ab81d14df None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:02.530381 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b9f49-676b-49d1-9380-448ab81d14df None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:02.530465 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6b9f49-676b-49d1-9380-448ab81d14df None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:02.531876 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 25/47] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:03:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:03:02.537153 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2bd358-d777-4b9b-9e91-b5e9b5e72b63 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:02.537585 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2bd358-d777-4b9b-9e91-b5e9b5e72b63 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:02.537845 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2bd358-d777-4b9b-9e91-b5e9b5e72b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:02.554548 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-bb2bd358-d777-4b9b-9e91-b5e9b5e72b63 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:03:02.555715 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-bb2bd358-d777-4b9b-9e91-b5e9b5e72b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:03:02.618422 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 23/48] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:03:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 18:03:02.641164 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6b9f49-676b-49d1-9380-448ab81d14df None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:02.734661 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6b9f49-676b-49d1-9380-448ab81d14df None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:02.766246 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d2b3fc-eee7-46d2-9bc5-9fb82a535687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:02.767023 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2b3fc-eee7-46d2-9bc5-9fb82a535687 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:02.767302 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2b3fc-eee7-46d2-9bc5-9fb82a535687 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:02.767577 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2b3fc-eee7-46d2-9bc5-9fb82a535687 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:02.776945 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d2b3fc-eee7-46d2-9bc5-9fb82a535687 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:03:02.784427 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-23d2b3fc-eee7-46d2-9bc5-9fb82a535687 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:03:02.784427 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:03:02.784427 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:03:02.784427 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:03:02.784427 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:03:02.784427 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:03:02.784427 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:03:02.784427 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:03:02.784427 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:03:02.784427 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:03:02.784427 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:03:02.784427 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:03:02.784427 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:03:02.784427 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:03:02.784427 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:03:02.784427 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:03:02.785500 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:03:02.785500 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:03:02.785500 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:03:02.785500 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:03:02.785500 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:03:02.785500 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:03:02.785500 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:03:02.785500 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:03:02.785500 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:03:02.785500 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:03:02.785500 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:03:02.785500 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:03:02.785500 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:03:02.785500 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:03:02.785500 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:03:02.785500 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:03:02.786274 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:03:02.786274 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:03:02.786274 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:03:02.786274 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:03:02.786274 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:03:02.786274 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:03:02.786274 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:03:02.786274 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:03:02.786274 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:03:02.786274 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:03:02.786274 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:03:02.786274 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:03:02.786274 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 26/49] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 17 18:03:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:03:02.791185 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2bd358-d777-4b9b-9e91-b5e9b5e72b63 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:02.885468 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2bd358-d777-4b9b-9e91-b5e9b5e72b63 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:02.916823 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb384aa-cb7e-4329-9069-149fc37fedb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:02.917499 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb384aa-cb7e-4329-9069-149fc37fedb3 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:02.917779 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb384aa-cb7e-4329-9069-149fc37fedb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:02.918050 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb384aa-cb7e-4329-9069-149fc37fedb3 None admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:02.918788 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb384aa-cb7e-4329-9069-149fc37fedb3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:02.919089 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb384aa-cb7e-4329-9069-149fc37fedb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:02.920462 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb384aa-cb7e-4329-9069-149fc37fedb3 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:02.928723 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 24/50] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 17 18:03:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:02.934186 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d2b3fc-eee7-46d2-9bc5-9fb82a535687 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:03.027251 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d2b3fc-eee7-46d2-9bc5-9fb82a535687 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:03.059273 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f55841-a515-455b-bc97-9ad7e58a1a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:03.060074 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f55841-a515-455b-bc97-9ad7e58a1a09 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:03.060358 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f55841-a515-455b-bc97-9ad7e58a1a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:03.060635 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f55841-a515-455b-bc97-9ad7e58a1a09 None admin] PATH_INFO: `/v3/users/8763b2e915c44d8688900867e35dfda6` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:03.061846 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f55841-a515-455b-bc97-9ad7e58a1a09 None admin] RBAC: Authorizing `identity:get_user(user_id=8763b2e915c44d8688900867e35dfda6)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:03.063320 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f55841-a515-455b-bc97-9ad7e58a1a09 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:03.064942 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 27/51] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 17 18:03:02 2022] GET /identity/v3/users/8763b2e915c44d8688900867e35dfda6 => generated 247 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:03:03.070528 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb384aa-cb7e-4329-9069-149fc37fedb3 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:03.165285 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb384aa-cb7e-4329-9069-149fc37fedb3 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:03.197076 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05f652-8973-4fc1-a1b8-b3b5423e0d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:03.197881 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05f652-8973-4fc1-a1b8-b3b5423e0d00 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:03.198164 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05f652-8973-4fc1-a1b8-b3b5423e0d00 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:03.198444 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05f652-8973-4fc1-a1b8-b3b5423e0d00 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:03.199610 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a05f652-8973-4fc1-a1b8-b3b5423e0d00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:03.201050 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a05f652-8973-4fc1-a1b8-b3b5423e0d00 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:03.202692 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 25/52] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:03:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:03:03.208907 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f55841-a515-455b-bc97-9ad7e58a1a09 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:03.303646 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f55841-a515-455b-bc97-9ad7e58a1a09 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:03.335405 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13104acb-e9d9-4e6e-8ead-4dde818350b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:03.335998 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13104acb-e9d9-4e6e-8ead-4dde818350b8 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:03.336282 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13104acb-e9d9-4e6e-8ead-4dde818350b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:03.336560 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13104acb-e9d9-4e6e-8ead-4dde818350b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:03.337390 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13104acb-e9d9-4e6e-8ead-4dde818350b8 None admin] RBAC: Adding query filter params (role.id=332c8d70fd0f41e2beea20aaead5daa5, scope.domain.id=default, user.id=8763b2e915c44d8688900867e35dfda6) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:03.337727 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13104acb-e9d9-4e6e-8ead-4dde818350b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:03.339175 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13104acb-e9d9-4e6e-8ead-4dde818350b8 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:03.345514 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 28/53] 10.222.0.65 () {56 vars in 1322 bytes} [Tue May 17 18:03:03 2022] GET /identity/v3/role_assignments?user.id=8763b2e915c44d8688900867e35dfda6&scope.domain.id=default&role.id=332c8d70fd0f41e2beea20aaead5daa5 => generated 530 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:03.574368 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ce7e8-3f21-4663-8063-4c065a73b4c8 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:03.574864 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ce7e8-3f21-4663-8063-4c065a73b4c8 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:03.574971 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ce7e8-3f21-4663-8063-4c065a73b4c8 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:03.576276 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 26/54] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:03:03.582303 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b54c1-5f97-4218-a924-05be0cfac409 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:03.582698 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b54c1-5f97-4218-a924-05be0cfac409 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:03.582860 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b54c1-5f97-4218-a924-05be0cfac409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:03.599825 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-2f6b54c1-5f97-4218-a924-05be0cfac409 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:03:03.600959 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-2f6b54c1-5f97-4218-a924-05be0cfac409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:03:03.662544 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 29/55] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:03:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:03:03.685241 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ce7e8-3f21-4663-8063-4c065a73b4c8 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:03.780606 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ce7e8-3f21-4663-8063-4c065a73b4c8 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:03.810893 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7759c4f4-5a18-4af7-af46-dc6d1944d4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:03.811658 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759c4f4-5a18-4af7-af46-dc6d1944d4df None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:03.811933 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759c4f4-5a18-4af7-af46-dc6d1944d4df None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:03.812198 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759c4f4-5a18-4af7-af46-dc6d1944d4df None admin] PATH_INFO: `/v3/domains/default` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:03.813878 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7759c4f4-5a18-4af7-af46-dc6d1944d4df None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:03.815296 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7759c4f4-5a18-4af7-af46-dc6d1944d4df None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:03.816873 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 27/56] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:03:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:03.822559 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b54c1-5f97-4218-a924-05be0cfac409 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:03.914941 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b54c1-5f97-4218-a924-05be0cfac409 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:03.946494 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d408d457-f684-4e22-8ec6-4518bead76f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:03.947140 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408d457-f684-4e22-8ec6-4518bead76f7 None admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:03.947422 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408d457-f684-4e22-8ec6-4518bead76f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:03.947701 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d408d457-f684-4e22-8ec6-4518bead76f7 None admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:03.948409 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d408d457-f684-4e22-8ec6-4518bead76f7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:03.949870 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d408d457-f684-4e22-8ec6-4518bead76f7 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:03.973012 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 30/57] 10.222.0.65 () {60 vars in 1140 bytes} [Tue May 17 18:03:03 2022] POST /identity/v3/projects => generated 298 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:03:06.177810 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580b779-06ca-41c6-ad5b-6f8c07e2a598 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:06.178347 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580b779-06ca-41c6-ad5b-6f8c07e2a598 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:06.178347 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580b779-06ca-41c6-ad5b-6f8c07e2a598 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:06.179732 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 28/58] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:03:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:03:06.185077 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3170a-81c7-41b3-8d65-5a7677a247ec None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:06.185482 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3170a-81c7-41b3-8d65-5a7677a247ec None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:06.185666 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3170a-81c7-41b3-8d65-5a7677a247ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:06.201940 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-ecd3170a-81c7-41b3-8d65-5a7677a247ec None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:03:06.203096 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-ecd3170a-81c7-41b3-8d65-5a7677a247ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:03:06.270143 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 31/59] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:03:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:03:06.294925 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6580b779-06ca-41c6-ad5b-6f8c07e2a598 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:06.390679 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6580b779-06ca-41c6-ad5b-6f8c07e2a598 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:06.422359 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20132134-600d-4218-92d8-0a448545356e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:06.423134 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20132134-600d-4218-92d8-0a448545356e None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:06.423417 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20132134-600d-4218-92d8-0a448545356e None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:06.423694 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20132134-600d-4218-92d8-0a448545356e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:06.424859 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20132134-600d-4218-92d8-0a448545356e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:06.426321 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20132134-600d-4218-92d8-0a448545356e None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:06.428026 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 29/60] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:03:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:06.433236 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd3170a-81c7-41b3-8d65-5a7677a247ec None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:06.524172 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd3170a-81c7-41b3-8d65-5a7677a247ec None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:06.555715 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2276c1-67ce-4be8-a813-ffa04793889d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:06.556391 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2276c1-67ce-4be8-a813-ffa04793889d None admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:06.556668 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2276c1-67ce-4be8-a813-ffa04793889d None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:06.556940 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2276c1-67ce-4be8-a813-ffa04793889d None admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:06.557701 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2276c1-67ce-4be8-a813-ffa04793889d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:06.559178 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2276c1-67ce-4be8-a813-ffa04793889d None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:06.586907 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 32/61] 10.222.0.65 () {60 vars in 1132 bytes} [Tue May 17 18:03:06 2022] POST /identity/v3/users => generated 275 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:03:10.042572 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39051677-66a6-4bb9-b383-85390b268b01 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:10.043072 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39051677-66a6-4bb9-b383-85390b268b01 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:10.043143 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39051677-66a6-4bb9-b383-85390b268b01 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:10.044661 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 30/62] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:03:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:03:10.059196 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b1151b-f0e1-4661-94d2-65e0a3583412 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:10.059665 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b1151b-f0e1-4661-94d2-65e0a3583412 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:10.059764 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b1151b-f0e1-4661-94d2-65e0a3583412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:10.086544 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-63b1151b-f0e1-4661-94d2-65e0a3583412 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:03:10.087688 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-63b1151b-f0e1-4661-94d2-65e0a3583412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:03:10.166703 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 33/63] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:03:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:03:10.190646 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c48ba-4224-4214-91ac-32df1c2258d5 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:10.190949 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c48ba-4224-4214-91ac-32df1c2258d5 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:10.191221 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c48ba-4224-4214-91ac-32df1c2258d5 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:10.192974 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 31/64] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:03:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:03:10.194503 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4099b7-2d1c-46b5-9d88-620232c3420f None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:10.194800 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4099b7-2d1c-46b5-9d88-620232c3420f None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:10.195079 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4099b7-2d1c-46b5-9d88-620232c3420f None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:10.196892 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 34/65] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:03:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:03:10.198041 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b3c717-ae47-4cb3-99ef-e13bee3ff2d3 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:10.198560 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b3c717-ae47-4cb3-99ef-e13bee3ff2d3 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:10.199053 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b3c717-ae47-4cb3-99ef-e13bee3ff2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:10.201859 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe1bd6-60bf-46ba-9ab3-896e21a9edce None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:10.202151 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe1bd6-60bf-46ba-9ab3-896e21a9edce None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:10.202432 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe1bd6-60bf-46ba-9ab3-896e21a9edce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:10.217575 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-57b3c717-ae47-4cb3-99ef-e13bee3ff2d3 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:03:10.219279 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-57b3c717-ae47-4cb3-99ef-e13bee3ff2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:03:10.219722 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-adfe1bd6-60bf-46ba-9ab3-896e21a9edce None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:03:10.220881 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-adfe1bd6-60bf-46ba-9ab3-896e21a9edce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:03:10.309561 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 32/66] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:03:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:03:10.310850 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b3c717-ae47-4cb3-99ef-e13bee3ff2d3 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:10.311640 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 35/67] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:03:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:03:10.330138 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfe1bd6-60bf-46ba-9ab3-896e21a9edce None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:10.415557 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b3c717-ae47-4cb3-99ef-e13bee3ff2d3 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:10.433772 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfe1bd6-60bf-46ba-9ab3-896e21a9edce None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:10.450791 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcdd78c-1055-4d03-ba58-b9b6de1a4880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:10.451919 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcdd78c-1055-4d03-ba58-b9b6de1a4880 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:10.452420 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcdd78c-1055-4d03-ba58-b9b6de1a4880 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:10.452888 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcdd78c-1055-4d03-ba58-b9b6de1a4880 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:10.464430 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcdd78c-1055-4d03-ba58-b9b6de1a4880 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:03:10.467894 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f9fcf-22cb-494b-bafa-5b82ad590553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:10.468691 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f9fcf-22cb-494b-bafa-5b82ad590553 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:10.469515 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f9fcf-22cb-494b-bafa-5b82ad590553 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:10.469796 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f9fcf-22cb-494b-bafa-5b82ad590553 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:10.473928 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-0fcdd78c-1055-4d03-ba58-b9b6de1a4880 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 18:03:10.473928 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:03:10.473928 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:03:10.473928 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:03:10.473928 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:03:10.473928 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:03:10.473928 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:03:10.473928 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:03:10.473928 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:03:10.473928 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:03:10.473928 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:03:10.473928 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:03:10.473928 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:03:10.473928 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:03:10.473928 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:03:10.473928 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:03:10.475185 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:03:10.475185 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:03:10.475185 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:03:10.475185 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:03:10.475185 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:03:10.475185 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:03:10.475185 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:03:10.475185 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:03:10.475185 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:03:10.475185 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:03:10.475185 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:03:10.475185 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:03:10.475185 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:03:10.475185 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:03:10.475185 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:03:10.475185 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:03:10.476258 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:03:10.476258 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:03:10.476258 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:03:10.476258 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:03:10.476258 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:03:10.476258 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:03:10.476258 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:03:10.476258 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:03:10.476258 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:03:10.476258 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:03:10.476258 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 18:03:10.476258 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:03:10.478750 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 33/68] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 17 18:03:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:03:10.478750 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcdd78c-1055-4d03-ba58-b9b6de1a4880 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:10.479895 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2f9fcf-22cb-494b-bafa-5b82ad590553 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:03:10.488069 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-ad2f9fcf-22cb-494b-bafa-5b82ad590553 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:03:10.488069 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:03:10.488069 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:03:10.488069 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:03:10.488069 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:03:10.488069 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:03:10.488069 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:03:10.488069 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:03:10.488069 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:03:10.488069 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:03:10.488069 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:03:10.488069 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:03:10.488069 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:03:10.488069 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:03:10.488069 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:03:10.488069 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:03:10.488964 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:03:10.488964 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:03:10.488964 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:03:10.488964 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:03:10.488964 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:03:10.488964 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:03:10.488964 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:03:10.488964 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:03:10.488964 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:03:10.488964 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:03:10.488964 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:03:10.488964 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:03:10.488964 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:03:10.488964 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:03:10.488964 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:03:10.488964 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:03:10.490812 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:03:10.490812 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:03:10.490812 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:03:10.490812 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:03:10.490812 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:03:10.490812 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:03:10.490812 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:03:10.490812 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:03:10.490812 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:03:10.490812 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:03:10.490812 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:03:10.490812 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:03:10.490812 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 36/69] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 17 18:03:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:03:10.490812 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd819a0-6bab-4c4c-b567-ec05afb290e3 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:10.491481 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd819a0-6bab-4c4c-b567-ec05afb290e3 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:10.491481 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd819a0-6bab-4c4c-b567-ec05afb290e3 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:10.492486 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 37/70] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:03:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:03:10.493575 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a9a69-2b6c-4a3e-9b99-e4ff0aa122f8 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:10.493862 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a9a69-2b6c-4a3e-9b99-e4ff0aa122f8 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:10.494137 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a9a69-2b6c-4a3e-9b99-e4ff0aa122f8 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:10.495355 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 38/71] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:03:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:03:10.496052 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a9a69-2b6c-4a3e-9b99-e4ff0aa122f8 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:10.575084 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcdd78c-1055-4d03-ba58-b9b6de1a4880 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:10.591098 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a9a69-2b6c-4a3e-9b99-e4ff0aa122f8 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:10.606315 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95630a90-2df7-4557-8e82-38133417cc6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:10.607115 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95630a90-2df7-4557-8e82-38133417cc6d None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:10.607397 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95630a90-2df7-4557-8e82-38133417cc6d None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:10.607674 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95630a90-2df7-4557-8e82-38133417cc6d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:10.617386 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95630a90-2df7-4557-8e82-38133417cc6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:03:10.622761 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b566a37-cffc-4c48-a8a1-1fcf181d3742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:10.623410 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b566a37-cffc-4c48-a8a1-1fcf181d3742 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:10.623696 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b566a37-cffc-4c48-a8a1-1fcf181d3742 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:10.623976 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b566a37-cffc-4c48-a8a1-1fcf181d3742 None admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:10.624719 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b566a37-cffc-4c48-a8a1-1fcf181d3742 None admin] RBAC: Adding query filter params (name=member) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:10.625027 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b566a37-cffc-4c48-a8a1-1fcf181d3742 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:10.626029 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-95630a90-2df7-4557-8e82-38133417cc6d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 18:03:10.626029 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:03:10.626029 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:03:10.626029 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:03:10.626029 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:03:10.626029 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:03:10.626029 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:03:10.626029 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:03:10.626029 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:03:10.626029 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:03:10.626029 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:03:10.626029 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:03:10.626029 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:03:10.626029 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:03:10.626029 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:03:10.626029 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:03:10.627040 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:03:10.627040 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:03:10.627040 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:03:10.627040 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:03:10.627040 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:03:10.627040 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:03:10.627040 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:03:10.627040 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:03:10.627040 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:03:10.627040 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:03:10.627040 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:03:10.627040 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:03:10.627040 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:03:10.627040 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:03:10.627040 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:03:10.627040 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:03:10.627969 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:03:10.627969 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:03:10.627969 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:03:10.627969 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:03:10.627969 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:03:10.627969 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:03:10.627969 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:03:10.627969 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:03:10.627969 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:03:10.627969 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:03:10.627969 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 18:03:10.627969 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:03:10.628665 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b566a37-cffc-4c48-a8a1-1fcf181d3742 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:10.630782 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 34/72] 10.222.0.65 () {56 vars in 1114 bytes} [Tue May 17 18:03:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:03:10.630782 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95630a90-2df7-4557-8e82-38133417cc6d None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:10.637886 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 39/73] 10.222.0.65 () {56 vars in 1101 bytes} [Tue May 17 18:03:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:10.640178 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df1e7c-c085-425b-8045-b271588237a7 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:10.640472 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df1e7c-c085-425b-8045-b271588237a7 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:10.640753 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df1e7c-c085-425b-8045-b271588237a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:10.656438 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-d7df1e7c-c085-425b-8045-b271588237a7 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:03:10.658180 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-d7df1e7c-c085-425b-8045-b271588237a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:03:10.721086 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 40/74] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:03:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:03:10.722458 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d853a3-73f8-456e-aa93-afb1fd3f7a91 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:10.722756 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d853a3-73f8-456e-aa93-afb1fd3f7a91 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:10.723039 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d853a3-73f8-456e-aa93-afb1fd3f7a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:10.728631 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95630a90-2df7-4557-8e82-38133417cc6d None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:10.738290 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-16d853a3-73f8-456e-aa93-afb1fd3f7a91 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:03:10.739465 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-16d853a3-73f8-456e-aa93-afb1fd3f7a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:03:10.760776 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e7048-1ab2-4489-b249-a1c5bae9dca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:10.761443 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e7048-1ab2-4489-b249-a1c5bae9dca0 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:10.761753 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e7048-1ab2-4489-b249-a1c5bae9dca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:10.762033 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e7048-1ab2-4489-b249-a1c5bae9dca0 None admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:10.762783 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25e7048-1ab2-4489-b249-a1c5bae9dca0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:10.763095 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25e7048-1ab2-4489-b249-a1c5bae9dca0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:10.764487 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25e7048-1ab2-4489-b249-a1c5bae9dca0 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:10.772678 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 35/75] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 17 18:03:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:10.773482 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e7048-1ab2-4489-b249-a1c5bae9dca0 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:10.803806 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 41/76] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:03:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:03:10.804638 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d853a3-73f8-456e-aa93-afb1fd3f7a91 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:10.868503 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e7048-1ab2-4489-b249-a1c5bae9dca0 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:10.903684 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d853a3-73f8-456e-aa93-afb1fd3f7a91 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:10.903866 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ced370-bc6d-415f-9d16-af25873c3381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:10.904459 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ced370-bc6d-415f-9d16-af25873c3381 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:10.904746 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ced370-bc6d-415f-9d16-af25873c3381 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:10.905027 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ced370-bc6d-415f-9d16-af25873c3381 None admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:10.905909 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ced370-bc6d-415f-9d16-af25873c3381 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:10.906188 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ced370-bc6d-415f-9d16-af25873c3381 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:10.907653 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ced370-bc6d-415f-9d16-af25873c3381 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:10.916002 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 36/77] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 17 18:03:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:10.916816 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ced370-bc6d-415f-9d16-af25873c3381 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:10.937245 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dfda55-0bf2-4ffa-86f0-7252cff85600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:10.938245 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dfda55-0bf2-4ffa-86f0-7252cff85600 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:10.938526 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dfda55-0bf2-4ffa-86f0-7252cff85600 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:10.938804 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dfda55-0bf2-4ffa-86f0-7252cff85600 None admin] PATH_INFO: `/v3/users/f3c67b1de39b4a0db1d2d09839e38f88` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:10.951688 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dfda55-0bf2-4ffa-86f0-7252cff85600 None admin] RBAC: Authorizing `identity:get_user(user_id=f3c67b1de39b4a0db1d2d09839e38f88)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:10.953143 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dfda55-0bf2-4ffa-86f0-7252cff85600 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:10.955366 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 42/78] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 17 18:03:10 2022] GET /identity/v3/users/f3c67b1de39b4a0db1d2d09839e38f88 => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:10.956139 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dfda55-0bf2-4ffa-86f0-7252cff85600 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:11.011673 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ced370-bc6d-415f-9d16-af25873c3381 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:11.044502 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a13fe93-5274-476c-b599-e5a895398fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:11.045294 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a13fe93-5274-476c-b599-e5a895398fa5 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:11.045616 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a13fe93-5274-476c-b599-e5a895398fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:11.045894 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a13fe93-5274-476c-b599-e5a895398fa5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:11.048436 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dfda55-0bf2-4ffa-86f0-7252cff85600 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:11.057810 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a13fe93-5274-476c-b599-e5a895398fa5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:03:11.065487 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-6a13fe93-5274-476c-b599-e5a895398fa5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 18:03:11.065487 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:03:11.065487 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:03:11.065487 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:03:11.065487 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:03:11.065487 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:03:11.065487 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:03:11.065487 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:03:11.065487 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:03:11.065487 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:03:11.065487 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:03:11.065487 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:03:11.065487 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:03:11.065487 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:03:11.065487 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:03:11.065487 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:03:11.066407 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:03:11.066407 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:03:11.066407 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:03:11.066407 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:03:11.066407 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:03:11.066407 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:03:11.066407 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:03:11.066407 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:03:11.066407 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:03:11.066407 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:03:11.066407 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:03:11.066407 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:03:11.066407 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:03:11.066407 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:03:11.066407 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:03:11.066407 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:03:11.067414 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:03:11.067414 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:03:11.067414 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:03:11.067414 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:03:11.067414 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:03:11.067414 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:03:11.067414 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:03:11.067414 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:03:11.067414 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:03:11.067414 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:03:11.067414 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 18:03:11.067414 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:03:11.067414 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 37/79] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 17 18:03:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:03:11.068692 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a13fe93-5274-476c-b599-e5a895398fa5 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:11.080979 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a72865-133a-4aa5-95b2-5a922244192c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:11.081883 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a72865-133a-4aa5-95b2-5a922244192c None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:11.082169 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a72865-133a-4aa5-95b2-5a922244192c None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:11.082449 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a72865-133a-4aa5-95b2-5a922244192c None admin] PATH_INFO: `/v3/users/8763b2e915c44d8688900867e35dfda6` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:11.083638 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a72865-133a-4aa5-95b2-5a922244192c None admin] RBAC: Authorizing `identity:get_user(user_id=8763b2e915c44d8688900867e35dfda6)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:11.085088 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a72865-133a-4aa5-95b2-5a922244192c None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:11.086801 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 43/80] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 17 18:03:10 2022] GET /identity/v3/users/8763b2e915c44d8688900867e35dfda6 => generated 247 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:11.087561 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a72865-133a-4aa5-95b2-5a922244192c None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:11.168380 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a13fe93-5274-476c-b599-e5a895398fa5 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:11.178176 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a72865-133a-4aa5-95b2-5a922244192c None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:11.200286 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede699d1-b6f8-44f7-ac8c-8e9931de3a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:11.201069 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede699d1-b6f8-44f7-ac8c-8e9931de3a23 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:11.201353 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede699d1-b6f8-44f7-ac8c-8e9931de3a23 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:11.201658 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede699d1-b6f8-44f7-ac8c-8e9931de3a23 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:11.202834 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede699d1-b6f8-44f7-ac8c-8e9931de3a23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:11.204350 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede699d1-b6f8-44f7-ac8c-8e9931de3a23 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:11.205990 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 38/81] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:03:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:11.206759 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede699d1-b6f8-44f7-ac8c-8e9931de3a23 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:11.214092 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b898e72-84c9-44b9-b1b0-02a61a6f4a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:11.214969 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b898e72-84c9-44b9-b1b0-02a61a6f4a6f None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:11.215251 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b898e72-84c9-44b9-b1b0-02a61a6f4a6f None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:11.215525 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b898e72-84c9-44b9-b1b0-02a61a6f4a6f None admin] PATH_INFO: `/v3/users/f3c67b1de39b4a0db1d2d09839e38f88` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:11.216712 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b898e72-84c9-44b9-b1b0-02a61a6f4a6f None admin] RBAC: Authorizing `identity:get_user(user_id=f3c67b1de39b4a0db1d2d09839e38f88)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:11.218200 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b898e72-84c9-44b9-b1b0-02a61a6f4a6f None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:11.220300 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 44/82] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 17 18:03:11 2022] GET /identity/v3/users/f3c67b1de39b4a0db1d2d09839e38f88 => generated 275 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:11.221054 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b898e72-84c9-44b9-b1b0-02a61a6f4a6f None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:11.299872 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede699d1-b6f8-44f7-ac8c-8e9931de3a23 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:11.312390 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b898e72-84c9-44b9-b1b0-02a61a6f4a6f None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:11.331934 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d268e-f990-431c-8c67-4adcf320f305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:11.332575 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d268e-f990-431c-8c67-4adcf320f305 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:11.332858 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d268e-f990-431c-8c67-4adcf320f305 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:11.333139 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d268e-f990-431c-8c67-4adcf320f305 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:11.345230 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13470d9-10fc-44ff-a9e8-412304b18b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:11.345920 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13470d9-10fc-44ff-a9e8-412304b18b22 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:11.346199 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13470d9-10fc-44ff-a9e8-412304b18b22 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:11.346475 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13470d9-10fc-44ff-a9e8-412304b18b22 None admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:11.347221 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13470d9-10fc-44ff-a9e8-412304b18b22 None admin] RBAC: Adding query filter params (name=member) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:11.347527 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13470d9-10fc-44ff-a9e8-412304b18b22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:11.348912 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13470d9-10fc-44ff-a9e8-412304b18b22 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:11.356614 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 45/83] 10.222.0.65 () {56 vars in 1101 bytes} [Tue May 17 18:03:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:11.357393 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13470d9-10fc-44ff-a9e8-412304b18b22 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:11.397571 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8d268e-f990-431c-8c67-4adcf320f305 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:11.399050 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8d268e-f990-431c-8c67-4adcf320f305 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:11.451895 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13470d9-10fc-44ff-a9e8-412304b18b22 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:11.487527 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c621140-4f02-40ab-bbab-d8d6a8206669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:11.488174 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c621140-4f02-40ab-bbab-d8d6a8206669 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:11.488459 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c621140-4f02-40ab-bbab-d8d6a8206669 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:11.488733 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c621140-4f02-40ab-bbab-d8d6a8206669 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:11.494299 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 39/84] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 17 18:03:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 18:03:11.495064 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d268e-f990-431c-8c67-4adcf320f305 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:11.553209 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c621140-4f02-40ab-bbab-d8d6a8206669 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:11.554728 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c621140-4f02-40ab-bbab-d8d6a8206669 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:11.587691 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d268e-f990-431c-8c67-4adcf320f305 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:11.619612 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb618b-95c5-4bd0-9f2c-6e01351c7f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:11.620268 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb618b-95c5-4bd0-9f2c-6e01351c7f8f None admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:11.620555 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb618b-95c5-4bd0-9f2c-6e01351c7f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:11.620834 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb618b-95c5-4bd0-9f2c-6e01351c7f8f None admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:11.621569 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbb618b-95c5-4bd0-9f2c-6e01351c7f8f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:11.622995 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbb618b-95c5-4bd0-9f2c-6e01351c7f8f None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:11.646425 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 46/85] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 17 18:03:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 18:03:11.647287 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c621140-4f02-40ab-bbab-d8d6a8206669 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:11.653506 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 40/86] 10.222.0.65 () {60 vars in 1132 bytes} [Tue May 17 18:03:11 2022] POST /identity/v3/users => generated 289 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:03:11.654351 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb618b-95c5-4bd0-9f2c-6e01351c7f8f None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:11.749721 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c621140-4f02-40ab-bbab-d8d6a8206669 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:11.759787 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb618b-95c5-4bd0-9f2c-6e01351c7f8f None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:11.784977 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58cffbc-d171-4fd1-8ca6-ed8fa8267b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:11.785716 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58cffbc-d171-4fd1-8ca6-ed8fa8267b32 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:11.785994 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58cffbc-d171-4fd1-8ca6-ed8fa8267b32 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:11.786263 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58cffbc-d171-4fd1-8ca6-ed8fa8267b32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:11.795060 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23d5b1-fde0-4146-b7dc-d827e987b222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:11.795959 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23d5b1-fde0-4146-b7dc-d827e987b222 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:11.796245 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23d5b1-fde0-4146-b7dc-d827e987b222 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:11.796520 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23d5b1-fde0-4146-b7dc-d827e987b222 None admin] PATH_INFO: `/v3/users/f3c67b1de39b4a0db1d2d09839e38f88` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:11.798370 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae23d5b1-fde0-4146-b7dc-d827e987b222 None admin] RBAC: Authorizing `identity:get_user(user_id=f3c67b1de39b4a0db1d2d09839e38f88)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:11.799883 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae23d5b1-fde0-4146-b7dc-d827e987b222 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:11.806612 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 41/87] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 17 18:03:11 2022] GET /identity/v3/users/f3c67b1de39b4a0db1d2d09839e38f88 => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:11.806612 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23d5b1-fde0-4146-b7dc-d827e987b222 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:11.857623 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58cffbc-d171-4fd1-8ca6-ed8fa8267b32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:11.859106 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58cffbc-d171-4fd1-8ca6-ed8fa8267b32 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:11.907675 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23d5b1-fde0-4146-b7dc-d827e987b222 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:11.944039 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7087cd-3c58-4f78-b02e-1689e82cf412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:11.944914 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7087cd-3c58-4f78-b02e-1689e82cf412 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:11.945193 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7087cd-3c58-4f78-b02e-1689e82cf412 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:11.945496 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7087cd-3c58-4f78-b02e-1689e82cf412 None admin] PATH_INFO: `/v3/projects/d7cf4e05380e477d8f7793c92acc9742` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:11.946835 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7087cd-3c58-4f78-b02e-1689e82cf412 None admin] RBAC: Authorizing `identity:get_project(project_id=d7cf4e05380e477d8f7793c92acc9742)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:11.948262 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7087cd-3c58-4f78-b02e-1689e82cf412 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:11.950400 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 42/88] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 17 18:03:11 2022] GET /identity/v3/projects/d7cf4e05380e477d8f7793c92acc9742 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:11.951210 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7087cd-3c58-4f78-b02e-1689e82cf412 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:11.974531 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 47/89] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 17 18:03:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 18:03:11.975817 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58cffbc-d171-4fd1-8ca6-ed8fa8267b32 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:12.060547 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7087cd-3c58-4f78-b02e-1689e82cf412 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:12.085997 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58cffbc-d171-4fd1-8ca6-ed8fa8267b32 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:12.095648 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ab089-1c2d-4819-8f0c-6c3c52068c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:12.096505 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ab089-1c2d-4819-8f0c-6c3c52068c26 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:12.096785 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ab089-1c2d-4819-8f0c-6c3c52068c26 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:12.097055 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ab089-1c2d-4819-8f0c-6c3c52068c26 None admin] PATH_INFO: `/v3/projects/d7cf4e05380e477d8f7793c92acc9742` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:12.098355 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ab089-1c2d-4819-8f0c-6c3c52068c26 None admin] RBAC: Authorizing `identity:get_project(project_id=d7cf4e05380e477d8f7793c92acc9742)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:12.099804 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ab089-1c2d-4819-8f0c-6c3c52068c26 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:12.101762 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 43/90] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 17 18:03:11 2022] GET /identity/v3/projects/d7cf4e05380e477d8f7793c92acc9742 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:12.102311 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ab089-1c2d-4819-8f0c-6c3c52068c26 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:12.123531 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a11cc8d-5ac9-4e47-9443-cc75e2135c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:12.124276 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11cc8d-5ac9-4e47-9443-cc75e2135c79 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:12.124599 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11cc8d-5ac9-4e47-9443-cc75e2135c79 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:12.124903 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11cc8d-5ac9-4e47-9443-cc75e2135c79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:12.198872 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a11cc8d-5ac9-4e47-9443-cc75e2135c79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:12.200482 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a11cc8d-5ac9-4e47-9443-cc75e2135c79 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:12.203307 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ab089-1c2d-4819-8f0c-6c3c52068c26 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:12.237998 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7526288-95db-4a2c-b776-4731574c3b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:12.238653 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7526288-95db-4a2c-b776-4731574c3b35 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:12.238935 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7526288-95db-4a2c-b776-4731574c3b35 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:12.239206 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7526288-95db-4a2c-b776-4731574c3b35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:12.240040 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7526288-95db-4a2c-b776-4731574c3b35 None admin] RBAC: Adding query filter params (role.id=2af599fd3ad74031901ea2d9e0408884, scope.project.id=d7cf4e05380e477d8f7793c92acc9742, user.id=f3c67b1de39b4a0db1d2d09839e38f88) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:12.240351 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7526288-95db-4a2c-b776-4731574c3b35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:12.241816 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7526288-95db-4a2c-b776-4731574c3b35 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:12.249586 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 44/91] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 17 18:03:12 2022] GET /identity/v3/role_assignments?user.id=f3c67b1de39b4a0db1d2d09839e38f88&scope.project.id=d7cf4e05380e477d8f7793c92acc9742&role.id=2af599fd3ad74031901ea2d9e0408884 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:12.250487 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7526288-95db-4a2c-b776-4731574c3b35 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:12.314406 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 48/92] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 17 18:03:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 18:03:12.315543 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a11cc8d-5ac9-4e47-9443-cc75e2135c79 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:12.457568 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7526288-95db-4a2c-b776-4731574c3b35 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:12.478296 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a11cc8d-5ac9-4e47-9443-cc75e2135c79 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:12.518342 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f09f90-35f7-4971-9053-f950024f8904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:12.519218 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f09f90-35f7-4971-9053-f950024f8904 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:12.519820 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f09f90-35f7-4971-9053-f950024f8904 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:12.520106 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f09f90-35f7-4971-9053-f950024f8904 None admin] PATH_INFO: `/v3/projects/d7cf4e05380e477d8f7793c92acc9742` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:12.521485 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f09f90-35f7-4971-9053-f950024f8904 None admin] RBAC: Authorizing `identity:get_project(project_id=d7cf4e05380e477d8f7793c92acc9742)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:12.523595 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f09f90-35f7-4971-9053-f950024f8904 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:12.525350 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 45/93] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 17 18:03:12 2022] GET /identity/v3/projects/d7cf4e05380e477d8f7793c92acc9742 => generated 298 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:12.526163 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f09f90-35f7-4971-9053-f950024f8904 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:12.542182 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901976c6-aece-459d-b209-6c59fee0e987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:12.542850 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901976c6-aece-459d-b209-6c59fee0e987 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:12.543126 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901976c6-aece-459d-b209-6c59fee0e987 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:12.543397 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901976c6-aece-459d-b209-6c59fee0e987 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:12.544238 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901976c6-aece-459d-b209-6c59fee0e987 None admin] RBAC: Adding query filter params (role.id=332c8d70fd0f41e2beea20aaead5daa5, scope.project.id=d7cf4e05380e477d8f7793c92acc9742, user.id=8763b2e915c44d8688900867e35dfda6) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:12.544542 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901976c6-aece-459d-b209-6c59fee0e987 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:12.546015 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901976c6-aece-459d-b209-6c59fee0e987 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:12.558515 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 49/94] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 17 18:03:12 2022] GET /identity/v3/role_assignments?user.id=8763b2e915c44d8688900867e35dfda6&scope.project.id=d7cf4e05380e477d8f7793c92acc9742&role.id=332c8d70fd0f41e2beea20aaead5daa5 => generated 259 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:12.559361 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901976c6-aece-459d-b209-6c59fee0e987 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:12.721487 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f09f90-35f7-4971-9053-f950024f8904 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:12.758896 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07523307-e36a-4565-b938-b8489ca11062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:12.765488 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07523307-e36a-4565-b938-b8489ca11062 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:12.765488 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07523307-e36a-4565-b938-b8489ca11062 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:12.765488 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07523307-e36a-4565-b938-b8489ca11062 None admin] PATH_INFO: `/v3/projects/a8a3bc1433894064824b80fbc711c006` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:12.765488 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07523307-e36a-4565-b938-b8489ca11062 None admin] RBAC: Authorizing `identity:get_project(project_id=a8a3bc1433894064824b80fbc711c006)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:12.767749 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07523307-e36a-4565-b938-b8489ca11062 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:12.774054 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 46/95] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 17 18:03:12 2022] GET /identity/v3/projects/a8a3bc1433894064824b80fbc711c006 => generated 312 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:12.777617 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07523307-e36a-4565-b938-b8489ca11062 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:12.926540 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901976c6-aece-459d-b209-6c59fee0e987 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:12.964913 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07523307-e36a-4565-b938-b8489ca11062 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:13.038411 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fcb8b8-8ccf-4394-880c-580ef2d6f791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:13.038999 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fcb8b8-8ccf-4394-880c-580ef2d6f791 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:13.039285 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fcb8b8-8ccf-4394-880c-580ef2d6f791 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:13.044487 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fcb8b8-8ccf-4394-880c-580ef2d6f791 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:13.044487 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fcb8b8-8ccf-4394-880c-580ef2d6f791 None admin] RBAC: Adding query filter params (role.id=2af599fd3ad74031901ea2d9e0408884, scope.project.id=a8a3bc1433894064824b80fbc711c006, user.id=f3c67b1de39b4a0db1d2d09839e38f88) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:13.044487 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fcb8b8-8ccf-4394-880c-580ef2d6f791 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:13.044487 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fcb8b8-8ccf-4394-880c-580ef2d6f791 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:13.066263 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2af0551-3150-4f74-80ee-c4bb9f968e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:13.067276 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af0551-3150-4f74-80ee-c4bb9f968e36 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:13.067602 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af0551-3150-4f74-80ee-c4bb9f968e36 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:13.067874 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 47/96] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 17 18:03:12 2022] GET /identity/v3/role_assignments?user.id=f3c67b1de39b4a0db1d2d09839e38f88&scope.project.id=a8a3bc1433894064824b80fbc711c006&role.id=2af599fd3ad74031901ea2d9e0408884 => generated 259 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:13.068300 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af0551-3150-4f74-80ee-c4bb9f968e36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:13.068987 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2af0551-3150-4f74-80ee-c4bb9f968e36 None admin] RBAC: Adding query filter params (role.id=c3b3265cd6364fbcb22a731040b7b47a, scope.project.id=d7cf4e05380e477d8f7793c92acc9742, user.id=f3c67b1de39b4a0db1d2d09839e38f88) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:13.069311 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2af0551-3150-4f74-80ee-c4bb9f968e36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:13.070878 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2af0551-3150-4f74-80ee-c4bb9f968e36 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:13.085870 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 50/97] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 17 18:03:12 2022] GET /identity/v3/role_assignments?user.id=f3c67b1de39b4a0db1d2d09839e38f88&scope.project.id=d7cf4e05380e477d8f7793c92acc9742&role.id=c3b3265cd6364fbcb22a731040b7b47a => generated 259 bytes in 527 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:14.712444 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed28da6-1094-4873-879f-959381ce80f3 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:14.712994 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed28da6-1094-4873-879f-959381ce80f3 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:14.712994 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed28da6-1094-4873-879f-959381ce80f3 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:14.714406 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 48/98] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:03:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:03:14.729979 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a8c9f-2760-465d-ab9d-f221f748b2a9 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:14.730409 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a8c9f-2760-465d-ab9d-f221f748b2a9 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:14.730535 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a8c9f-2760-465d-ab9d-f221f748b2a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:14.751014 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-bc3a8c9f-2760-465d-ab9d-f221f748b2a9 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:03:14.752461 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-bc3a8c9f-2760-465d-ab9d-f221f748b2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:03:14.795396 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5117f8c-6ff2-47d5-a1ce-c21a744baafa None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:14.796000 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5117f8c-6ff2-47d5-a1ce-c21a744baafa None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:14.796470 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5117f8c-6ff2-47d5-a1ce-c21a744baafa None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:14.798817 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 49/99] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:03:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:03:14.804044 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360003d6-2354-4665-b72b-ab7b04635e6d None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:14.804574 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360003d6-2354-4665-b72b-ab7b04635e6d None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:14.805051 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360003d6-2354-4665-b72b-ab7b04635e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:14.840998 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 51/100] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:03:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:03:14.842320 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-360003d6-2354-4665-b72b-ab7b04635e6d None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:03:14.843793 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-360003d6-2354-4665-b72b-ab7b04635e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:03:14.878613 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a8c9f-2760-465d-ab9d-f221f748b2a9 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:14.964587 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 50/101] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:03:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:03:15.003502 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360003d6-2354-4665-b72b-ab7b04635e6d None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:15.038756 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a8c9f-2760-465d-ab9d-f221f748b2a9 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:15.114250 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf0182-fe86-4295-800e-8099e1ae0bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:15.115154 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf0182-fe86-4295-800e-8099e1ae0bda None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:15.115473 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf0182-fe86-4295-800e-8099e1ae0bda None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:15.115773 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf0182-fe86-4295-800e-8099e1ae0bda None admin] PATH_INFO: `/v3/domains/default` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:15.117093 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decf0182-fe86-4295-800e-8099e1ae0bda None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:15.118905 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decf0182-fe86-4295-800e-8099e1ae0bda None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:15.121111 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 52/102] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:03:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:03:15.127855 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf0182-fe86-4295-800e-8099e1ae0bda None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:15.171050 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360003d6-2354-4665-b72b-ab7b04635e6d None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:15.235739 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8baaf1b-06f4-4702-9420-36a555f4107f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:15.236785 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8baaf1b-06f4-4702-9420-36a555f4107f None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:15.237219 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8baaf1b-06f4-4702-9420-36a555f4107f None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:15.237677 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8baaf1b-06f4-4702-9420-36a555f4107f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:15.248374 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf0182-fe86-4295-800e-8099e1ae0bda None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:15.254610 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8baaf1b-06f4-4702-9420-36a555f4107f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:03:15.270934 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-f8baaf1b-06f4-4702-9420-36a555f4107f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 17 18:03:15.270934 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:03:15.270934 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:03:15.270934 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:03:15.270934 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:03:15.270934 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:03:15.270934 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:03:15.270934 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:03:15.270934 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:03:15.270934 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:03:15.270934 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:03:15.270934 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:03:15.270934 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:03:15.270934 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:03:15.270934 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:03:15.270934 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:03:15.272156 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:03:15.272156 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:03:15.272156 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:03:15.272156 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:03:15.272156 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:03:15.272156 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:03:15.272156 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:03:15.272156 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:03:15.272156 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:03:15.272156 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:03:15.272156 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:03:15.272156 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:03:15.272156 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:03:15.272156 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:03:15.272156 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:03:15.272156 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:03:15.273302 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:03:15.273302 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:03:15.273302 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:03:15.273302 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:03:15.273302 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:03:15.273302 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:03:15.273302 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:03:15.273302 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:03:15.273302 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:03:15.273302 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:03:15.273302 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 17 18:03:15.273302 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:03:15.273302 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 51/103] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 17 18:03:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:03:15.277826 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8baaf1b-06f4-4702-9420-36a555f4107f None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:15.302292 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99238a3-cb64-4c98-9ea2-172ec7770c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:15.303334 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99238a3-cb64-4c98-9ea2-172ec7770c59 None admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:15.303818 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99238a3-cb64-4c98-9ea2-172ec7770c59 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:15.304277 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99238a3-cb64-4c98-9ea2-172ec7770c59 None admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:15.305267 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99238a3-cb64-4c98-9ea2-172ec7770c59 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:15.307043 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99238a3-cb64-4c98-9ea2-172ec7770c59 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:15.347728 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 53/104] 10.222.0.65 () {60 vars in 1141 bytes} [Tue May 17 18:03:15 2022] POST /identity/v3/projects => generated 302 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:03:15.386816 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8baaf1b-06f4-4702-9420-36a555f4107f None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:15.429031 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2104198-ff3e-48bd-ace2-36bb50751b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:15.429793 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2104198-ff3e-48bd-ace2-36bb50751b56 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:15.430082 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2104198-ff3e-48bd-ace2-36bb50751b56 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:15.430362 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2104198-ff3e-48bd-ace2-36bb50751b56 None admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:15.431129 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2104198-ff3e-48bd-ace2-36bb50751b56 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:15.431433 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2104198-ff3e-48bd-ace2-36bb50751b56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:15.432834 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2104198-ff3e-48bd-ace2-36bb50751b56 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:15.448742 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 52/105] 10.222.0.65 () {56 vars in 1101 bytes} [Tue May 17 18:03:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:03:15.454974 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99238a3-cb64-4c98-9ea2-172ec7770c59 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:15.606181 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99238a3-cb64-4c98-9ea2-172ec7770c59 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:15.654676 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f2fd3-5c86-4150-9f53-dc02820185c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:15.655574 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f2fd3-5c86-4150-9f53-dc02820185c8 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:15.655900 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f2fd3-5c86-4150-9f53-dc02820185c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:15.656180 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f2fd3-5c86-4150-9f53-dc02820185c8 None admin] PATH_INFO: `/v3/users/49dc952b9d904831a726eeaa23990861` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:15.678818 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615f2fd3-5c86-4150-9f53-dc02820185c8 None admin] RBAC: Authorizing `identity:get_user(user_id=49dc952b9d904831a726eeaa23990861)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:15.680425 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615f2fd3-5c86-4150-9f53-dc02820185c8 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:15.682595 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 54/106] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 17 18:03:15 2022] GET /identity/v3/users/49dc952b9d904831a726eeaa23990861 => generated 289 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:15.688571 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2104198-ff3e-48bd-ace2-36bb50751b56 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:15.835619 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2104198-ff3e-48bd-ace2-36bb50751b56 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:15.877967 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eba1d5-aa58-4ae9-9166-02f731af77ad None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:15.878534 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eba1d5-aa58-4ae9-9166-02f731af77ad None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:15.878534 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eba1d5-aa58-4ae9-9166-02f731af77ad None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:15.879875 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 55/107] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:03:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:03:15.884209 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d78b9e-a4a0-4ab1-b9b6-89af72231022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:15.884866 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d78b9e-a4a0-4ab1-b9b6-89af72231022 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:15.885147 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d78b9e-a4a0-4ab1-b9b6-89af72231022 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:15.885422 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d78b9e-a4a0-4ab1-b9b6-89af72231022 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:15.887218 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a75ad0-8c69-4c18-8c2f-d07e9f5319f4 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:15.887498 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a75ad0-8c69-4c18-8c2f-d07e9f5319f4 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:15.887771 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a75ad0-8c69-4c18-8c2f-d07e9f5319f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:15.917199 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-d5a75ad0-8c69-4c18-8c2f-d07e9f5319f4 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:03:15.918760 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-d5a75ad0-8c69-4c18-8c2f-d07e9f5319f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:03:15.964197 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d78b9e-a4a0-4ab1-b9b6-89af72231022 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:15.965847 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d78b9e-a4a0-4ab1-b9b6-89af72231022 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:15.990624 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 56/108] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:03:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:03:15.992385 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20f2df-1f24-40e3-ac2d-78b1b797e16c None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:15.992886 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20f2df-1f24-40e3-ac2d-78b1b797e16c None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:15.993375 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20f2df-1f24-40e3-ac2d-78b1b797e16c None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:15.994873 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 57/109] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:03:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:03:16.000960 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1c27f-20f0-4dac-bde0-5a794a7aeafc None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:16.001532 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1c27f-20f0-4dac-bde0-5a794a7aeafc None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:16.002019 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1c27f-20f0-4dac-bde0-5a794a7aeafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:16.019425 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-49b1c27f-20f0-4dac-bde0-5a794a7aeafc None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:03:16.020924 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-49b1c27f-20f0-4dac-bde0-5a794a7aeafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:03:16.077688 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 53/110] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 17 18:03:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 18:03:16.079371 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d78b9e-a4a0-4ab1-b9b6-89af72231022 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:16.094688 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 58/111] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:03:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 18:03:16.095932 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b1c27f-20f0-4dac-bde0-5a794a7aeafc None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:16.190372 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d78b9e-a4a0-4ab1-b9b6-89af72231022 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:16.205748 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b1c27f-20f0-4dac-bde0-5a794a7aeafc None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:16.229068 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c67dbef-c780-4806-9238-3e73ec2a2895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:16.230845 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67dbef-c780-4806-9238-3e73ec2a2895 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:16.231575 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67dbef-c780-4806-9238-3e73ec2a2895 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:16.232248 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67dbef-c780-4806-9238-3e73ec2a2895 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:16.241790 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e79782-f267-4e21-9f34-88e4219020a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:16.242959 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e79782-f267-4e21-9f34-88e4219020a2 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:16.243450 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e79782-f267-4e21-9f34-88e4219020a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:16.243928 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e79782-f267-4e21-9f34-88e4219020a2 None admin] PATH_INFO: `/v3/projects/d7cf4e05380e477d8f7793c92acc9742` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:16.245706 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e79782-f267-4e21-9f34-88e4219020a2 None admin] RBAC: Authorizing `identity:get_project(project_id=d7cf4e05380e477d8f7793c92acc9742)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:16.246207 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c67dbef-c780-4806-9238-3e73ec2a2895 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:03:16.247698 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e79782-f267-4e21-9f34-88e4219020a2 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:16.250076 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 59/112] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 17 18:03:16 2022] GET /identity/v3/projects/d7cf4e05380e477d8f7793c92acc9742 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:16.251593 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e79782-f267-4e21-9f34-88e4219020a2 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:16.256639 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-2c67dbef-c780-4806-9238-3e73ec2a2895 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:03:16.256639 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:03:16.256639 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:03:16.256639 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:03:16.256639 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:03:16.256639 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:03:16.256639 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:03:16.256639 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:03:16.256639 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:03:16.256639 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:03:16.256639 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:03:16.256639 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:03:16.256639 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:03:16.256639 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:03:16.256639 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:03:16.256639 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:03:16.257525 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:03:16.257525 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:03:16.257525 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:03:16.257525 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:03:16.257525 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:03:16.257525 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:03:16.257525 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:03:16.257525 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:03:16.257525 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:03:16.257525 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:03:16.257525 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:03:16.257525 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:03:16.257525 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:03:16.257525 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:03:16.257525 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:03:16.257525 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:03:16.258301 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:03:16.258301 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:03:16.258301 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:03:16.258301 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:03:16.258301 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:03:16.258301 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:03:16.258301 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:03:16.258301 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:03:16.258301 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:03:16.258301 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:03:16.258301 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:03:16.258301 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:03:16.258301 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 54/113] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 17 18:03:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:03:16.258301 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c67dbef-c780-4806-9238-3e73ec2a2895 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:16.364791 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c67dbef-c780-4806-9238-3e73ec2a2895 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:16.365490 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e79782-f267-4e21-9f34-88e4219020a2 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:16.400017 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0174a714-aebb-4ce6-aac4-0df83d90b70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:16.401209 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174a714-aebb-4ce6-aac4-0df83d90b70f None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:16.401441 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53049f94-ec83-4620-9bb5-406457b3fa3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:16.401969 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174a714-aebb-4ce6-aac4-0df83d90b70f None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:16.402152 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53049f94-ec83-4620-9bb5-406457b3fa3e None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:16.402444 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53049f94-ec83-4620-9bb5-406457b3fa3e None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:16.402748 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53049f94-ec83-4620-9bb5-406457b3fa3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:16.403012 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174a714-aebb-4ce6-aac4-0df83d90b70f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:16.403628 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53049f94-ec83-4620-9bb5-406457b3fa3e None admin] RBAC: Adding query filter params (role.id=6f39f2f8bcc04c11b768de7f0c994fd7, scope.project.id=d7cf4e05380e477d8f7793c92acc9742, user.id=49dc952b9d904831a726eeaa23990861) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:16.404096 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53049f94-ec83-4620-9bb5-406457b3fa3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:16.405769 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53049f94-ec83-4620-9bb5-406457b3fa3e None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:16.413217 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 55/114] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 17 18:03:16 2022] GET /identity/v3/role_assignments?user.id=49dc952b9d904831a726eeaa23990861&scope.project.id=d7cf4e05380e477d8f7793c92acc9742&role.id=6f39f2f8bcc04c11b768de7f0c994fd7 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:16.414169 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53049f94-ec83-4620-9bb5-406457b3fa3e None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:16.422772 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0174a714-aebb-4ce6-aac4-0df83d90b70f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:03:16.431066 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-0174a714-aebb-4ce6-aac4-0df83d90b70f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 18:03:16.431066 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:03:16.431066 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:03:16.431066 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:03:16.431066 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:03:16.431066 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:03:16.431066 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:03:16.431066 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:03:16.431066 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:03:16.431066 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:03:16.431066 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:03:16.431066 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:03:16.431066 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:03:16.431066 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:03:16.431066 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:03:16.431066 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:03:16.431924 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:03:16.431924 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:03:16.431924 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:03:16.431924 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:03:16.431924 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:03:16.431924 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:03:16.431924 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:03:16.431924 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:03:16.431924 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:03:16.431924 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:03:16.431924 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:03:16.431924 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:03:16.431924 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:03:16.431924 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:03:16.431924 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:03:16.431924 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:03:16.432698 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:03:16.432698 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:03:16.432698 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:03:16.432698 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:03:16.432698 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:03:16.432698 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:03:16.432698 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:03:16.432698 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:03:16.432698 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:03:16.432698 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:03:16.432698 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 18:03:16.432698 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:03:16.435079 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 60/115] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 17 18:03:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:03:16.441973 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0174a714-aebb-4ce6-aac4-0df83d90b70f None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:16.617984 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53049f94-ec83-4620-9bb5-406457b3fa3e None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:16.678825 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0174a714-aebb-4ce6-aac4-0df83d90b70f None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:16.696785 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e19fb5-4454-4b42-9b8c-f31a42cad57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:16.698504 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e19fb5-4454-4b42-9b8c-f31a42cad57a None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:16.699014 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e19fb5-4454-4b42-9b8c-f31a42cad57a None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:16.699519 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e19fb5-4454-4b42-9b8c-f31a42cad57a None admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:16.700822 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e19fb5-4454-4b42-9b8c-f31a42cad57a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:16.701555 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e19fb5-4454-4b42-9b8c-f31a42cad57a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:16.704185 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e19fb5-4454-4b42-9b8c-f31a42cad57a None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:16.716039 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 56/116] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 17 18:03:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:16.718820 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb67ed-a7b1-4384-9cf0-59dc9cafcfa2 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:16.719419 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb67ed-a7b1-4384-9cf0-59dc9cafcfa2 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:16.720154 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebb67ed-a7b1-4384-9cf0-59dc9cafcfa2 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:16.723092 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 57/117] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:03:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:03:16.724742 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebb67ed-a7b1-4384-9cf0-59dc9cafcfa2 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:16.733588 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f554a40-08fb-43ad-93bf-defbe6c2a372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:16.734323 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f554a40-08fb-43ad-93bf-defbe6c2a372 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:16.735188 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f554a40-08fb-43ad-93bf-defbe6c2a372 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:16.735494 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f554a40-08fb-43ad-93bf-defbe6c2a372 None admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:16.736367 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f554a40-08fb-43ad-93bf-defbe6c2a372 None admin] RBAC: Adding query filter params (name=member) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:16.736709 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f554a40-08fb-43ad-93bf-defbe6c2a372 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:16.741482 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f554a40-08fb-43ad-93bf-defbe6c2a372 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:16.758051 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 61/118] 10.222.0.65 () {56 vars in 1101 bytes} [Tue May 17 18:03:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:03:16.759524 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81faa31-43ba-4dfb-be69-75218e20b93d None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:16.759843 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81faa31-43ba-4dfb-be69-75218e20b93d None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:16.760158 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81faa31-43ba-4dfb-be69-75218e20b93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:16.802680 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-a81faa31-43ba-4dfb-be69-75218e20b93d None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:03:16.804153 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-a81faa31-43ba-4dfb-be69-75218e20b93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:03:16.869088 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebb67ed-a7b1-4384-9cf0-59dc9cafcfa2 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:16.905610 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4099fa73-afeb-4ab9-8fbf-10c1cea57d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:16.907130 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4099fa73-afeb-4ab9-8fbf-10c1cea57d29 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:16.907416 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4099fa73-afeb-4ab9-8fbf-10c1cea57d29 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:16.907712 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4099fa73-afeb-4ab9-8fbf-10c1cea57d29 None admin] PATH_INFO: `/v3/users/8763b2e915c44d8688900867e35dfda6` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:16.909119 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4099fa73-afeb-4ab9-8fbf-10c1cea57d29 None admin] RBAC: Authorizing `identity:get_user(user_id=8763b2e915c44d8688900867e35dfda6)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:16.910713 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4099fa73-afeb-4ab9-8fbf-10c1cea57d29 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:16.912675 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 58/119] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 17 18:03:16 2022] GET /identity/v3/users/8763b2e915c44d8688900867e35dfda6 => generated 247 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:16.913610 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4099fa73-afeb-4ab9-8fbf-10c1cea57d29 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:16.933208 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 62/120] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:03:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:03:16.935239 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451aba3-7a48-4e5c-a298-50b941251d58 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:16.935736 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451aba3-7a48-4e5c-a298-50b941251d58 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:16.936219 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451aba3-7a48-4e5c-a298-50b941251d58 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:16.937985 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 63/121] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:03:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:03:16.943366 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a451aba3-7a48-4e5c-a298-50b941251d58 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:17.022338 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4099fa73-afeb-4ab9-8fbf-10c1cea57d29 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:17.047014 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a451aba3-7a48-4e5c-a298-50b941251d58 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:17.059081 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c81090-97b5-4c71-a7e4-01ee8060bd07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:17.059938 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c81090-97b5-4c71-a7e4-01ee8060bd07 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:17.060280 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c81090-97b5-4c71-a7e4-01ee8060bd07 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:17.060566 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c81090-97b5-4c71-a7e4-01ee8060bd07 None admin] PATH_INFO: `/v3/users/f3c67b1de39b4a0db1d2d09839e38f88` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:17.061847 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c81090-97b5-4c71-a7e4-01ee8060bd07 None admin] RBAC: Authorizing `identity:get_user(user_id=f3c67b1de39b4a0db1d2d09839e38f88)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:17.063432 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c81090-97b5-4c71-a7e4-01ee8060bd07 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:17.065622 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 59/122] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 17 18:03:16 2022] GET /identity/v3/users/f3c67b1de39b4a0db1d2d09839e38f88 => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:17.067259 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c90ca0c-495e-4d17-828c-d2129465d5e9 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:17.067587 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c90ca0c-495e-4d17-828c-d2129465d5e9 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:17.067913 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c90ca0c-495e-4d17-828c-d2129465d5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:17.086404 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6a547e-3a65-4cd5-8c46-18cad2f49fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:17.087259 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a547e-3a65-4cd5-8c46-18cad2f49fe6 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:17.087541 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a547e-3a65-4cd5-8c46-18cad2f49fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:17.087817 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a547e-3a65-4cd5-8c46-18cad2f49fe6 None admin] PATH_INFO: `/v3/projects/d7cf4e05380e477d8f7793c92acc9742` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:17.089229 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-7c90ca0c-495e-4d17-828c-d2129465d5e9 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:03:17.090349 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6a547e-3a65-4cd5-8c46-18cad2f49fe6 None admin] RBAC: Authorizing `identity:get_project(project_id=d7cf4e05380e477d8f7793c92acc9742)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:17.090455 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-7c90ca0c-495e-4d17-828c-d2129465d5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:03:17.092488 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6a547e-3a65-4cd5-8c46-18cad2f49fe6 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:17.096000 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 64/123] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 17 18:03:16 2022] GET /identity/v3/projects/d7cf4e05380e477d8f7793c92acc9742 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:17.097078 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6a547e-3a65-4cd5-8c46-18cad2f49fe6 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:17.178496 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 60/124] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:03:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:03:17.180333 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c90ca0c-495e-4d17-828c-d2129465d5e9 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:17.232987 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6a547e-3a65-4cd5-8c46-18cad2f49fe6 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:17.271798 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed9440-d9af-4aa2-94f0-7ac6dae57bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:17.272824 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed9440-d9af-4aa2-94f0-7ac6dae57bc9 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:17.273045 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed9440-d9af-4aa2-94f0-7ac6dae57bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:17.273320 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed9440-d9af-4aa2-94f0-7ac6dae57bc9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:17.285919 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ed9440-d9af-4aa2-94f0-7ac6dae57bc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:03:17.296706 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-46ed9440-d9af-4aa2-94f0-7ac6dae57bc9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 18:03:17.296706 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:03:17.296706 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:03:17.296706 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:03:17.296706 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:03:17.296706 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:03:17.296706 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:03:17.296706 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:03:17.296706 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:03:17.296706 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:03:17.296706 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:03:17.296706 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:03:17.296706 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:03:17.296706 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:03:17.296706 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:03:17.296706 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:03:17.298188 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:03:17.298188 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:03:17.298188 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:03:17.298188 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:03:17.298188 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:03:17.298188 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:03:17.298188 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:03:17.298188 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:03:17.298188 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:03:17.298188 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:03:17.298188 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:03:17.298188 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:03:17.298188 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:03:17.298188 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:03:17.298188 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:03:17.298188 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:03:17.299064 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:03:17.299064 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:03:17.299064 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:03:17.299064 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:03:17.299064 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:03:17.299064 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:03:17.299064 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:03:17.299064 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:03:17.299064 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:03:17.299064 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:03:17.299064 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 18:03:17.299064 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:03:17.299064 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 65/125] 10.222.0.65 () {56 vars in 1114 bytes} [Tue May 17 18:03:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:03:17.299738 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed9440-d9af-4aa2-94f0-7ac6dae57bc9 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:17.320029 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c90ca0c-495e-4d17-828c-d2129465d5e9 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:17.369556 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e86354-d0d8-4b8c-be30-b67cf0f6f008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:17.370890 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e86354-d0d8-4b8c-be30-b67cf0f6f008 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:17.371354 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e86354-d0d8-4b8c-be30-b67cf0f6f008 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:17.371994 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e86354-d0d8-4b8c-be30-b67cf0f6f008 None admin] PATH_INFO: `/v3/projects/d7cf4e05380e477d8f7793c92acc9742` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:17.374364 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e86354-d0d8-4b8c-be30-b67cf0f6f008 None admin] RBAC: Authorizing `identity:get_project(project_id=d7cf4e05380e477d8f7793c92acc9742)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:17.376422 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e86354-d0d8-4b8c-be30-b67cf0f6f008 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:17.379719 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 61/126] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 17 18:03:17 2022] GET /identity/v3/projects/d7cf4e05380e477d8f7793c92acc9742 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:17.380964 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e86354-d0d8-4b8c-be30-b67cf0f6f008 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:17.417884 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ed9440-d9af-4aa2-94f0-7ac6dae57bc9 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:17.459211 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768bdbf-ebfe-47a3-acc0-c42500282f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:17.460417 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768bdbf-ebfe-47a3-acc0-c42500282f6d None admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:17.460702 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768bdbf-ebfe-47a3-acc0-c42500282f6d None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:17.460982 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768bdbf-ebfe-47a3-acc0-c42500282f6d None admin] PATH_INFO: `/v3/projects/d7cf4e05380e477d8f7793c92acc9742/users/8763b2e915c44d8688900867e35dfda6/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:17.464006 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c768bdbf-ebfe-47a3-acc0-c42500282f6d None admin] RBAC: Authorizing `identity:create_grant(project_id=d7cf4e05380e477d8f7793c92acc9742, user_id=8763b2e915c44d8688900867e35dfda6, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:17.466318 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c768bdbf-ebfe-47a3-acc0-c42500282f6d None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:17.482217 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 66/127] 10.222.0.65 () {58 vars in 1439 bytes} [Tue May 17 18:03:17 2022] PUT /identity/v3/projects/d7cf4e05380e477d8f7793c92acc9742/users/8763b2e915c44d8688900867e35dfda6/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:03:17.483217 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768bdbf-ebfe-47a3-acc0-c42500282f6d None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:17.506053 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e86354-d0d8-4b8c-be30-b67cf0f6f008 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:17.599178 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768bdbf-ebfe-47a3-acc0-c42500282f6d None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:17.634239 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415131ab-3b4a-4280-96ab-86de8f0545a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:17.635067 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415131ab-3b4a-4280-96ab-86de8f0545a7 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:17.635361 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415131ab-3b4a-4280-96ab-86de8f0545a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:17.635634 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415131ab-3b4a-4280-96ab-86de8f0545a7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:17.637940 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63baff01-bda2-4bf3-b74e-f268fab42931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:17.639033 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63baff01-bda2-4bf3-b74e-f268fab42931 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:17.639530 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63baff01-bda2-4bf3-b74e-f268fab42931 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:17.640034 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63baff01-bda2-4bf3-b74e-f268fab42931 None admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:17.641641 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63baff01-bda2-4bf3-b74e-f268fab42931 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:17.642184 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63baff01-bda2-4bf3-b74e-f268fab42931 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:17.643924 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63baff01-bda2-4bf3-b74e-f268fab42931 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:17.653796 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 67/128] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 17 18:03:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:17.655105 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63baff01-bda2-4bf3-b74e-f268fab42931 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:17.670485 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415131ab-3b4a-4280-96ab-86de8f0545a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:03:17.683280 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-415131ab-3b4a-4280-96ab-86de8f0545a7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 18:03:17.683280 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:03:17.683280 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:03:17.683280 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:03:17.683280 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:03:17.683280 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:03:17.683280 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:03:17.683280 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:03:17.683280 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:03:17.683280 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:03:17.683280 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:03:17.683280 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:03:17.683280 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:03:17.683280 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:03:17.683280 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:03:17.683280 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:03:17.684182 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:03:17.684182 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:03:17.684182 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:03:17.684182 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:03:17.684182 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:03:17.684182 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:03:17.684182 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:03:17.684182 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:03:17.684182 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:03:17.684182 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:03:17.684182 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:03:17.684182 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:03:17.684182 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:03:17.684182 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:03:17.684182 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:03:17.684182 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:03:17.684958 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:03:17.684958 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:03:17.684958 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:03:17.684958 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:03:17.684958 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:03:17.684958 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:03:17.684958 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:03:17.684958 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:03:17.684958 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:03:17.684958 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:03:17.684958 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 18:03:17.684958 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:03:17.684958 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 62/129] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 17 18:03:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:03:17.690360 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415131ab-3b4a-4280-96ab-86de8f0545a7 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:17.779408 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63baff01-bda2-4bf3-b74e-f268fab42931 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:17.818997 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415131ab-3b4a-4280-96ab-86de8f0545a7 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:17.819179 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae3426-7059-491e-9bdd-ce9e397074c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:17.820537 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae3426-7059-491e-9bdd-ce9e397074c6 None admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:17.821036 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae3426-7059-491e-9bdd-ce9e397074c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:17.822213 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae3426-7059-491e-9bdd-ce9e397074c6 None admin] PATH_INFO: `/v3/projects/d7cf4e05380e477d8f7793c92acc9742/users/f3c67b1de39b4a0db1d2d09839e38f88/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:17.824371 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae3426-7059-491e-9bdd-ce9e397074c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=d7cf4e05380e477d8f7793c92acc9742, user_id=f3c67b1de39b4a0db1d2d09839e38f88, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:17.826017 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae3426-7059-491e-9bdd-ce9e397074c6 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:17.851892 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 68/130] 10.222.0.65 () {58 vars in 1439 bytes} [Tue May 17 18:03:17 2022] PUT /identity/v3/projects/d7cf4e05380e477d8f7793c92acc9742/users/f3c67b1de39b4a0db1d2d09839e38f88/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:03:17.852930 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae3426-7059-491e-9bdd-ce9e397074c6 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:17.886224 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff332e0b-4ea1-48c4-a743-af187b88989c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:17.887299 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff332e0b-4ea1-48c4-a743-af187b88989c None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:17.887692 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff332e0b-4ea1-48c4-a743-af187b88989c None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:17.888170 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff332e0b-4ea1-48c4-a743-af187b88989c None admin] PATH_INFO: `/v3/users/f3c67b1de39b4a0db1d2d09839e38f88` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:17.894329 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff332e0b-4ea1-48c4-a743-af187b88989c None admin] RBAC: Authorizing `identity:get_user(user_id=f3c67b1de39b4a0db1d2d09839e38f88)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:17.896100 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff332e0b-4ea1-48c4-a743-af187b88989c None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:17.898360 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 63/131] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 17 18:03:17 2022] GET /identity/v3/users/f3c67b1de39b4a0db1d2d09839e38f88 => generated 275 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:17.904103 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff332e0b-4ea1-48c4-a743-af187b88989c None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:17.984911 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae3426-7059-491e-9bdd-ce9e397074c6 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:18.028280 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da4cd3-e4d5-4912-a7c7-3ef69da41ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:18.029558 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da4cd3-e4d5-4912-a7c7-3ef69da41ae1 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:18.030015 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da4cd3-e4d5-4912-a7c7-3ef69da41ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:18.030441 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da4cd3-e4d5-4912-a7c7-3ef69da41ae1 None admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:18.032529 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0da4cd3-e4d5-4912-a7c7-3ef69da41ae1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:18.033003 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0da4cd3-e4d5-4912-a7c7-3ef69da41ae1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:18.034579 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0da4cd3-e4d5-4912-a7c7-3ef69da41ae1 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:18.046713 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 69/132] 10.222.0.65 () {56 vars in 1101 bytes} [Tue May 17 18:03:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:18.050019 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff332e0b-4ea1-48c4-a743-af187b88989c None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:18.054151 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da4cd3-e4d5-4912-a7c7-3ef69da41ae1 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:18.125535 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de4bf6b-563c-4449-8050-2a5dfccfa17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:18.130592 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de4bf6b-563c-4449-8050-2a5dfccfa17f None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:18.130880 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de4bf6b-563c-4449-8050-2a5dfccfa17f None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:18.131166 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de4bf6b-563c-4449-8050-2a5dfccfa17f None admin] PATH_INFO: `/v3/projects/d7cf4e05380e477d8f7793c92acc9742` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:18.133831 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de4bf6b-563c-4449-8050-2a5dfccfa17f None admin] RBAC: Authorizing `identity:get_project(project_id=d7cf4e05380e477d8f7793c92acc9742)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:18.135314 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de4bf6b-563c-4449-8050-2a5dfccfa17f None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:18.137196 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 64/133] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 17 18:03:17 2022] GET /identity/v3/projects/d7cf4e05380e477d8f7793c92acc9742 => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:03:18.143975 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de4bf6b-563c-4449-8050-2a5dfccfa17f None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:18.249363 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da4cd3-e4d5-4912-a7c7-3ef69da41ae1 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:18.306623 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c4f2c3-f1f8-4bf9-9b42-e374dc36d934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:18.307506 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4f2c3-f1f8-4bf9-9b42-e374dc36d934 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:18.307792 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4f2c3-f1f8-4bf9-9b42-e374dc36d934 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:18.308074 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4f2c3-f1f8-4bf9-9b42-e374dc36d934 None admin] PATH_INFO: `/v3/users/f3c67b1de39b4a0db1d2d09839e38f88` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:18.309410 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c4f2c3-f1f8-4bf9-9b42-e374dc36d934 None admin] RBAC: Authorizing `identity:get_user(user_id=f3c67b1de39b4a0db1d2d09839e38f88)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:18.310896 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c4f2c3-f1f8-4bf9-9b42-e374dc36d934 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:18.313111 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 70/134] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 17 18:03:18 2022] GET /identity/v3/users/f3c67b1de39b4a0db1d2d09839e38f88 => generated 275 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:03:18.323041 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c4f2c3-f1f8-4bf9-9b42-e374dc36d934 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:18.327004 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de4bf6b-563c-4449-8050-2a5dfccfa17f None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:18.396175 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cec53b-9e8c-40ef-a932-069beb5b01d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:18.397445 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cec53b-9e8c-40ef-a932-069beb5b01d9 None admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:18.397964 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cec53b-9e8c-40ef-a932-069beb5b01d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:18.398485 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cec53b-9e8c-40ef-a932-069beb5b01d9 None admin] PATH_INFO: `/v3/projects/d7cf4e05380e477d8f7793c92acc9742/users/f3c67b1de39b4a0db1d2d09839e38f88/roles/c3b3265cd6364fbcb22a731040b7b47a` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:18.400939 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cec53b-9e8c-40ef-a932-069beb5b01d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=d7cf4e05380e477d8f7793c92acc9742, user_id=f3c67b1de39b4a0db1d2d09839e38f88, role_id=c3b3265cd6364fbcb22a731040b7b47a)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:18.404771 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cec53b-9e8c-40ef-a932-069beb5b01d9 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:18.427599 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 65/135] 10.222.0.65 () {58 vars in 1439 bytes} [Tue May 17 18:03:18 2022] PUT /identity/v3/projects/d7cf4e05380e477d8f7793c92acc9742/users/f3c67b1de39b4a0db1d2d09839e38f88/roles/c3b3265cd6364fbcb22a731040b7b47a => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:03:18.476255 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c4f2c3-f1f8-4bf9-9b42-e374dc36d934 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:18.512138 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3478b41-753f-45c2-a203-0e49f93a0c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:18.513390 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3478b41-753f-45c2-a203-0e49f93a0c05 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:18.513926 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3478b41-753f-45c2-a203-0e49f93a0c05 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:18.514405 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3478b41-753f-45c2-a203-0e49f93a0c05 None admin] PATH_INFO: `/v3/projects/a8a3bc1433894064824b80fbc711c006` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:18.516347 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3478b41-753f-45c2-a203-0e49f93a0c05 None admin] RBAC: Authorizing `identity:get_project(project_id=a8a3bc1433894064824b80fbc711c006)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:18.518043 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3478b41-753f-45c2-a203-0e49f93a0c05 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:18.519969 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 71/136] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 17 18:03:18 2022] GET /identity/v3/projects/a8a3bc1433894064824b80fbc711c006 => generated 312 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:18.525884 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cec53b-9e8c-40ef-a932-069beb5b01d9 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:18.645430 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cec53b-9e8c-40ef-a932-069beb5b01d9 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:18.687384 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1a53d0-3bd5-4c71-a5b5-4af777434a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:18.689172 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a53d0-3bd5-4c71-a5b5-4af777434a57 None admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:18.689704 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a53d0-3bd5-4c71-a5b5-4af777434a57 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:18.690185 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a53d0-3bd5-4c71-a5b5-4af777434a57 None admin] PATH_INFO: `/v3/projects/a8a3bc1433894064824b80fbc711c006/users/f3c67b1de39b4a0db1d2d09839e38f88/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:18.692756 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1a53d0-3bd5-4c71-a5b5-4af777434a57 None admin] RBAC: Authorizing `identity:create_grant(project_id=a8a3bc1433894064824b80fbc711c006, user_id=f3c67b1de39b4a0db1d2d09839e38f88, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:18.694473 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1a53d0-3bd5-4c71-a5b5-4af777434a57 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:18.714543 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 66/137] 10.222.0.65 () {58 vars in 1439 bytes} [Tue May 17 18:03:18 2022] PUT /identity/v3/projects/a8a3bc1433894064824b80fbc711c006/users/f3c67b1de39b4a0db1d2d09839e38f88/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:03:19.114231 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ac6b1-952d-455f-8458-60e611789c4a None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:19.115213 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ac6b1-952d-455f-8458-60e611789c4a None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:19.115714 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ac6b1-952d-455f-8458-60e611789c4a None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:19.117553 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 72/138] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:03:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:03:19.123203 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b32aee-3526-4608-b3b5-c527f40a0302 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:19.124065 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b32aee-3526-4608-b3b5-c527f40a0302 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:19.124557 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b32aee-3526-4608-b3b5-c527f40a0302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:19.145997 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-08b32aee-3526-4608-b3b5-c527f40a0302 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:03:19.147495 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-08b32aee-3526-4608-b3b5-c527f40a0302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:03:19.224394 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 67/139] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:03:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:03:19.261139 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ac6b1-952d-455f-8458-60e611789c4a None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:19.368138 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ac6b1-952d-455f-8458-60e611789c4a None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:19.404025 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c45352-99f9-4117-8b63-cbeae794bc6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:19.405211 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c45352-99f9-4117-8b63-cbeae794bc6e None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:19.405731 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c45352-99f9-4117-8b63-cbeae794bc6e None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:19.406237 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c45352-99f9-4117-8b63-cbeae794bc6e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:19.407622 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c45352-99f9-4117-8b63-cbeae794bc6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:19.409273 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c45352-99f9-4117-8b63-cbeae794bc6e None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:19.411137 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 73/140] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:03:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:19.416820 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b32aee-3526-4608-b3b5-c527f40a0302 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:19.441623 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9796d-2a6b-4507-8245-12597440b103 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:19.442495 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9796d-2a6b-4507-8245-12597440b103 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:19.442972 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9796d-2a6b-4507-8245-12597440b103 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:19.444550 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 74/141] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:03:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 18:03:19.462044 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98263375-52d5-401f-8f2d-202c241913a1 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:19.462652 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98263375-52d5-401f-8f2d-202c241913a1 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:19.463133 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98263375-52d5-401f-8f2d-202c241913a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:19.486260 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-98263375-52d5-401f-8f2d-202c241913a1 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:03:19.487795 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-98263375-52d5-401f-8f2d-202c241913a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:03:19.585324 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b32aee-3526-4608-b3b5-c527f40a0302 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:19.597120 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 75/142] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:03:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:03:19.641775 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4bfb95-db80-4053-989a-30cfdd556741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:19.642462 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4bfb95-db80-4053-989a-30cfdd556741 None admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:19.642745 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4bfb95-db80-4053-989a-30cfdd556741 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:19.643022 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4bfb95-db80-4053-989a-30cfdd556741 None admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:19.643755 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4bfb95-db80-4053-989a-30cfdd556741 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:19.645226 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4bfb95-db80-4053-989a-30cfdd556741 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:19.668730 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98263375-52d5-401f-8f2d-202c241913a1 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:19.679999 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 68/143] 10.222.0.65 () {60 vars in 1132 bytes} [Tue May 17 18:03:19 2022] POST /identity/v3/users => generated 283 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:03:19.785607 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98263375-52d5-401f-8f2d-202c241913a1 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:19.823396 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6355d9e-d07f-4bae-a9f7-ba01e47b9dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:19.824593 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6355d9e-d07f-4bae-a9f7-ba01e47b9dfb None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:19.825106 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6355d9e-d07f-4bae-a9f7-ba01e47b9dfb None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:19.825630 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6355d9e-d07f-4bae-a9f7-ba01e47b9dfb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:19.843370 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6355d9e-d07f-4bae-a9f7-ba01e47b9dfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:03:19.854703 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-c6355d9e-d07f-4bae-a9f7-ba01e47b9dfb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 17 18:03:19.854703 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:03:19.854703 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:03:19.854703 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:03:19.854703 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:03:19.854703 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:03:19.854703 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:03:19.854703 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:03:19.854703 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:03:19.854703 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:03:19.854703 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:03:19.854703 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:03:19.854703 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:03:19.854703 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:03:19.854703 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:03:19.854703 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:03:19.855627 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:03:19.855627 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:03:19.855627 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:03:19.855627 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:03:19.855627 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:03:19.855627 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:03:19.855627 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:03:19.855627 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:03:19.855627 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:03:19.855627 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:03:19.855627 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:03:19.855627 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:03:19.855627 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:03:19.855627 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:03:19.855627 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:03:19.855627 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:03:19.856390 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:03:19.856390 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:03:19.856390 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:03:19.856390 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:03:19.856390 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:03:19.856390 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:03:19.856390 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:03:19.856390 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:03:19.856390 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:03:19.856390 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:03:19.856390 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 17 18:03:19.856390 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:03:19.860761 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 76/144] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 17 18:03:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:03:19.870690 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4bfb95-db80-4053-989a-30cfdd556741 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:19.988899 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4bfb95-db80-4053-989a-30cfdd556741 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:20.029010 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32481cbb-f816-4d06-963b-d413c58eb193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:20.029715 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32481cbb-f816-4d06-963b-d413c58eb193 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:20.030002 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32481cbb-f816-4d06-963b-d413c58eb193 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:20.030283 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32481cbb-f816-4d06-963b-d413c58eb193 None admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:20.031048 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32481cbb-f816-4d06-963b-d413c58eb193 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:20.031973 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32481cbb-f816-4d06-963b-d413c58eb193 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:20.033378 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32481cbb-f816-4d06-963b-d413c58eb193 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:20.042668 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 69/145] 10.222.0.65 () {56 vars in 1101 bytes} [Tue May 17 18:03:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:20.048683 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6355d9e-d07f-4bae-a9f7-ba01e47b9dfb None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:20.192991 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6355d9e-d07f-4bae-a9f7-ba01e47b9dfb None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:20.231980 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ae5eae-df9b-4aaa-b2e1-98b2b9740fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:20.233271 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae5eae-df9b-4aaa-b2e1-98b2b9740fe6 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:20.233883 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae5eae-df9b-4aaa-b2e1-98b2b9740fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:20.234568 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae5eae-df9b-4aaa-b2e1-98b2b9740fe6 None admin] PATH_INFO: `/v3/users/49dc952b9d904831a726eeaa23990861` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:20.236253 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ae5eae-df9b-4aaa-b2e1-98b2b9740fe6 None admin] RBAC: Authorizing `identity:get_user(user_id=49dc952b9d904831a726eeaa23990861)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:20.238021 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ae5eae-df9b-4aaa-b2e1-98b2b9740fe6 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:20.240404 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 77/146] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 17 18:03:20 2022] GET /identity/v3/users/49dc952b9d904831a726eeaa23990861 => generated 289 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:20.251164 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32481cbb-f816-4d06-963b-d413c58eb193 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:20.389889 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32481cbb-f816-4d06-963b-d413c58eb193 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:20.432527 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ffba13-df62-4d0f-9126-901ed333348f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:20.433397 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ffba13-df62-4d0f-9126-901ed333348f None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:20.433706 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ffba13-df62-4d0f-9126-901ed333348f None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:20.433997 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ffba13-df62-4d0f-9126-901ed333348f None admin] PATH_INFO: `/v3/projects/d7cf4e05380e477d8f7793c92acc9742` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:20.438592 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ffba13-df62-4d0f-9126-901ed333348f None admin] RBAC: Authorizing `identity:get_project(project_id=d7cf4e05380e477d8f7793c92acc9742)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:20.440053 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ffba13-df62-4d0f-9126-901ed333348f None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:20.442411 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 70/147] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 17 18:03:20 2022] GET /identity/v3/projects/d7cf4e05380e477d8f7793c92acc9742 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:20.450530 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ae5eae-df9b-4aaa-b2e1-98b2b9740fe6 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:20.549256 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa275cf-4ace-48e2-b180-3252ad29ffc5 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:20.549597 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa275cf-4ace-48e2-b180-3252ad29ffc5 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:20.549793 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa275cf-4ace-48e2-b180-3252ad29ffc5 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:20.551306 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 71/148] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:03:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 18:03:20.556169 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11c16f-022e-41a3-b26f-699598ee5c36 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:20.556464 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11c16f-022e-41a3-b26f-699598ee5c36 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:20.556746 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11c16f-022e-41a3-b26f-699598ee5c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:20.561018 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ae5eae-df9b-4aaa-b2e1-98b2b9740fe6 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:20.588112 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-3e11c16f-022e-41a3-b26f-699598ee5c36 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:03:20.589311 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-3e11c16f-022e-41a3-b26f-699598ee5c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:03:20.602346 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4611ba24-2dfb-4e6c-9826-12e8df36663b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:20.603585 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611ba24-2dfb-4e6c-9826-12e8df36663b None admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:20.604082 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611ba24-2dfb-4e6c-9826-12e8df36663b None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:20.604561 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4611ba24-2dfb-4e6c-9826-12e8df36663b None admin] PATH_INFO: `/v3/projects/d7cf4e05380e477d8f7793c92acc9742/users/49dc952b9d904831a726eeaa23990861/roles/6f39f2f8bcc04c11b768de7f0c994fd7` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:20.609531 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4611ba24-2dfb-4e6c-9826-12e8df36663b None admin] RBAC: Authorizing `identity:create_grant(project_id=d7cf4e05380e477d8f7793c92acc9742, user_id=49dc952b9d904831a726eeaa23990861, role_id=6f39f2f8bcc04c11b768de7f0c994fd7)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:20.611283 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4611ba24-2dfb-4e6c-9826-12e8df36663b None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:20.634685 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 78/149] 10.222.0.65 () {58 vars in 1439 bytes} [Tue May 17 18:03:20 2022] PUT /identity/v3/projects/d7cf4e05380e477d8f7793c92acc9742/users/49dc952b9d904831a726eeaa23990861/roles/6f39f2f8bcc04c11b768de7f0c994fd7 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:03:20.707537 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 72/150] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:03:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:03:20.749097 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4611ba24-2dfb-4e6c-9826-12e8df36663b None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:20.880504 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4611ba24-2dfb-4e6c-9826-12e8df36663b None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:20.915976 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db2a45-8047-4f81-bfed-8e0a5232be7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:20.916776 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db2a45-8047-4f81-bfed-8e0a5232be7a None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:20.919208 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db2a45-8047-4f81-bfed-8e0a5232be7a None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:20.919518 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db2a45-8047-4f81-bfed-8e0a5232be7a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:20.931595 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4db2a45-8047-4f81-bfed-8e0a5232be7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:03:20.939930 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-a4db2a45-8047-4f81-bfed-8e0a5232be7a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:03:20.939930 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:03:20.939930 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:03:20.939930 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:03:20.939930 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:03:20.939930 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:03:20.939930 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:03:20.939930 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:03:20.939930 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:03:20.939930 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:03:20.939930 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:03:20.939930 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:03:20.939930 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:03:20.939930 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:03:20.939930 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:03:20.939930 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:03:20.940818 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:03:20.940818 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:03:20.940818 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:03:20.940818 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:03:20.940818 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:03:20.940818 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:03:20.940818 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:03:20.940818 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:03:20.940818 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:03:20.940818 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:03:20.940818 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:03:20.940818 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:03:20.940818 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:03:20.940818 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:03:20.940818 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:03:20.940818 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:03:20.942710 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:03:20.942710 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:03:20.942710 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:03:20.942710 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:03:20.942710 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:03:20.942710 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:03:20.942710 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:03:20.942710 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:03:20.942710 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:03:20.942710 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:03:20.942710 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:03:20.942710 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:03:20.942710 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 79/151] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 17 18:03:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:03:20.947201 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e11c16f-022e-41a3-b26f-699598ee5c36 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:21.074401 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e11c16f-022e-41a3-b26f-699598ee5c36 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:21.119375 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f5113-d677-4d1e-a095-e3ac9377c6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:21.120044 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f5113-d677-4d1e-a095-e3ac9377c6a0 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:21.120324 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f5113-d677-4d1e-a095-e3ac9377c6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:21.120600 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f5113-d677-4d1e-a095-e3ac9377c6a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:21.121425 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51f5113-d677-4d1e-a095-e3ac9377c6a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:21.121781 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51f5113-d677-4d1e-a095-e3ac9377c6a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:21.123168 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51f5113-d677-4d1e-a095-e3ac9377c6a0 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:21.137149 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 73/152] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 17 18:03:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:21.142842 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db2a45-8047-4f81-bfed-8e0a5232be7a None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:21.259311 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db2a45-8047-4f81-bfed-8e0a5232be7a None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:21.296482 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdc5874-5415-4d04-a56f-12c8e832a03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:21.297911 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc5874-5415-4d04-a56f-12c8e832a03e None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:21.298193 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc5874-5415-4d04-a56f-12c8e832a03e None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:21.298464 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdc5874-5415-4d04-a56f-12c8e832a03e None admin] PATH_INFO: `/v3/users/8763b2e915c44d8688900867e35dfda6` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:21.299674 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdc5874-5415-4d04-a56f-12c8e832a03e None admin] RBAC: Authorizing `identity:get_user(user_id=8763b2e915c44d8688900867e35dfda6)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:21.301128 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdc5874-5415-4d04-a56f-12c8e832a03e None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:21.303007 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 80/153] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 17 18:03:21 2022] GET /identity/v3/users/8763b2e915c44d8688900867e35dfda6 => generated 247 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:21.308293 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f5113-d677-4d1e-a095-e3ac9377c6a0 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:21.416643 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f5113-d677-4d1e-a095-e3ac9377c6a0 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:21.452517 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b812f9a-7232-412f-90c0-4c6e57b222a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:21.453720 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b812f9a-7232-412f-90c0-4c6e57b222a5 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:21.454003 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b812f9a-7232-412f-90c0-4c6e57b222a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:21.454276 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b812f9a-7232-412f-90c0-4c6e57b222a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:21.542285 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b812f9a-7232-412f-90c0-4c6e57b222a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:21.543771 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b812f9a-7232-412f-90c0-4c6e57b222a5 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:21.662890 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 74/154] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 17 18:03:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 18:03:21.668177 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdc5874-5415-4d04-a56f-12c8e832a03e None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:21.777654 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdc5874-5415-4d04-a56f-12c8e832a03e None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:21.820631 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62026771-d8de-46e1-b710-00eb11e3da4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:21.821534 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62026771-d8de-46e1-b710-00eb11e3da4b None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:21.821848 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62026771-d8de-46e1-b710-00eb11e3da4b None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:21.822109 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62026771-d8de-46e1-b710-00eb11e3da4b None admin] PATH_INFO: `/v3/projects/d7cf4e05380e477d8f7793c92acc9742` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:21.826623 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62026771-d8de-46e1-b710-00eb11e3da4b None admin] RBAC: Authorizing `identity:get_project(project_id=d7cf4e05380e477d8f7793c92acc9742)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:21.833884 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62026771-d8de-46e1-b710-00eb11e3da4b None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:21.833884 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 81/155] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 17 18:03:21 2022] GET /identity/v3/projects/d7cf4e05380e477d8f7793c92acc9742 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:21.838540 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b812f9a-7232-412f-90c0-4c6e57b222a5 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:21.852836 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726304cf-8427-40ef-b6c3-36929e22789a None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:21.852836 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726304cf-8427-40ef-b6c3-36929e22789a None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:21.852836 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726304cf-8427-40ef-b6c3-36929e22789a None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:21.852836 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 82/156] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:03:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:03:21.859583 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731168b-8a65-4800-8111-758ff0fd406f None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:21.859862 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731168b-8a65-4800-8111-758ff0fd406f None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:21.860141 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6731168b-8a65-4800-8111-758ff0fd406f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:21.886633 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-6731168b-8a65-4800-8111-758ff0fd406f None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:03:21.889201 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-6731168b-8a65-4800-8111-758ff0fd406f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:03:22.021317 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 83/157] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:03:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 17 18:03:22.023110 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b812f9a-7232-412f-90c0-4c6e57b222a5 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:22.052164 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed3c6d-a72f-41ce-967e-9c2211b6df5f None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:22.052451 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed3c6d-a72f-41ce-967e-9c2211b6df5f None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:22.052724 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed3c6d-a72f-41ce-967e-9c2211b6df5f None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:22.054114 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 84/158] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:03:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 18:03:22.061218 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040d7d0-3495-4f16-8492-d25ba0497ea2 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:22.061690 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040d7d0-3495-4f16-8492-d25ba0497ea2 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:22.062073 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e040d7d0-3495-4f16-8492-d25ba0497ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:22.073116 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1f248-9581-47ed-ae74-d2f182b30121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:22.073811 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1f248-9581-47ed-ae74-d2f182b30121 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:22.074095 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1f248-9581-47ed-ae74-d2f182b30121 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:22.074374 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1f248-9581-47ed-ae74-d2f182b30121 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:22.075220 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f1f248-9581-47ed-ae74-d2f182b30121 None admin] RBAC: Adding query filter params (role.id=332c8d70fd0f41e2beea20aaead5daa5, scope.project.id=d7cf4e05380e477d8f7793c92acc9742, user.id=8763b2e915c44d8688900867e35dfda6) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:22.075528 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f1f248-9581-47ed-ae74-d2f182b30121 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:22.081498 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f1f248-9581-47ed-ae74-d2f182b30121 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:22.089896 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-e040d7d0-3495-4f16-8492-d25ba0497ea2 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:03:22.091070 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-e040d7d0-3495-4f16-8492-d25ba0497ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:03:22.095977 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 75/159] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 17 18:03:21 2022] GET /identity/v3/role_assignments?user.id=8763b2e915c44d8688900867e35dfda6&scope.project.id=d7cf4e05380e477d8f7793c92acc9742&role.id=332c8d70fd0f41e2beea20aaead5daa5 => generated 608 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:22.096907 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1f248-9581-47ed-ae74-d2f182b30121 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:22.235733 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 85/160] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:03:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:03:22.296552 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e040d7d0-3495-4f16-8492-d25ba0497ea2 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:22.300886 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1f248-9581-47ed-ae74-d2f182b30121 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:22.395082 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed4fb2-aca1-4b4e-8467-a5a6d43f9bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:22.395886 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed4fb2-aca1-4b4e-8467-a5a6d43f9bf3 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:22.396235 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed4fb2-aca1-4b4e-8467-a5a6d43f9bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:22.396513 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed4fb2-aca1-4b4e-8467-a5a6d43f9bf3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:22.420560 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deed4fb2-aca1-4b4e-8467-a5a6d43f9bf3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:03:22.432819 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-deed4fb2-aca1-4b4e-8467-a5a6d43f9bf3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 18:03:22.432819 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:03:22.432819 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:03:22.432819 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:03:22.432819 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:03:22.432819 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:03:22.432819 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:03:22.432819 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:03:22.432819 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:03:22.432819 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:03:22.432819 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:03:22.432819 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:03:22.432819 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:03:22.432819 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:03:22.432819 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:03:22.432819 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:03:22.435219 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:03:22.435219 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:03:22.435219 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:03:22.435219 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:03:22.435219 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:03:22.435219 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:03:22.435219 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:03:22.435219 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:03:22.435219 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:03:22.435219 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:03:22.435219 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:03:22.435219 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:03:22.435219 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:03:22.435219 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:03:22.435219 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:03:22.435219 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:03:22.439358 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:03:22.439358 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:03:22.439358 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:03:22.439358 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:03:22.439358 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:03:22.439358 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:03:22.439358 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:03:22.439358 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:03:22.439358 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:03:22.439358 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:03:22.439358 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 18:03:22.439358 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:03:22.439358 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 76/161] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 17 18:03:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:03:22.442654 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e040d7d0-3495-4f16-8492-d25ba0497ea2 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:22.442852 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed4fb2-aca1-4b4e-8467-a5a6d43f9bf3 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:22.488500 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e625dc-37eb-47d5-8543-718956efbe02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:22.489378 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e625dc-37eb-47d5-8543-718956efbe02 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:22.489679 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e625dc-37eb-47d5-8543-718956efbe02 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:22.489949 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e625dc-37eb-47d5-8543-718956efbe02 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:22.507849 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e625dc-37eb-47d5-8543-718956efbe02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:03:22.537165 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-13e625dc-37eb-47d5-8543-718956efbe02 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 18:03:22.537165 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:03:22.537165 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:03:22.537165 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:03:22.537165 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:03:22.537165 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:03:22.537165 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:03:22.537165 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:03:22.537165 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:03:22.537165 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:03:22.537165 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:03:22.537165 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:03:22.537165 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:03:22.537165 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:03:22.537165 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:03:22.537165 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:03:22.540095 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:03:22.540095 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:03:22.540095 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:03:22.540095 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:03:22.540095 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:03:22.540095 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:03:22.540095 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:03:22.540095 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:03:22.540095 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:03:22.540095 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:03:22.540095 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:03:22.540095 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:03:22.540095 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:03:22.540095 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:03:22.540095 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:03:22.540095 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:03:22.542216 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:03:22.542216 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:03:22.542216 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:03:22.542216 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:03:22.542216 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:03:22.542216 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:03:22.542216 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:03:22.542216 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:03:22.542216 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:03:22.542216 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:03:22.542216 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 18:03:22.542216 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:03:22.542216 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 86/162] 10.222.0.65 () {56 vars in 1114 bytes} [Tue May 17 18:03:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:03:22.548068 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e625dc-37eb-47d5-8543-718956efbe02 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:22.680453 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed4fb2-aca1-4b4e-8467-a5a6d43f9bf3 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:22.757578 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e625dc-37eb-47d5-8543-718956efbe02 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:22.761953 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4269587-f58c-452e-b8fc-ce24f14c7b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:22.762625 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4269587-f58c-452e-b8fc-ce24f14c7b69 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:22.762902 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4269587-f58c-452e-b8fc-ce24f14c7b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:22.763177 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4269587-f58c-452e-b8fc-ce24f14c7b69 None admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:22.763927 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4269587-f58c-452e-b8fc-ce24f14c7b69 None admin] RBAC: Adding query filter params (name=member) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:22.764230 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4269587-f58c-452e-b8fc-ce24f14c7b69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:22.766264 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4269587-f58c-452e-b8fc-ce24f14c7b69 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:22.785134 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 77/163] 10.222.0.65 () {56 vars in 1101 bytes} [Tue May 17 18:03:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:22.790833 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4269587-f58c-452e-b8fc-ce24f14c7b69 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:22.798728 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fc5e5d-630f-4d5f-856c-58aeddb9d05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:22.799340 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc5e5d-630f-4d5f-856c-58aeddb9d05d None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:22.799624 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc5e5d-630f-4d5f-856c-58aeddb9d05d None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:22.799896 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fc5e5d-630f-4d5f-856c-58aeddb9d05d None admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:22.800654 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fc5e5d-630f-4d5f-856c-58aeddb9d05d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:22.800958 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fc5e5d-630f-4d5f-856c-58aeddb9d05d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:22.802396 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fc5e5d-630f-4d5f-856c-58aeddb9d05d None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:22.812057 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 87/164] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 17 18:03:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:03:22.817973 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fc5e5d-630f-4d5f-856c-58aeddb9d05d None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:22.956437 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fc5e5d-630f-4d5f-856c-58aeddb9d05d None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:23.004877 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804e7b1-0ecf-4761-b7b2-3bb078832cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:23.005799 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804e7b1-0ecf-4761-b7b2-3bb078832cd1 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:23.006079 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804e7b1-0ecf-4761-b7b2-3bb078832cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:23.006348 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804e7b1-0ecf-4761-b7b2-3bb078832cd1 None admin] PATH_INFO: `/v3/users/f3c67b1de39b4a0db1d2d09839e38f88` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:23.007555 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c804e7b1-0ecf-4761-b7b2-3bb078832cd1 None admin] RBAC: Authorizing `identity:get_user(user_id=f3c67b1de39b4a0db1d2d09839e38f88)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:23.009006 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c804e7b1-0ecf-4761-b7b2-3bb078832cd1 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:23.010954 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 88/165] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 17 18:03:22 2022] GET /identity/v3/users/f3c67b1de39b4a0db1d2d09839e38f88 => generated 275 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:23.016274 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804e7b1-0ecf-4761-b7b2-3bb078832cd1 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:23.017345 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4269587-f58c-452e-b8fc-ce24f14c7b69 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:23.091120 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f251da-6c2f-4207-8878-93a9f33bc72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:23.091917 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f251da-6c2f-4207-8878-93a9f33bc72e None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:23.092186 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f251da-6c2f-4207-8878-93a9f33bc72e None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:23.092453 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f251da-6c2f-4207-8878-93a9f33bc72e None admin] PATH_INFO: `/v3/users/f3c67b1de39b4a0db1d2d09839e38f88` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:23.098179 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f251da-6c2f-4207-8878-93a9f33bc72e None admin] RBAC: Authorizing `identity:get_user(user_id=f3c67b1de39b4a0db1d2d09839e38f88)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:23.099639 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f251da-6c2f-4207-8878-93a9f33bc72e None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:23.101597 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 78/166] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 17 18:03:22 2022] GET /identity/v3/users/f3c67b1de39b4a0db1d2d09839e38f88 => generated 275 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:23.106796 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f251da-6c2f-4207-8878-93a9f33bc72e None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:23.173759 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804e7b1-0ecf-4761-b7b2-3bb078832cd1 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:23.251635 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1347e4d-7306-4c42-8fb5-eeb46d67670a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:23.252301 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1347e4d-7306-4c42-8fb5-eeb46d67670a None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:23.252579 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1347e4d-7306-4c42-8fb5-eeb46d67670a None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:23.252852 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1347e4d-7306-4c42-8fb5-eeb46d67670a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:23.325351 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f251da-6c2f-4207-8878-93a9f33bc72e None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:23.378191 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1085eae4-769b-4f6d-830a-fd914c84b1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:23.378862 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085eae4-769b-4f6d-830a-fd914c84b1a9 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:23.379139 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085eae4-769b-4f6d-830a-fd914c84b1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:23.379411 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085eae4-769b-4f6d-830a-fd914c84b1a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:23.381071 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1347e4d-7306-4c42-8fb5-eeb46d67670a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:23.382593 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1347e4d-7306-4c42-8fb5-eeb46d67670a None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:23.471678 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1085eae4-769b-4f6d-830a-fd914c84b1a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:23.473141 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1085eae4-769b-4f6d-830a-fd914c84b1a9 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:23.539705 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 89/167] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 17 18:03:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 17 18:03:23.541423 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48221c1d-0977-4619-924f-7ddfb28f9fd5 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:23.541956 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48221c1d-0977-4619-924f-7ddfb28f9fd5 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:23.542457 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48221c1d-0977-4619-924f-7ddfb28f9fd5 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:23.543947 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 90/168] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:03:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:03:23.545626 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48221c1d-0977-4619-924f-7ddfb28f9fd5 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:23.659051 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48221c1d-0977-4619-924f-7ddfb28f9fd5 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:23.674548 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 79/169] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 17 18:03:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 18:03:23.676121 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75fa083-7ddd-4177-a3a1-8b136668bde9 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:23.676553 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75fa083-7ddd-4177-a3a1-8b136668bde9 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:23.676998 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75fa083-7ddd-4177-a3a1-8b136668bde9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:23.697107 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9755c6d-9f1d-41d5-9bc5-a6f8ef4db4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:23.698428 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9755c6d-9f1d-41d5-9bc5-a6f8ef4db4c6 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:23.698944 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9755c6d-9f1d-41d5-9bc5-a6f8ef4db4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:23.699433 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9755c6d-9f1d-41d5-9bc5-a6f8ef4db4c6 None admin] PATH_INFO: `/v3/projects/d7cf4e05380e477d8f7793c92acc9742` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:23.700866 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9755c6d-9f1d-41d5-9bc5-a6f8ef4db4c6 None admin] RBAC: Authorizing `identity:get_project(project_id=d7cf4e05380e477d8f7793c92acc9742)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:23.702646 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9755c6d-9f1d-41d5-9bc5-a6f8ef4db4c6 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:23.705023 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 91/170] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 17 18:03:23 2022] GET /identity/v3/projects/d7cf4e05380e477d8f7793c92acc9742 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:03:23.706081 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9755c6d-9f1d-41d5-9bc5-a6f8ef4db4c6 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:23.707479 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-f75fa083-7ddd-4177-a3a1-8b136668bde9 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:03:23.708671 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-f75fa083-7ddd-4177-a3a1-8b136668bde9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:03:23.815274 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9755c6d-9f1d-41d5-9bc5-a6f8ef4db4c6 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:23.847882 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 80/171] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:03:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:03:23.848755 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75fa083-7ddd-4177-a3a1-8b136668bde9 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:23.852202 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc05519-6aaf-4fa3-9bc5-ceecbe3efd18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:23.853306 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc05519-6aaf-4fa3-9bc5-ceecbe3efd18 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:23.853814 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc05519-6aaf-4fa3-9bc5-ceecbe3efd18 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:23.854304 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc05519-6aaf-4fa3-9bc5-ceecbe3efd18 None admin] PATH_INFO: `/v3/projects/d7cf4e05380e477d8f7793c92acc9742` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:23.855737 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc05519-6aaf-4fa3-9bc5-ceecbe3efd18 None admin] RBAC: Authorizing `identity:get_project(project_id=d7cf4e05380e477d8f7793c92acc9742)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:23.857493 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc05519-6aaf-4fa3-9bc5-ceecbe3efd18 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:23.859423 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 92/172] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 17 18:03:23 2022] GET /identity/v3/projects/d7cf4e05380e477d8f7793c92acc9742 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:23.868855 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc05519-6aaf-4fa3-9bc5-ceecbe3efd18 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:23.970604 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc05519-6aaf-4fa3-9bc5-ceecbe3efd18 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:24.004898 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b485bd-f68c-4021-ae88-9287a4cead90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:24.005983 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b485bd-f68c-4021-ae88-9287a4cead90 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:24.006519 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b485bd-f68c-4021-ae88-9287a4cead90 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:24.006998 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b485bd-f68c-4021-ae88-9287a4cead90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:24.008065 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b485bd-f68c-4021-ae88-9287a4cead90 None admin] RBAC: Adding query filter params (role.id=2af599fd3ad74031901ea2d9e0408884, scope.project.id=d7cf4e05380e477d8f7793c92acc9742, user.id=f3c67b1de39b4a0db1d2d09839e38f88) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:24.008621 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b485bd-f68c-4021-ae88-9287a4cead90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:24.010280 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b485bd-f68c-4021-ae88-9287a4cead90 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:24.016387 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 93/173] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 17 18:03:23 2022] GET /identity/v3/role_assignments?user.id=f3c67b1de39b4a0db1d2d09839e38f88&scope.project.id=d7cf4e05380e477d8f7793c92acc9742&role.id=2af599fd3ad74031901ea2d9e0408884 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:03:24.017418 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b485bd-f68c-4021-ae88-9287a4cead90 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:24.045332 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75fa083-7ddd-4177-a3a1-8b136668bde9 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:24.121311 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56282c4-47a0-4611-8568-f30fd5cebfe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:24.121997 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56282c4-47a0-4611-8568-f30fd5cebfe6 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:24.122274 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56282c4-47a0-4611-8568-f30fd5cebfe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:24.122545 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56282c4-47a0-4611-8568-f30fd5cebfe6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:24.123379 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56282c4-47a0-4611-8568-f30fd5cebfe6 None admin] RBAC: Adding query filter params (role.id=c3b3265cd6364fbcb22a731040b7b47a, scope.project.id=d7cf4e05380e477d8f7793c92acc9742, user.id=f3c67b1de39b4a0db1d2d09839e38f88) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:24.123687 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56282c4-47a0-4611-8568-f30fd5cebfe6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:24.124156 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b485bd-f68c-4021-ae88-9287a4cead90 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:24.125172 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56282c4-47a0-4611-8568-f30fd5cebfe6 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:24.144086 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 81/174] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 17 18:03:23 2022] GET /identity/v3/role_assignments?user.id=f3c67b1de39b4a0db1d2d09839e38f88&scope.project.id=d7cf4e05380e477d8f7793c92acc9742&role.id=c3b3265cd6364fbcb22a731040b7b47a => generated 608 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:24.161723 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04340bcb-7650-4fbf-938f-1324456dbfa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:24.163032 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04340bcb-7650-4fbf-938f-1324456dbfa8 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:24.163529 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04340bcb-7650-4fbf-938f-1324456dbfa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:24.164013 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04340bcb-7650-4fbf-938f-1324456dbfa8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:24.176777 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04340bcb-7650-4fbf-938f-1324456dbfa8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:03:24.185123 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-04340bcb-7650-4fbf-938f-1324456dbfa8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 18:03:24.185123 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:03:24.185123 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:03:24.185123 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:03:24.185123 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:03:24.185123 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:03:24.185123 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:03:24.185123 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:03:24.185123 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:03:24.185123 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:03:24.185123 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:03:24.185123 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:03:24.185123 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:03:24.185123 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:03:24.185123 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:03:24.185123 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:03:24.186109 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:03:24.186109 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:03:24.186109 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:03:24.186109 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:03:24.186109 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:03:24.186109 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:03:24.186109 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:03:24.186109 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:03:24.186109 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:03:24.186109 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:03:24.186109 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:03:24.186109 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:03:24.186109 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:03:24.186109 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:03:24.186109 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:03:24.186109 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:03:24.186881 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:03:24.186881 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:03:24.186881 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:03:24.186881 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:03:24.186881 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:03:24.186881 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:03:24.186881 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:03:24.186881 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:03:24.186881 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:03:24.186881 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:03:24.186881 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 18:03:24.186881 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:03:24.190771 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 94/175] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 17 18:03:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:03:24.196721 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56282c4-47a0-4611-8568-f30fd5cebfe6 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:24.347880 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56282c4-47a0-4611-8568-f30fd5cebfe6 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:24.387215 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f44df8-551d-44ed-b4c9-baa05d3f888c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:24.387888 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f44df8-551d-44ed-b4c9-baa05d3f888c None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:24.388166 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f44df8-551d-44ed-b4c9-baa05d3f888c None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:24.388445 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f44df8-551d-44ed-b4c9-baa05d3f888c None admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:24.389190 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f44df8-551d-44ed-b4c9-baa05d3f888c None admin] RBAC: Adding query filter params (name=member) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:24.389515 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f44df8-551d-44ed-b4c9-baa05d3f888c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:24.391443 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f44df8-551d-44ed-b4c9-baa05d3f888c None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:24.400579 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 82/176] 10.222.0.65 () {56 vars in 1101 bytes} [Tue May 17 18:03:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:24.406371 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04340bcb-7650-4fbf-938f-1324456dbfa8 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:24.520750 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04340bcb-7650-4fbf-938f-1324456dbfa8 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:24.555324 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf345c7-726d-44ca-86f5-41fe1acab911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:24.556212 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf345c7-726d-44ca-86f5-41fe1acab911 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:24.556488 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf345c7-726d-44ca-86f5-41fe1acab911 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:24.556764 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf345c7-726d-44ca-86f5-41fe1acab911 None admin] PATH_INFO: `/v3/users/f3c67b1de39b4a0db1d2d09839e38f88` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:24.558013 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf345c7-726d-44ca-86f5-41fe1acab911 None admin] RBAC: Authorizing `identity:get_user(user_id=f3c67b1de39b4a0db1d2d09839e38f88)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:24.559475 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf345c7-726d-44ca-86f5-41fe1acab911 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:24.561113 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 95/177] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 17 18:03:24 2022] GET /identity/v3/users/f3c67b1de39b4a0db1d2d09839e38f88 => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:24.566675 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f44df8-551d-44ed-b4c9-baa05d3f888c None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:24.678260 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aad1b9-9f77-4f5e-aad5-ab713db53b34 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:24.678593 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aad1b9-9f77-4f5e-aad5-ab713db53b34 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:24.678802 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aad1b9-9f77-4f5e-aad5-ab713db53b34 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:24.680446 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 96/178] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:03:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:03:24.685502 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000cb1e6-d05e-4e88-99d8-efaed04373cf None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:24.685783 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000cb1e6-d05e-4e88-99d8-efaed04373cf None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:24.686063 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000cb1e6-d05e-4e88-99d8-efaed04373cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:24.709983 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f44df8-551d-44ed-b4c9-baa05d3f888c None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:24.712313 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-000cb1e6-d05e-4e88-99d8-efaed04373cf None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:03:24.713504 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-000cb1e6-d05e-4e88-99d8-efaed04373cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:03:24.772645 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d4e93d-301a-4de8-b318-e657bf69dfaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:24.773298 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d4e93d-301a-4de8-b318-e657bf69dfaf None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:24.773602 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d4e93d-301a-4de8-b318-e657bf69dfaf None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:24.775855 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d4e93d-301a-4de8-b318-e657bf69dfaf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:24.870893 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d4e93d-301a-4de8-b318-e657bf69dfaf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:24.872884 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d4e93d-301a-4de8-b318-e657bf69dfaf None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:24.875840 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 97/179] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:03:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 18:03:24.924109 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000cb1e6-d05e-4e88-99d8-efaed04373cf None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:25.010725 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 83/180] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 17 18:03:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 18:03:25.017731 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d4e93d-301a-4de8-b318-e657bf69dfaf None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:25.125499 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d4e93d-301a-4de8-b318-e657bf69dfaf None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:25.137550 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000cb1e6-d05e-4e88-99d8-efaed04373cf None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:25.162459 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059e244-f0c7-432c-84bc-c3b6d30463e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:25.163315 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059e244-f0c7-432c-84bc-c3b6d30463e1 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:25.163590 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059e244-f0c7-432c-84bc-c3b6d30463e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:25.163859 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059e244-f0c7-432c-84bc-c3b6d30463e1 None admin] PATH_INFO: `/v3/projects/a8a3bc1433894064824b80fbc711c006` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:25.165049 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f059e244-f0c7-432c-84bc-c3b6d30463e1 None admin] RBAC: Authorizing `identity:get_project(project_id=a8a3bc1433894064824b80fbc711c006)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:25.166544 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f059e244-f0c7-432c-84bc-c3b6d30463e1 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:25.168395 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 84/181] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 17 18:03:25 2022] GET /identity/v3/projects/a8a3bc1433894064824b80fbc711c006 => generated 312 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:03:25.169803 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb378d2-88e3-4d9f-a8b1-a4d1076a079a None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:25.170080 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb378d2-88e3-4d9f-a8b1-a4d1076a079a None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:25.170350 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb378d2-88e3-4d9f-a8b1-a4d1076a079a None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:25.171987 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 85/182] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:03:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:03:25.172295 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a25e4-e7d0-4ac0-a7d3-3e2d904d2d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:25.173087 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a25e4-e7d0-4ac0-a7d3-3e2d904d2d3e None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:25.173476 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a25e4-e7d0-4ac0-a7d3-3e2d904d2d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:25.173755 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a25e4-e7d0-4ac0-a7d3-3e2d904d2d3e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:25.177625 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d64af-dc78-49e4-abad-a19573bdc9c4 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:25.178177 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d64af-dc78-49e4-abad-a19573bdc9c4 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:25.178947 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d64af-dc78-49e4-abad-a19573bdc9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:25.184161 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993a25e4-e7d0-4ac0-a7d3-3e2d904d2d3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:03:25.191862 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-993a25e4-e7d0-4ac0-a7d3-3e2d904d2d3e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 17 18:03:25.191862 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:03:25.191862 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:03:25.191862 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:03:25.191862 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:03:25.191862 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:03:25.191862 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:03:25.191862 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:03:25.191862 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:03:25.191862 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:03:25.191862 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:03:25.191862 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:03:25.191862 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:03:25.191862 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:03:25.191862 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:03:25.191862 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:03:25.193048 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:03:25.193048 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:03:25.193048 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:03:25.193048 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:03:25.193048 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:03:25.193048 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:03:25.193048 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:03:25.193048 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:03:25.193048 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:03:25.193048 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:03:25.193048 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:03:25.193048 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:03:25.193048 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:03:25.193048 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:03:25.193048 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:03:25.193048 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:03:25.193942 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:03:25.193942 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:03:25.193942 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:03:25.193942 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:03:25.193942 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:03:25.193942 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:03:25.193942 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:03:25.193942 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:03:25.193942 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:03:25.193942 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:03:25.193942 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 17 18:03:25.193942 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:03:25.193942 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 98/183] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 17 18:03:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:03:25.194591 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a25e4-e7d0-4ac0-a7d3-3e2d904d2d3e None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:25.204313 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-f72d64af-dc78-49e4-abad-a19573bdc9c4 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:03:25.205532 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-f72d64af-dc78-49e4-abad-a19573bdc9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:03:25.270209 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 86/184] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:03:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:03:25.271856 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0258805-0f00-4ad5-ab2d-95c2cbe3bd47 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:25.272349 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0258805-0f00-4ad5-ab2d-95c2cbe3bd47 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:25.272846 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0258805-0f00-4ad5-ab2d-95c2cbe3bd47 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:25.274333 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 87/185] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:03:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:03:25.275221 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0258805-0f00-4ad5-ab2d-95c2cbe3bd47 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:25.306264 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a25e4-e7d0-4ac0-a7d3-3e2d904d2d3e None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:25.338131 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a5aa43-da2a-4102-b47e-03f4be90b2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:25.338782 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a5aa43-da2a-4102-b47e-03f4be90b2f1 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:25.339059 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a5aa43-da2a-4102-b47e-03f4be90b2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:25.339334 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a5aa43-da2a-4102-b47e-03f4be90b2f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:25.340161 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a5aa43-da2a-4102-b47e-03f4be90b2f1 None admin] RBAC: Adding query filter params (role.id=2af599fd3ad74031901ea2d9e0408884, scope.project.id=a8a3bc1433894064824b80fbc711c006, user.id=f3c67b1de39b4a0db1d2d09839e38f88) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:25.340476 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a5aa43-da2a-4102-b47e-03f4be90b2f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:25.341959 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a5aa43-da2a-4102-b47e-03f4be90b2f1 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:25.348110 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 99/186] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 17 18:03:25 2022] GET /identity/v3/role_assignments?user.id=f3c67b1de39b4a0db1d2d09839e38f88&scope.project.id=a8a3bc1433894064824b80fbc711c006&role.id=2af599fd3ad74031901ea2d9e0408884 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:25.349331 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab16883-cde0-468a-8c44-58371b295cab None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:25.350173 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab16883-cde0-468a-8c44-58371b295cab None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:25.350173 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab16883-cde0-468a-8c44-58371b295cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:25.366728 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-bab16883-cde0-468a-8c44-58371b295cab None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:03:25.367941 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-bab16883-cde0-468a-8c44-58371b295cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:03:25.378593 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0258805-0f00-4ad5-ab2d-95c2cbe3bd47 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:25.414360 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc73f1d-2efb-456f-beaf-bcd91b993d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:25.415036 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc73f1d-2efb-456f-beaf-bcd91b993d40 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:25.415309 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc73f1d-2efb-456f-beaf-bcd91b993d40 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:25.415575 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc73f1d-2efb-456f-beaf-bcd91b993d40 None admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:25.416339 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc73f1d-2efb-456f-beaf-bcd91b993d40 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:25.416639 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc73f1d-2efb-456f-beaf-bcd91b993d40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:25.418081 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc73f1d-2efb-456f-beaf-bcd91b993d40 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:25.427032 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 88/187] 10.222.0.65 () {56 vars in 1101 bytes} [Tue May 17 18:03:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:25.428179 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c2322-abeb-44e3-a458-67e8ec85c522 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:25.428481 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c2322-abeb-44e3-a458-67e8ec85c522 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:25.428730 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c2322-abeb-44e3-a458-67e8ec85c522 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:25.430262 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 89/188] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:03:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:03:25.430816 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c2322-abeb-44e3-a458-67e8ec85c522 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:25.443901 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 100/189] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:03:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:03:25.454002 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab16883-cde0-468a-8c44-58371b295cab None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:25.549743 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab16883-cde0-468a-8c44-58371b295cab None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:25.553351 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c2322-abeb-44e3-a458-67e8ec85c522 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:25.588259 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2541ff84-a42e-4329-9890-7ca3ed107189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:25.589139 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541ff84-a42e-4329-9890-7ca3ed107189 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:25.589420 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541ff84-a42e-4329-9890-7ca3ed107189 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:25.589719 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2541ff84-a42e-4329-9890-7ca3ed107189 None admin] PATH_INFO: `/v3/users/49dc952b9d904831a726eeaa23990861` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:25.590242 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9c660-3f22-49f9-ad49-182f4ee9affc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:25.591095 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9c660-3f22-49f9-ad49-182f4ee9affc None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:25.591370 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9c660-3f22-49f9-ad49-182f4ee9affc None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:25.591521 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2541ff84-a42e-4329-9890-7ca3ed107189 None admin] RBAC: Authorizing `identity:get_user(user_id=49dc952b9d904831a726eeaa23990861)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:25.591620 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9c660-3f22-49f9-ad49-182f4ee9affc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:25.592971 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2541ff84-a42e-4329-9890-7ca3ed107189 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:25.595547 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 101/190] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 17 18:03:25 2022] GET /identity/v3/users/49dc952b9d904831a726eeaa23990861 => generated 289 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:25.596349 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69f6cd-ca00-4bcb-944b-11d9de1c8ae4 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:25.596631 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69f6cd-ca00-4bcb-944b-11d9de1c8ae4 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:25.596901 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69f6cd-ca00-4bcb-944b-11d9de1c8ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:25.603283 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec9c660-3f22-49f9-ad49-182f4ee9affc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:03:25.612010 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-9ec9c660-3f22-49f9-ad49-182f4ee9affc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 18:03:25.612010 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:03:25.612010 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:03:25.612010 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:03:25.612010 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:03:25.612010 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:03:25.612010 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:03:25.612010 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:03:25.612010 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:03:25.612010 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:03:25.612010 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:03:25.612010 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:03:25.612010 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:03:25.612010 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:03:25.612010 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:03:25.612010 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:03:25.613775 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:03:25.613775 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:03:25.613775 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:03:25.613775 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:03:25.613775 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:03:25.613775 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:03:25.613775 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:03:25.613775 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:03:25.613775 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:03:25.613775 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:03:25.613775 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:03:25.613775 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:03:25.613775 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:03:25.613775 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:03:25.613775 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:03:25.613775 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:03:25.615020 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:03:25.615020 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:03:25.615020 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:03:25.615020 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:03:25.615020 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:03:25.615020 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:03:25.615020 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:03:25.615020 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:03:25.615020 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:03:25.615020 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:03:25.615020 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 18:03:25.615020 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:03:25.615020 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 90/191] 10.222.0.65 () {56 vars in 1114 bytes} [Tue May 17 18:03:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:03:25.615724 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-7c69f6cd-ca00-4bcb-944b-11d9de1c8ae4 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:03:25.615798 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9c660-3f22-49f9-ad49-182f4ee9affc None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:25.615864 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-7c69f6cd-ca00-4bcb-944b-11d9de1c8ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:03:25.684749 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 102/192] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:03:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:03:25.685702 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c69f6cd-ca00-4bcb-944b-11d9de1c8ae4 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:25.715523 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9c660-3f22-49f9-ad49-182f4ee9affc None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:25.747255 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c3577-2feb-4c14-86cc-ebbfda8f0b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:25.748021 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c3577-2feb-4c14-86cc-ebbfda8f0b33 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:25.748297 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c3577-2feb-4c14-86cc-ebbfda8f0b33 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:25.748563 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c3577-2feb-4c14-86cc-ebbfda8f0b33 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:25.758392 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6c3577-2feb-4c14-86cc-ebbfda8f0b33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:03:25.766415 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-4b6c3577-2feb-4c14-86cc-ebbfda8f0b33 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:03:25.766415 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:03:25.766415 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:03:25.766415 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:03:25.766415 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:03:25.766415 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:03:25.766415 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:03:25.766415 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:03:25.766415 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:03:25.766415 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:03:25.766415 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:03:25.766415 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:03:25.766415 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:03:25.766415 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:03:25.766415 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:03:25.766415 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:03:25.767443 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:03:25.767443 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:03:25.767443 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:03:25.767443 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:03:25.767443 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:03:25.767443 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:03:25.767443 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:03:25.767443 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:03:25.767443 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:03:25.767443 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:03:25.767443 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:03:25.767443 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:03:25.767443 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:03:25.767443 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:03:25.767443 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:03:25.767443 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:03:25.768414 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:03:25.768414 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:03:25.768414 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:03:25.768414 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:03:25.768414 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:03:25.768414 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:03:25.768414 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:03:25.768414 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:03:25.768414 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:03:25.768414 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:03:25.768414 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:03:25.768414 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:03:25.768414 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 91/193] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 17 18:03:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:03:25.768414 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c3577-2feb-4c14-86cc-ebbfda8f0b33 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:25.780621 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c69f6cd-ca00-4bcb-944b-11d9de1c8ae4 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:25.812414 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c65b6c-5068-4edc-92d8-067a12dc34d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:25.812993 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c65b6c-5068-4edc-92d8-067a12dc34d0 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:25.813269 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c65b6c-5068-4edc-92d8-067a12dc34d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:25.813567 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c65b6c-5068-4edc-92d8-067a12dc34d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:25.865511 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c3577-2feb-4c14-86cc-ebbfda8f0b33 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:25.877753 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c65b6c-5068-4edc-92d8-067a12dc34d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:25.879206 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c65b6c-5068-4edc-92d8-067a12dc34d0 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:25.897201 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58716165-edc3-4534-be53-7f81c3ce79ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:25.897888 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58716165-edc3-4534-be53-7f81c3ce79ac None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:25.898168 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58716165-edc3-4534-be53-7f81c3ce79ac None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:25.898440 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58716165-edc3-4534-be53-7f81c3ce79ac None admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:25.899173 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58716165-edc3-4534-be53-7f81c3ce79ac None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:25.899474 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58716165-edc3-4534-be53-7f81c3ce79ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:25.900833 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58716165-edc3-4534-be53-7f81c3ce79ac None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:25.909099 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 92/194] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 17 18:03:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:25.909746 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58716165-edc3-4534-be53-7f81c3ce79ac None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:25.972123 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 103/195] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 17 18:03:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 18:03:25.972956 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c65b6c-5068-4edc-92d8-067a12dc34d0 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:26.002477 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58716165-edc3-4534-be53-7f81c3ce79ac None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:26.033833 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843540d8-44f7-40af-ac1b-290482e663ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:26.034603 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843540d8-44f7-40af-ac1b-290482e663ef None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:26.034876 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843540d8-44f7-40af-ac1b-290482e663ef None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:26.035148 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843540d8-44f7-40af-ac1b-290482e663ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:26.036293 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843540d8-44f7-40af-ac1b-290482e663ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:26.037740 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843540d8-44f7-40af-ac1b-290482e663ef None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:26.039323 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 93/196] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:03:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:26.041180 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843540d8-44f7-40af-ac1b-290482e663ef None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:26.065394 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c65b6c-5068-4edc-92d8-067a12dc34d0 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:26.098010 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b81a99-df92-43e4-89d6-a0e9ee923b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:26.098744 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b81a99-df92-43e4-89d6-a0e9ee923b45 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:26.099028 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b81a99-df92-43e4-89d6-a0e9ee923b45 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:26.099315 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b81a99-df92-43e4-89d6-a0e9ee923b45 None admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:26.100041 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b81a99-df92-43e4-89d6-a0e9ee923b45 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:26.100344 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b81a99-df92-43e4-89d6-a0e9ee923b45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:26.101742 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b81a99-df92-43e4-89d6-a0e9ee923b45 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:26.109486 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 104/197] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 17 18:03:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:26.110277 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b81a99-df92-43e4-89d6-a0e9ee923b45 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:26.137122 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843540d8-44f7-40af-ac1b-290482e663ef None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:26.168054 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc48cb3-2866-4453-a867-33186baa5ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:26.168900 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc48cb3-2866-4453-a867-33186baa5ee4 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:26.169176 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc48cb3-2866-4453-a867-33186baa5ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:26.169443 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc48cb3-2866-4453-a867-33186baa5ee4 None admin] PATH_INFO: `/v3/users/f16a286989d94ca4a48696ab219e2cdc` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:26.183551 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc48cb3-2866-4453-a867-33186baa5ee4 None admin] RBAC: Authorizing `identity:get_user(user_id=f16a286989d94ca4a48696ab219e2cdc)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:26.184979 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc48cb3-2866-4453-a867-33186baa5ee4 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:26.186638 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 94/198] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 17 18:03:26 2022] GET /identity/v3/users/f16a286989d94ca4a48696ab219e2cdc => generated 283 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:26.188980 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc48cb3-2866-4453-a867-33186baa5ee4 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:26.206916 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b81a99-df92-43e4-89d6-a0e9ee923b45 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:26.238681 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d21affe-4f73-4c8f-89be-efe439bca019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:26.239529 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21affe-4f73-4c8f-89be-efe439bca019 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:26.239807 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21affe-4f73-4c8f-89be-efe439bca019 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:26.240078 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21affe-4f73-4c8f-89be-efe439bca019 None admin] PATH_INFO: `/v3/projects/d7cf4e05380e477d8f7793c92acc9742` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:26.241427 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d21affe-4f73-4c8f-89be-efe439bca019 None admin] RBAC: Authorizing `identity:get_project(project_id=d7cf4e05380e477d8f7793c92acc9742)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:26.242951 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d21affe-4f73-4c8f-89be-efe439bca019 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:26.244635 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 105/199] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 17 18:03:26 2022] GET /identity/v3/projects/d7cf4e05380e477d8f7793c92acc9742 => generated 298 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:26.245410 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d21affe-4f73-4c8f-89be-efe439bca019 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:26.280527 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc48cb3-2866-4453-a867-33186baa5ee4 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:26.312495 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd92861-6ae7-4eba-b836-d14ab00785d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:26.313141 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd92861-6ae7-4eba-b836-d14ab00785d4 None admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:26.313420 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd92861-6ae7-4eba-b836-d14ab00785d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:26.313734 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd92861-6ae7-4eba-b836-d14ab00785d4 None admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:26.314433 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd92861-6ae7-4eba-b836-d14ab00785d4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:26.315901 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd92861-6ae7-4eba-b836-d14ab00785d4 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:26.334605 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 95/200] 10.222.0.65 () {60 vars in 1132 bytes} [Tue May 17 18:03:26 2022] POST /identity/v3/users => generated 297 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:03:26.335511 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd92861-6ae7-4eba-b836-d14ab00785d4 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:26.338375 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d21affe-4f73-4c8f-89be-efe439bca019 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:26.374367 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb1c699-32bb-4d7b-a39b-f15dc3a67bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:26.375802 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1c699-32bb-4d7b-a39b-f15dc3a67bcc None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:26.376084 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1c699-32bb-4d7b-a39b-f15dc3a67bcc None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:26.376365 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1c699-32bb-4d7b-a39b-f15dc3a67bcc None admin] PATH_INFO: `/v3/users/f16a286989d94ca4a48696ab219e2cdc` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:26.377701 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb1c699-32bb-4d7b-a39b-f15dc3a67bcc None admin] RBAC: Authorizing `identity:get_user(user_id=f16a286989d94ca4a48696ab219e2cdc)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:26.379186 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb1c699-32bb-4d7b-a39b-f15dc3a67bcc None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:26.381049 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 106/201] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 17 18:03:26 2022] GET /identity/v3/users/f16a286989d94ca4a48696ab219e2cdc => generated 283 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:26.386392 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb1c699-32bb-4d7b-a39b-f15dc3a67bcc None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:26.439933 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd92861-6ae7-4eba-b836-d14ab00785d4 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:26.474906 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acffbbd2-c638-4e14-8ac4-e7e049622bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:26.475563 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acffbbd2-c638-4e14-8ac4-e7e049622bd7 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:26.475840 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acffbbd2-c638-4e14-8ac4-e7e049622bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:26.476112 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acffbbd2-c638-4e14-8ac4-e7e049622bd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:26.493822 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb1c699-32bb-4d7b-a39b-f15dc3a67bcc None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:26.528180 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65da2960-cab0-4d17-9219-66ecca5cfb85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:26.529575 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da2960-cab0-4d17-9219-66ecca5cfb85 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:26.529575 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da2960-cab0-4d17-9219-66ecca5cfb85 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:26.529575 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65da2960-cab0-4d17-9219-66ecca5cfb85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:26.530293 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65da2960-cab0-4d17-9219-66ecca5cfb85 None admin] RBAC: Adding query filter params (role.id=6f39f2f8bcc04c11b768de7f0c994fd7, scope.project.id=d7cf4e05380e477d8f7793c92acc9742, user.id=49dc952b9d904831a726eeaa23990861) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:26.530853 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65da2960-cab0-4d17-9219-66ecca5cfb85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:26.532073 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65da2960-cab0-4d17-9219-66ecca5cfb85 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:26.539071 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 107/202] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 17 18:03:26 2022] GET /identity/v3/role_assignments?user.id=49dc952b9d904831a726eeaa23990861&scope.project.id=d7cf4e05380e477d8f7793c92acc9742&role.id=6f39f2f8bcc04c11b768de7f0c994fd7 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:26.539071 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65da2960-cab0-4d17-9219-66ecca5cfb85 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:26.547713 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acffbbd2-c638-4e14-8ac4-e7e049622bd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:26.549296 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acffbbd2-c638-4e14-8ac4-e7e049622bd7 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:26.647038 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65da2960-cab0-4d17-9219-66ecca5cfb85 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:26.660917 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 96/203] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 17 18:03:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 18:03:26.666884 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acffbbd2-c638-4e14-8ac4-e7e049622bd7 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:26.686635 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55c4d7-2998-44d9-a38f-bb6ef91e6b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:26.687727 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55c4d7-2998-44d9-a38f-bb6ef91e6b69 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:26.688214 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55c4d7-2998-44d9-a38f-bb6ef91e6b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:26.688689 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf55c4d7-2998-44d9-a38f-bb6ef91e6b69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:26.764859 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf55c4d7-2998-44d9-a38f-bb6ef91e6b69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:26.766514 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf55c4d7-2998-44d9-a38f-bb6ef91e6b69 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:26.774484 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acffbbd2-c638-4e14-8ac4-e7e049622bd7 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:26.808705 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed09dd-f74d-4c0f-8a07-df255caf1f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:26.809580 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed09dd-f74d-4c0f-8a07-df255caf1f0b None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:26.809858 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed09dd-f74d-4c0f-8a07-df255caf1f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:26.810122 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ed09dd-f74d-4c0f-8a07-df255caf1f0b None admin] PATH_INFO: `/v3/projects/3d967b497e5049b1bd80196bde0b33fd` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:26.811314 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ed09dd-f74d-4c0f-8a07-df255caf1f0b None admin] RBAC: Authorizing `identity:get_project(project_id=3d967b497e5049b1bd80196bde0b33fd)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:26.812855 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ed09dd-f74d-4c0f-8a07-df255caf1f0b None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:26.819677 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 97/204] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 17 18:03:26 2022] GET /identity/v3/projects/3d967b497e5049b1bd80196bde0b33fd => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:03:26.821983 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed09dd-f74d-4c0f-8a07-df255caf1f0b None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:26.879379 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 108/205] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 17 18:03:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 18:03:26.884838 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55c4d7-2998-44d9-a38f-bb6ef91e6b69 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:26.949720 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ed09dd-f74d-4c0f-8a07-df255caf1f0b None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:26.990889 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf55c4d7-2998-44d9-a38f-bb6ef91e6b69 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:26.993381 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73386747-d4f2-416f-a7c2-6d81575c6ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:26.994239 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73386747-d4f2-416f-a7c2-6d81575c6ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:26.994666 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73386747-d4f2-416f-a7c2-6d81575c6ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:26.995937 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73386747-d4f2-416f-a7c2-6d81575c6ea7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:26.996969 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73386747-d4f2-416f-a7c2-6d81575c6ea7 None admin] RBAC: Adding query filter params (role.id=c3b3265cd6364fbcb22a731040b7b47a, scope.project.id=3d967b497e5049b1bd80196bde0b33fd, user.id=f16a286989d94ca4a48696ab219e2cdc) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:26.997444 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73386747-d4f2-416f-a7c2-6d81575c6ea7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:26.999060 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73386747-d4f2-416f-a7c2-6d81575c6ea7 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:27.009970 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 98/206] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 17 18:03:26 2022] GET /identity/v3/role_assignments?user.id=f16a286989d94ca4a48696ab219e2cdc&scope.project.id=3d967b497e5049b1bd80196bde0b33fd&role.id=c3b3265cd6364fbcb22a731040b7b47a => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:27.049176 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d4c4e-1737-4e12-bf58-aff2a0bbe59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:27.050073 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d4c4e-1737-4e12-bf58-aff2a0bbe59a None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:27.050354 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d4c4e-1737-4e12-bf58-aff2a0bbe59a None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:27.050627 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d4c4e-1737-4e12-bf58-aff2a0bbe59a None admin] PATH_INFO: `/v3/projects/3d967b497e5049b1bd80196bde0b33fd` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:27.052542 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d4c4e-1737-4e12-bf58-aff2a0bbe59a None admin] RBAC: Authorizing `identity:get_project(project_id=3d967b497e5049b1bd80196bde0b33fd)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:27.054111 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d4c4e-1737-4e12-bf58-aff2a0bbe59a None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:27.056248 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 109/207] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 17 18:03:26 2022] GET /identity/v3/projects/3d967b497e5049b1bd80196bde0b33fd => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:03:27.061979 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73386747-d4f2-416f-a7c2-6d81575c6ea7 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:27.178979 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73386747-d4f2-416f-a7c2-6d81575c6ea7 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:27.216155 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed26958-66d0-424c-867c-dc0d935949a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:27.217056 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed26958-66d0-424c-867c-dc0d935949a6 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:27.217343 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed26958-66d0-424c-867c-dc0d935949a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:27.217645 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed26958-66d0-424c-867c-dc0d935949a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:27.218563 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed26958-66d0-424c-867c-dc0d935949a6 None admin] RBAC: Adding query filter params (role.id=332c8d70fd0f41e2beea20aaead5daa5, scope.project.id=3d967b497e5049b1bd80196bde0b33fd, user.id=f16a286989d94ca4a48696ab219e2cdc) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:27.218873 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed26958-66d0-424c-867c-dc0d935949a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:27.220304 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed26958-66d0-424c-867c-dc0d935949a6 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:27.226233 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 99/208] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 17 18:03:27 2022] GET /identity/v3/role_assignments?user.id=f16a286989d94ca4a48696ab219e2cdc&scope.project.id=3d967b497e5049b1bd80196bde0b33fd&role.id=332c8d70fd0f41e2beea20aaead5daa5 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:28.863319 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a7ef38-a8be-4259-ba39-6bfddb85a6af None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:28.864188 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a7ef38-a8be-4259-ba39-6bfddb85a6af None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:28.864609 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a7ef38-a8be-4259-ba39-6bfddb85a6af None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:28.866405 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 110/209] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:03:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:03:28.871923 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb84b7-63b5-48db-87bb-5b58c2f02b96 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:28.872327 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb84b7-63b5-48db-87bb-5b58c2f02b96 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:28.872523 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb84b7-63b5-48db-87bb-5b58c2f02b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:28.883046 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc017ab1-1848-4c67-a092-6ec7328bf007 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:28.883330 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc017ab1-1848-4c67-a092-6ec7328bf007 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:28.883607 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc017ab1-1848-4c67-a092-6ec7328bf007 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:28.885086 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 111/210] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:03:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 18:03:28.889410 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-4bcb84b7-63b5-48db-87bb-5b58c2f02b96 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:03:28.891184 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-4bcb84b7-63b5-48db-87bb-5b58c2f02b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:03:28.891760 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a715df9-ea56-4dcf-aa82-c0381c53747a None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:28.892248 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a715df9-ea56-4dcf-aa82-c0381c53747a None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:28.892740 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a715df9-ea56-4dcf-aa82-c0381c53747a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:28.914615 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-8a715df9-ea56-4dcf-aa82-c0381c53747a None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:03:28.916672 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-8a715df9-ea56-4dcf-aa82-c0381c53747a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:03:28.959611 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 100/211] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:03:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:03:28.983700 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb84b7-63b5-48db-87bb-5b58c2f02b96 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:28.994978 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 112/212] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:03:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 18:03:29.018994 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a715df9-ea56-4dcf-aa82-c0381c53747a None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:29.112088 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb84b7-63b5-48db-87bb-5b58c2f02b96 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:29.150231 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a715df9-ea56-4dcf-aa82-c0381c53747a None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:29.153513 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed00308-bd28-4f91-8861-ded578d7073e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:29.154181 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed00308-bd28-4f91-8861-ded578d7073e None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:29.154460 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed00308-bd28-4f91-8861-ded578d7073e None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:29.154734 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed00308-bd28-4f91-8861-ded578d7073e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:29.155951 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed00308-bd28-4f91-8861-ded578d7073e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:29.157395 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed00308-bd28-4f91-8861-ded578d7073e None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:29.159067 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 101/213] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:03:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:03:29.164930 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed00308-bd28-4f91-8861-ded578d7073e None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:29.190548 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcbf487-0bf7-44fc-974d-1a83cfd7a744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:29.192356 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcbf487-0bf7-44fc-974d-1a83cfd7a744 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:29.193127 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcbf487-0bf7-44fc-974d-1a83cfd7a744 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:29.193654 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcbf487-0bf7-44fc-974d-1a83cfd7a744 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:29.210327 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcbf487-0bf7-44fc-974d-1a83cfd7a744 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:03:29.221126 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-2bcbf487-0bf7-44fc-974d-1a83cfd7a744 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 18:03:29.221126 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:03:29.221126 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:03:29.221126 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:03:29.221126 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:03:29.221126 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:03:29.221126 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:03:29.221126 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:03:29.221126 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:03:29.221126 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:03:29.221126 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:03:29.221126 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:03:29.221126 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:03:29.221126 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:03:29.221126 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:03:29.221126 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:03:29.222108 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:03:29.222108 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:03:29.222108 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:03:29.222108 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:03:29.222108 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:03:29.222108 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:03:29.222108 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:03:29.222108 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:03:29.222108 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:03:29.222108 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:03:29.222108 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:03:29.222108 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:03:29.222108 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:03:29.222108 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:03:29.222108 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:03:29.222108 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:03:29.223180 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:03:29.223180 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:03:29.223180 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:03:29.223180 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:03:29.223180 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:03:29.223180 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:03:29.223180 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:03:29.223180 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:03:29.223180 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:03:29.223180 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:03:29.223180 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 18:03:29.223180 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:03:29.230138 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 113/214] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 17 18:03:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:03:29.231632 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcbf487-0bf7-44fc-974d-1a83cfd7a744 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:29.285796 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed00308-bd28-4f91-8861-ded578d7073e None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:29.325376 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07068727-8d8c-4a58-a075-8b00b2156fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:29.326087 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07068727-8d8c-4a58-a075-8b00b2156fa7 None admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:29.326365 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07068727-8d8c-4a58-a075-8b00b2156fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:29.326638 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07068727-8d8c-4a58-a075-8b00b2156fa7 None admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:29.327348 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07068727-8d8c-4a58-a075-8b00b2156fa7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:29.329360 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07068727-8d8c-4a58-a075-8b00b2156fa7 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:29.342904 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcbf487-0bf7-44fc-974d-1a83cfd7a744 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:29.349429 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 102/215] 10.222.0.65 () {60 vars in 1132 bytes} [Tue May 17 18:03:29 2022] POST /identity/v3/users => generated 297 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:03:29.350754 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82397465-4cd4-4780-89a9-a71378a682a3 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:29.351193 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82397465-4cd4-4780-89a9-a71378a682a3 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:29.351367 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82397465-4cd4-4780-89a9-a71378a682a3 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:29.352640 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 103/216] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:03:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:03:29.358391 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2b4df-2952-4e66-95ec-14f272c9f31e None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:29.358673 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2b4df-2952-4e66-95ec-14f272c9f31e None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:29.358951 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2b4df-2952-4e66-95ec-14f272c9f31e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:29.377239 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-46f2b4df-2952-4e66-95ec-14f272c9f31e None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:03:29.378527 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-46f2b4df-2952-4e66-95ec-14f272c9f31e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:03:29.388948 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab9f009-3a0b-42a8-a912-fdd6294d854c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:29.389966 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9f009-3a0b-42a8-a912-fdd6294d854c None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:29.390318 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9f009-3a0b-42a8-a912-fdd6294d854c None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:29.390693 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9f009-3a0b-42a8-a912-fdd6294d854c None admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:29.391471 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab9f009-3a0b-42a8-a912-fdd6294d854c None admin] RBAC: Adding query filter params (name=member) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:29.391781 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab9f009-3a0b-42a8-a912-fdd6294d854c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:29.393231 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab9f009-3a0b-42a8-a912-fdd6294d854c None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:29.403348 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 114/217] 10.222.0.65 () {56 vars in 1101 bytes} [Tue May 17 18:03:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:03:29.409731 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab9f009-3a0b-42a8-a912-fdd6294d854c None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:29.455392 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 104/218] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:03:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 18:03:29.457053 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f8064-9b9e-433d-a299-0dddb52d2d53 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:29.457503 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f8064-9b9e-433d-a299-0dddb52d2d53 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:29.457916 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f8064-9b9e-433d-a299-0dddb52d2d53 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:29.459768 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 105/219] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:03:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:03:29.467143 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990fda60-6ff7-49f3-974c-2ac1514a5e3d None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:29.467446 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990fda60-6ff7-49f3-974c-2ac1514a5e3d None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:29.467690 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990fda60-6ff7-49f3-974c-2ac1514a5e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:29.487702 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-990fda60-6ff7-49f3-974c-2ac1514a5e3d None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:03:29.488912 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-990fda60-6ff7-49f3-974c-2ac1514a5e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:03:29.529099 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab9f009-3a0b-42a8-a912-fdd6294d854c None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:29.557237 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 106/220] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:03:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:03:29.557727 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990fda60-6ff7-49f3-974c-2ac1514a5e3d None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:29.566996 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f05358-8c88-40d2-a95c-daabd7d399b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:29.568127 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f05358-8c88-40d2-a95c-daabd7d399b3 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:29.568405 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f05358-8c88-40d2-a95c-daabd7d399b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:29.568670 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f05358-8c88-40d2-a95c-daabd7d399b3 None admin] PATH_INFO: `/v3/users/9249a64b1d9f44488f63b0507f14baa4` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:29.584359 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f05358-8c88-40d2-a95c-daabd7d399b3 None admin] RBAC: Authorizing `identity:get_user(user_id=9249a64b1d9f44488f63b0507f14baa4)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:29.586712 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f05358-8c88-40d2-a95c-daabd7d399b3 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:29.587595 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 115/221] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 17 18:03:29 2022] GET /identity/v3/users/9249a64b1d9f44488f63b0507f14baa4 => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:29.590347 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f05358-8c88-40d2-a95c-daabd7d399b3 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:29.679931 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990fda60-6ff7-49f3-974c-2ac1514a5e3d None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:29.720881 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f05358-8c88-40d2-a95c-daabd7d399b3 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:29.723627 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ec6e08-b85d-4ea5-8a7e-3096f7baa8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:29.724428 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec6e08-b85d-4ea5-8a7e-3096f7baa8b7 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:29.724707 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec6e08-b85d-4ea5-8a7e-3096f7baa8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:29.724977 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec6e08-b85d-4ea5-8a7e-3096f7baa8b7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:29.737540 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ec6e08-b85d-4ea5-8a7e-3096f7baa8b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:03:29.745618 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-a6ec6e08-b85d-4ea5-8a7e-3096f7baa8b7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 18:03:29.745618 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:03:29.745618 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:03:29.745618 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:03:29.745618 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:03:29.745618 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:03:29.745618 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:03:29.745618 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:03:29.745618 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:03:29.745618 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:03:29.745618 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:03:29.745618 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:03:29.745618 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:03:29.745618 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:03:29.745618 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:03:29.745618 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:03:29.746540 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:03:29.746540 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:03:29.746540 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:03:29.746540 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:03:29.746540 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:03:29.746540 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:03:29.746540 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:03:29.746540 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:03:29.746540 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:03:29.746540 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:03:29.746540 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:03:29.746540 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:03:29.746540 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:03:29.746540 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:03:29.746540 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:03:29.746540 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:03:29.747323 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:03:29.747323 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:03:29.747323 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:03:29.747323 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:03:29.747323 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:03:29.747323 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:03:29.747323 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:03:29.747323 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:03:29.747323 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:03:29.747323 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:03:29.747323 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 18:03:29.747323 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:03:29.747323 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 107/222] 10.222.0.65 () {56 vars in 1114 bytes} [Tue May 17 18:03:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:03:29.747976 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ec6e08-b85d-4ea5-8a7e-3096f7baa8b7 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:29.763513 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8840a68-147e-4152-9077-2fda02c29965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:29.764562 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8840a68-147e-4152-9077-2fda02c29965 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:29.764840 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8840a68-147e-4152-9077-2fda02c29965 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:29.765105 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8840a68-147e-4152-9077-2fda02c29965 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:29.776584 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8840a68-147e-4152-9077-2fda02c29965 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:03:29.784452 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-d8840a68-147e-4152-9077-2fda02c29965 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:03:29.784452 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:03:29.784452 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:03:29.784452 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:03:29.784452 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:03:29.784452 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:03:29.784452 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:03:29.784452 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:03:29.784452 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:03:29.784452 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:03:29.784452 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:03:29.784452 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:03:29.784452 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:03:29.784452 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:03:29.784452 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:03:29.784452 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:03:29.785346 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:03:29.785346 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:03:29.785346 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:03:29.785346 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:03:29.785346 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:03:29.785346 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:03:29.785346 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:03:29.785346 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:03:29.785346 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:03:29.785346 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:03:29.785346 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:03:29.785346 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:03:29.785346 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:03:29.785346 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:03:29.785346 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:03:29.785346 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:03:29.786163 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:03:29.786163 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:03:29.786163 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:03:29.786163 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:03:29.786163 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:03:29.786163 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:03:29.786163 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:03:29.786163 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:03:29.786163 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:03:29.786163 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:03:29.786163 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:03:29.786163 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:03:29.786163 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 116/223] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 17 18:03:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:03:29.786820 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8840a68-147e-4152-9077-2fda02c29965 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:29.857814 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ec6e08-b85d-4ea5-8a7e-3096f7baa8b7 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:29.892776 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05975f14-1925-4ee1-a92c-ccecb8958748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:29.893428 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05975f14-1925-4ee1-a92c-ccecb8958748 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:29.893737 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05975f14-1925-4ee1-a92c-ccecb8958748 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:29.894010 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05975f14-1925-4ee1-a92c-ccecb8958748 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:29.907083 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8840a68-147e-4152-9077-2fda02c29965 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:29.941310 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88323e7e-5fff-4e66-ac3f-f12c70135cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:29.941923 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88323e7e-5fff-4e66-ac3f-f12c70135cdc None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:29.942454 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88323e7e-5fff-4e66-ac3f-f12c70135cdc None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:29.942726 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88323e7e-5fff-4e66-ac3f-f12c70135cdc None admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:29.943469 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88323e7e-5fff-4e66-ac3f-f12c70135cdc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:29.943768 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88323e7e-5fff-4e66-ac3f-f12c70135cdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:29.945142 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88323e7e-5fff-4e66-ac3f-f12c70135cdc None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:29.953546 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 117/224] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 17 18:03:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:29.954368 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88323e7e-5fff-4e66-ac3f-f12c70135cdc None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:29.963912 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05975f14-1925-4ee1-a92c-ccecb8958748 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:29.965411 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05975f14-1925-4ee1-a92c-ccecb8958748 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:30.057433 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88323e7e-5fff-4e66-ac3f-f12c70135cdc None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:30.071845 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 108/225] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 17 18:03:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 18:03:30.072707 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05975f14-1925-4ee1-a92c-ccecb8958748 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:30.093085 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a8790-a1cf-438f-965a-f1a36a36cc1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:30.093810 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a8790-a1cf-438f-965a-f1a36a36cc1b None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:30.094373 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a8790-a1cf-438f-965a-f1a36a36cc1b None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:30.094650 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a8790-a1cf-438f-965a-f1a36a36cc1b None admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:30.095395 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2a8790-a1cf-438f-965a-f1a36a36cc1b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:30.095697 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2a8790-a1cf-438f-965a-f1a36a36cc1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:30.097068 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2a8790-a1cf-438f-965a-f1a36a36cc1b None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:30.110068 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 118/226] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 17 18:03:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:30.110989 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a8790-a1cf-438f-965a-f1a36a36cc1b None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:30.174216 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05975f14-1925-4ee1-a92c-ccecb8958748 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:30.209304 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4169b0-b8c7-43f7-aedb-56250bd7e239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:30.210116 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4169b0-b8c7-43f7-aedb-56250bd7e239 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:30.210316 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a8790-a1cf-438f-965a-f1a36a36cc1b None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:30.210474 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4169b0-b8c7-43f7-aedb-56250bd7e239 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:30.210653 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4169b0-b8c7-43f7-aedb-56250bd7e239 None admin] PATH_INFO: `/v3/users/f16a286989d94ca4a48696ab219e2cdc` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:30.211882 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4169b0-b8c7-43f7-aedb-56250bd7e239 None admin] RBAC: Authorizing `identity:get_user(user_id=f16a286989d94ca4a48696ab219e2cdc)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:30.213396 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4169b0-b8c7-43f7-aedb-56250bd7e239 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:30.215321 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 109/227] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 17 18:03:30 2022] GET /identity/v3/users/f16a286989d94ca4a48696ab219e2cdc => generated 283 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:30.215941 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4169b0-b8c7-43f7-aedb-56250bd7e239 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:30.243773 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe258f0-d2e2-40e8-8d59-3aaabd6193e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:30.244627 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe258f0-d2e2-40e8-8d59-3aaabd6193e0 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:30.244903 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe258f0-d2e2-40e8-8d59-3aaabd6193e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:30.245165 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe258f0-d2e2-40e8-8d59-3aaabd6193e0 None admin] PATH_INFO: `/v3/projects/3d967b497e5049b1bd80196bde0b33fd` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:30.246354 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe258f0-d2e2-40e8-8d59-3aaabd6193e0 None admin] RBAC: Authorizing `identity:get_project(project_id=3d967b497e5049b1bd80196bde0b33fd)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:30.247803 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe258f0-d2e2-40e8-8d59-3aaabd6193e0 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:30.249716 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 119/228] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 17 18:03:30 2022] GET /identity/v3/projects/3d967b497e5049b1bd80196bde0b33fd => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:30.250344 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe258f0-d2e2-40e8-8d59-3aaabd6193e0 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:30.317623 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4169b0-b8c7-43f7-aedb-56250bd7e239 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:30.350495 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe258f0-d2e2-40e8-8d59-3aaabd6193e0 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:30.352292 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d6fed-ea44-484c-b3d6-aef474afc125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:30.353159 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d6fed-ea44-484c-b3d6-aef474afc125 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:30.353439 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d6fed-ea44-484c-b3d6-aef474afc125 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:30.353738 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d6fed-ea44-484c-b3d6-aef474afc125 None admin] PATH_INFO: `/v3/users/f16a286989d94ca4a48696ab219e2cdc` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:30.354997 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d6fed-ea44-484c-b3d6-aef474afc125 None admin] RBAC: Authorizing `identity:get_user(user_id=f16a286989d94ca4a48696ab219e2cdc)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:30.356496 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d6fed-ea44-484c-b3d6-aef474afc125 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:30.358410 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 110/229] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 17 18:03:30 2022] GET /identity/v3/users/f16a286989d94ca4a48696ab219e2cdc => generated 283 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:30.359580 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d6fed-ea44-484c-b3d6-aef474afc125 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:30.393321 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cd70be-53c0-4ef5-811f-d8e6cc724131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:30.394543 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd70be-53c0-4ef5-811f-d8e6cc724131 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:30.395139 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd70be-53c0-4ef5-811f-d8e6cc724131 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:30.395419 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd70be-53c0-4ef5-811f-d8e6cc724131 None admin] PATH_INFO: `/v3/projects/3d967b497e5049b1bd80196bde0b33fd` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:30.397115 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cd70be-53c0-4ef5-811f-d8e6cc724131 None admin] RBAC: Authorizing `identity:get_project(project_id=3d967b497e5049b1bd80196bde0b33fd)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:30.398936 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cd70be-53c0-4ef5-811f-d8e6cc724131 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:30.401655 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 120/230] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 17 18:03:30 2022] GET /identity/v3/projects/3d967b497e5049b1bd80196bde0b33fd => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:30.402324 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cd70be-53c0-4ef5-811f-d8e6cc724131 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:30.487211 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d6fed-ea44-484c-b3d6-aef474afc125 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:30.520689 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cd70be-53c0-4ef5-811f-d8e6cc724131 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:30.532465 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238273a9-1e91-4866-80ba-356355e540c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:30.533127 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238273a9-1e91-4866-80ba-356355e540c2 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:30.533447 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238273a9-1e91-4866-80ba-356355e540c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:30.533748 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238273a9-1e91-4866-80ba-356355e540c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:30.535113 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238273a9-1e91-4866-80ba-356355e540c2 None admin] RBAC: Adding query filter params (role.id=2af599fd3ad74031901ea2d9e0408884, scope.project.id=3d967b497e5049b1bd80196bde0b33fd, user.id=9249a64b1d9f44488f63b0507f14baa4) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:30.535432 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238273a9-1e91-4866-80ba-356355e540c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:30.537356 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238273a9-1e91-4866-80ba-356355e540c2 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:30.544447 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 111/231] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 17 18:03:30 2022] GET /identity/v3/role_assignments?user.id=9249a64b1d9f44488f63b0507f14baa4&scope.project.id=3d967b497e5049b1bd80196bde0b33fd&role.id=2af599fd3ad74031901ea2d9e0408884 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:30.545634 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238273a9-1e91-4866-80ba-356355e540c2 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:30.555620 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b971754c-95d3-402f-9ab9-277d663249bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:30.556663 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971754c-95d3-402f-9ab9-277d663249bc None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:30.557043 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971754c-95d3-402f-9ab9-277d663249bc None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:30.557366 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971754c-95d3-402f-9ab9-277d663249bc None admin] PATH_INFO: `/v3/projects/3d967b497e5049b1bd80196bde0b33fd` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:30.558686 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b971754c-95d3-402f-9ab9-277d663249bc None admin] RBAC: Authorizing `identity:get_project(project_id=3d967b497e5049b1bd80196bde0b33fd)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:30.560283 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b971754c-95d3-402f-9ab9-277d663249bc None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:30.562882 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 121/232] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 17 18:03:30 2022] GET /identity/v3/projects/3d967b497e5049b1bd80196bde0b33fd => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:30.568546 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b971754c-95d3-402f-9ab9-277d663249bc None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:30.665918 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238273a9-1e91-4866-80ba-356355e540c2 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:30.677987 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b971754c-95d3-402f-9ab9-277d663249bc None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:30.701321 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a72dcb4-f089-4fbd-abcc-325d21696902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:30.702248 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72dcb4-f089-4fbd-abcc-325d21696902 None admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:30.702533 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72dcb4-f089-4fbd-abcc-325d21696902 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:30.702846 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72dcb4-f089-4fbd-abcc-325d21696902 None admin] PATH_INFO: `/v3/projects/3d967b497e5049b1bd80196bde0b33fd/users/f16a286989d94ca4a48696ab219e2cdc/roles/c3b3265cd6364fbcb22a731040b7b47a` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:30.705170 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a72dcb4-f089-4fbd-abcc-325d21696902 None admin] RBAC: Authorizing `identity:create_grant(project_id=3d967b497e5049b1bd80196bde0b33fd, user_id=f16a286989d94ca4a48696ab219e2cdc, role_id=c3b3265cd6364fbcb22a731040b7b47a)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:30.706653 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a72dcb4-f089-4fbd-abcc-325d21696902 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:30.719338 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02b111-a7ba-4e65-95ed-166c6fdd7bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:30.721495 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02b111-a7ba-4e65-95ed-166c6fdd7bdb None admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:30.721844 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02b111-a7ba-4e65-95ed-166c6fdd7bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:30.722242 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02b111-a7ba-4e65-95ed-166c6fdd7bdb None admin] PATH_INFO: `/v3/projects/3d967b497e5049b1bd80196bde0b33fd/users/f16a286989d94ca4a48696ab219e2cdc/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:30.724780 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f02b111-a7ba-4e65-95ed-166c6fdd7bdb None admin] RBAC: Authorizing `identity:create_grant(project_id=3d967b497e5049b1bd80196bde0b33fd, user_id=f16a286989d94ca4a48696ab219e2cdc, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:30.726831 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f02b111-a7ba-4e65-95ed-166c6fdd7bdb None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:30.736960 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 112/233] 10.222.0.65 () {58 vars in 1439 bytes} [Tue May 17 18:03:30 2022] PUT /identity/v3/projects/3d967b497e5049b1bd80196bde0b33fd/users/f16a286989d94ca4a48696ab219e2cdc/roles/c3b3265cd6364fbcb22a731040b7b47a => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:03:30.751300 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 122/234] 10.222.0.65 () {58 vars in 1439 bytes} [Tue May 17 18:03:30 2022] PUT /identity/v3/projects/3d967b497e5049b1bd80196bde0b33fd/users/f16a286989d94ca4a48696ab219e2cdc/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:03:32.166975 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a98d00-2aa6-4995-abbe-5f82619feef6 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:32.167497 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a98d00-2aa6-4995-abbe-5f82619feef6 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:32.167735 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a98d00-2aa6-4995-abbe-5f82619feef6 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:32.169491 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 113/235] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:03:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:03:32.175665 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ec434-c447-4d54-ab74-fb64f4e175a6 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:32.176187 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ec434-c447-4d54-ab74-fb64f4e175a6 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:32.176187 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50ec434-c447-4d54-ab74-fb64f4e175a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:32.197218 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-e50ec434-c447-4d54-ab74-fb64f4e175a6 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:03:32.202463 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-e50ec434-c447-4d54-ab74-fb64f4e175a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:03:32.219030 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5cbe87-ff6d-487c-9993-603e75aca4cf None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:32.219336 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5cbe87-ff6d-487c-9993-603e75aca4cf None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:32.219577 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5cbe87-ff6d-487c-9993-603e75aca4cf None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:32.222754 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 114/236] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:03:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:03:32.227382 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0b14b-18f3-470e-b305-0dd3de241c55 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:32.227686 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0b14b-18f3-470e-b305-0dd3de241c55 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:32.227933 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0b14b-18f3-470e-b305-0dd3de241c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:32.270459 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-9eb0b14b-18f3-470e-b305-0dd3de241c55 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:03:32.271679 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-9eb0b14b-18f3-470e-b305-0dd3de241c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:03:32.286594 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 123/237] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:03:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:03:32.320373 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ec434-c447-4d54-ab74-fb64f4e175a6 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:32.365830 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 115/238] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:03:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 18:03:32.406568 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb0b14b-18f3-470e-b305-0dd3de241c55 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:32.458037 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50ec434-c447-4d54-ab74-fb64f4e175a6 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:32.513763 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79edbc3a-ee31-46a5-ad04-d2c6a8528ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:32.514560 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79edbc3a-ee31-46a5-ad04-d2c6a8528ea8 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:32.514841 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79edbc3a-ee31-46a5-ad04-d2c6a8528ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:32.515636 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79edbc3a-ee31-46a5-ad04-d2c6a8528ea8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:32.517087 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79edbc3a-ee31-46a5-ad04-d2c6a8528ea8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:32.518576 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79edbc3a-ee31-46a5-ad04-d2c6a8528ea8 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:32.520353 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 124/239] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:03:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:03:32.526161 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79edbc3a-ee31-46a5-ad04-d2c6a8528ea8 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:32.595373 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb0b14b-18f3-470e-b305-0dd3de241c55 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:32.632105 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2908393-b64e-4a16-865a-bbb7dcfe7bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:32.632894 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2908393-b64e-4a16-865a-bbb7dcfe7bd7 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:32.633172 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2908393-b64e-4a16-865a-bbb7dcfe7bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:32.633445 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2908393-b64e-4a16-865a-bbb7dcfe7bd7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:32.644114 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2908393-b64e-4a16-865a-bbb7dcfe7bd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:03:32.651880 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-e2908393-b64e-4a16-865a-bbb7dcfe7bd7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 17 18:03:32.651880 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:03:32.651880 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:03:32.651880 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:03:32.651880 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:03:32.651880 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:03:32.651880 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:03:32.651880 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:03:32.651880 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:03:32.651880 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:03:32.651880 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:03:32.651880 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:03:32.651880 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:03:32.651880 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:03:32.651880 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:03:32.651880 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:03:32.652751 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:03:32.652751 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:03:32.652751 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:03:32.652751 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:03:32.652751 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:03:32.652751 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:03:32.652751 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:03:32.652751 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:03:32.652751 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:03:32.652751 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:03:32.652751 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:03:32.652751 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:03:32.652751 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:03:32.652751 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:03:32.652751 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:03:32.652751 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:03:32.653559 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:03:32.653559 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:03:32.653559 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:03:32.653559 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:03:32.653559 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:03:32.653559 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:03:32.653559 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:03:32.653559 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:03:32.653559 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:03:32.653559 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:03:32.653559 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 17 18:03:32.653559 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:03:32.657579 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 116/240] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 17 18:03:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:03:32.659226 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2908393-b64e-4a16-865a-bbb7dcfe7bd7 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:32.749144 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79edbc3a-ee31-46a5-ad04-d2c6a8528ea8 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:32.762758 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2908393-b64e-4a16-865a-bbb7dcfe7bd7 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:32.796326 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0dc8d0-741a-4519-a7c2-2094390e5d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:32.797556 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0dc8d0-741a-4519-a7c2-2094390e5d85 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:32.797840 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0dc8d0-741a-4519-a7c2-2094390e5d85 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:32.798116 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0dc8d0-741a-4519-a7c2-2094390e5d85 None admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:32.799171 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0dc8d0-741a-4519-a7c2-2094390e5d85 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:32.799482 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0dc8d0-741a-4519-a7c2-2094390e5d85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:32.800873 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0dc8d0-741a-4519-a7c2-2094390e5d85 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:32.814702 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 117/241] 10.222.0.65 () {56 vars in 1101 bytes} [Tue May 17 18:03:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:32.817338 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0dc8d0-741a-4519-a7c2-2094390e5d85 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:32.840174 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c2cc9-0e39-4b99-9742-d16dc2f6b5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:32.840860 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c2cc9-0e39-4b99-9742-d16dc2f6b5c4 None admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:32.841136 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c2cc9-0e39-4b99-9742-d16dc2f6b5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:32.841404 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c2cc9-0e39-4b99-9742-d16dc2f6b5c4 None admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:32.842141 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7c2cc9-0e39-4b99-9742-d16dc2f6b5c4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:32.843645 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7c2cc9-0e39-4b99-9742-d16dc2f6b5c4 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:32.888239 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 125/242] 10.222.0.65 () {60 vars in 1132 bytes} [Tue May 17 18:03:32 2022] POST /identity/v3/users => generated 293 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:03:32.928636 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0dc8d0-741a-4519-a7c2-2094390e5d85 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:32.965324 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255d7057-69ce-4cfb-954f-396d25aeb9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:32.966479 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d7057-69ce-4cfb-954f-396d25aeb9fe None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:32.966917 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d7057-69ce-4cfb-954f-396d25aeb9fe None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:32.967366 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d7057-69ce-4cfb-954f-396d25aeb9fe None admin] PATH_INFO: `/v3/users/36030fb8ad0f49d1b8330027b860bfc6` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:32.983510 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255d7057-69ce-4cfb-954f-396d25aeb9fe None admin] RBAC: Authorizing `identity:get_user(user_id=36030fb8ad0f49d1b8330027b860bfc6)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:32.985883 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255d7057-69ce-4cfb-954f-396d25aeb9fe None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:32.992433 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 118/243] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 17 18:03:32 2022] GET /identity/v3/users/36030fb8ad0f49d1b8330027b860bfc6 => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:32.994152 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c2cc9-0e39-4b99-9742-d16dc2f6b5c4 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:33.128875 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c2cc9-0e39-4b99-9742-d16dc2f6b5c4 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:33.166341 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a612de-1cd0-4ffd-947e-64b459b39fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:33.167227 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a612de-1cd0-4ffd-947e-64b459b39fc7 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:33.167645 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a612de-1cd0-4ffd-947e-64b459b39fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:33.168113 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a612de-1cd0-4ffd-947e-64b459b39fc7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:33.236284 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a612de-1cd0-4ffd-947e-64b459b39fc7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:33.238464 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a612de-1cd0-4ffd-947e-64b459b39fc7 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:33.342808 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 126/244] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 17 18:03:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 18:03:33.350189 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255d7057-69ce-4cfb-954f-396d25aeb9fe None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:33.460595 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255d7057-69ce-4cfb-954f-396d25aeb9fe None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:33.475835 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87950192-6cf7-4c7c-90a6-26c63fee6913 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:33.476604 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87950192-6cf7-4c7c-90a6-26c63fee6913 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:33.477021 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87950192-6cf7-4c7c-90a6-26c63fee6913 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:33.480581 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 127/245] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:03:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:03:33.484779 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6046837-07e6-43db-b877-dd81b56d177a None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:33.485056 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6046837-07e6-43db-b877-dd81b56d177a None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:33.485329 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6046837-07e6-43db-b877-dd81b56d177a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:33.510557 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-b6046837-07e6-43db-b877-dd81b56d177a None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:03:33.511755 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-b6046837-07e6-43db-b877-dd81b56d177a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:03:33.514914 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5636eca0-0bdc-4482-94e3-1a72d89841ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:33.516887 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5636eca0-0bdc-4482-94e3-1a72d89841ae None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:33.517361 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5636eca0-0bdc-4482-94e3-1a72d89841ae None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:33.517831 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5636eca0-0bdc-4482-94e3-1a72d89841ae None admin] PATH_INFO: `/v3/projects/3d967b497e5049b1bd80196bde0b33fd` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:33.519999 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5636eca0-0bdc-4482-94e3-1a72d89841ae None admin] RBAC: Authorizing `identity:get_project(project_id=3d967b497e5049b1bd80196bde0b33fd)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:33.522136 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5636eca0-0bdc-4482-94e3-1a72d89841ae None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:33.524796 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 119/246] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 17 18:03:33 2022] GET /identity/v3/projects/3d967b497e5049b1bd80196bde0b33fd => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:33.531250 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5636eca0-0bdc-4482-94e3-1a72d89841ae None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:33.604560 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 128/247] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:03:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 18:03:33.606523 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b71378-375f-447a-8608-20b027c9272b None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:33.607089 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b71378-375f-447a-8608-20b027c9272b None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:33.607369 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b71378-375f-447a-8608-20b027c9272b None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:33.609447 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 129/248] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:03:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:03:33.614650 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0ecda-6029-4793-8a0b-6eb076d45597 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:33.614936 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0ecda-6029-4793-8a0b-6eb076d45597 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:33.615371 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd0ecda-6029-4793-8a0b-6eb076d45597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:33.637700 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-4cd0ecda-6029-4793-8a0b-6eb076d45597 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:03:33.638889 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-4cd0ecda-6029-4793-8a0b-6eb076d45597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:03:33.665833 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5636eca0-0bdc-4482-94e3-1a72d89841ae None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:33.714133 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e93f27-18ae-460b-b1a1-ea0434dba3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:33.714870 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e93f27-18ae-460b-b1a1-ea0434dba3b6 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:33.715152 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e93f27-18ae-460b-b1a1-ea0434dba3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:33.715743 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e93f27-18ae-460b-b1a1-ea0434dba3b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:33.716867 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e93f27-18ae-460b-b1a1-ea0434dba3b6 None admin] RBAC: Adding query filter params (role.id=6f39f2f8bcc04c11b768de7f0c994fd7, scope.project.id=3d967b497e5049b1bd80196bde0b33fd, user.id=36030fb8ad0f49d1b8330027b860bfc6) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:33.717178 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e93f27-18ae-460b-b1a1-ea0434dba3b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:33.719920 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e93f27-18ae-460b-b1a1-ea0434dba3b6 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:33.724504 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 130/249] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:03:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 18:03:33.725373 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0ecda-6029-4793-8a0b-6eb076d45597 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:33.729658 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 120/250] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 17 18:03:33 2022] GET /identity/v3/role_assignments?user.id=36030fb8ad0f49d1b8330027b860bfc6&scope.project.id=3d967b497e5049b1bd80196bde0b33fd&role.id=6f39f2f8bcc04c11b768de7f0c994fd7 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:33.736506 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff02e58-79fd-4901-a099-155b6001da75 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:33.736832 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff02e58-79fd-4901-a099-155b6001da75 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:33.737106 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff02e58-79fd-4901-a099-155b6001da75 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:33.738701 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 121/251] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:03:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:03:33.745234 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d524e9-6717-43af-ae33-7090d321ec65 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:33.745750 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d524e9-6717-43af-ae33-7090d321ec65 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:33.746039 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d524e9-6717-43af-ae33-7090d321ec65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:33.770925 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-29d524e9-6717-43af-ae33-7090d321ec65 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:03:33.772828 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-29d524e9-6717-43af-ae33-7090d321ec65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:03:33.846876 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd0ecda-6029-4793-8a0b-6eb076d45597 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:33.861862 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 122/252] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:03:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:03:33.863116 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d524e9-6717-43af-ae33-7090d321ec65 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:33.974851 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b9b63-750c-4dfe-b898-2dd3b81b8fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:33.975596 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b9b63-750c-4dfe-b898-2dd3b81b8fc0 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:33.975875 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b9b63-750c-4dfe-b898-2dd3b81b8fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:33.976145 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b9b63-750c-4dfe-b898-2dd3b81b8fc0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:33.988132 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5b9b63-750c-4dfe-b898-2dd3b81b8fc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:03:33.996836 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-bb5b9b63-750c-4dfe-b898-2dd3b81b8fc0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 18:03:33.996836 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:03:33.996836 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:03:33.996836 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:03:33.996836 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:03:33.996836 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:03:33.996836 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:03:33.996836 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:03:33.996836 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:03:33.996836 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:03:33.996836 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:03:33.996836 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:03:33.996836 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:03:33.996836 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:03:33.996836 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:03:33.996836 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:03:33.997797 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:03:33.997797 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:03:33.997797 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:03:33.997797 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:03:33.997797 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:03:33.997797 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:03:33.997797 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:03:33.997797 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:03:33.997797 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:03:33.997797 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:03:33.997797 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:03:33.997797 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:03:33.997797 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:03:33.997797 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:03:33.997797 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:03:33.997797 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:03:33.998587 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:03:33.998587 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:03:33.998587 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:03:33.998587 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:03:33.998587 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:03:33.998587 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:03:33.998587 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:03:33.998587 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:03:33.998587 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:03:33.998587 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:03:33.998587 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 18:03:33.998587 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:03:34.000962 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 131/253] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 17 18:03:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:03:34.001950 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b9b63-750c-4dfe-b898-2dd3b81b8fc0 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:34.002905 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d524e9-6717-43af-ae33-7090d321ec65 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:34.058682 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18313613-7127-42aa-9c55-dedb1add4747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:34.059492 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18313613-7127-42aa-9c55-dedb1add4747 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:34.059765 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18313613-7127-42aa-9c55-dedb1add4747 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:34.060038 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18313613-7127-42aa-9c55-dedb1add4747 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:34.079305 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18313613-7127-42aa-9c55-dedb1add4747 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:03:34.089439 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-18313613-7127-42aa-9c55-dedb1add4747 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:03:34.089439 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:03:34.089439 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:03:34.089439 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:03:34.089439 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:03:34.089439 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:03:34.089439 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:03:34.089439 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:03:34.089439 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:03:34.089439 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:03:34.089439 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:03:34.089439 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:03:34.089439 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:03:34.089439 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:03:34.089439 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:03:34.089439 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:03:34.090345 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:03:34.090345 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:03:34.090345 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:03:34.090345 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:03:34.090345 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:03:34.090345 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:03:34.090345 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:03:34.090345 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:03:34.090345 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:03:34.090345 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:03:34.090345 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:03:34.090345 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:03:34.090345 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:03:34.090345 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:03:34.090345 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:03:34.090345 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:03:34.091135 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:03:34.091135 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:03:34.091135 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:03:34.091135 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:03:34.091135 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:03:34.091135 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:03:34.091135 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:03:34.091135 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:03:34.091135 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:03:34.091135 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:03:34.091135 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:03:34.091135 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:03:34.095029 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 123/254] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 17 18:03:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:03:34.096166 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18313613-7127-42aa-9c55-dedb1add4747 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:34.208673 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18313613-7127-42aa-9c55-dedb1add4747 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:34.220407 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b9b63-750c-4dfe-b898-2dd3b81b8fc0 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:34.253163 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bdbb60-3148-4461-9cfe-7a63038e499e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:34.253753 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bdbb60-3148-4461-9cfe-7a63038e499e None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:34.254033 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bdbb60-3148-4461-9cfe-7a63038e499e None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:34.254305 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bdbb60-3148-4461-9cfe-7a63038e499e None admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:34.255055 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bdbb60-3148-4461-9cfe-7a63038e499e None admin] RBAC: Adding query filter params (name=member) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:34.255359 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bdbb60-3148-4461-9cfe-7a63038e499e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:34.260244 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e290e1-61bf-4fb6-a141-ea1e689e4e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:34.261063 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e290e1-61bf-4fb6-a141-ea1e689e4e14 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:34.261341 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e290e1-61bf-4fb6-a141-ea1e689e4e14 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:34.261641 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e290e1-61bf-4fb6-a141-ea1e689e4e14 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:34.262774 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bdbb60-3148-4461-9cfe-7a63038e499e None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:34.281791 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 124/255] 10.222.0.65 () {56 vars in 1101 bytes} [Tue May 17 18:03:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:34.282874 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bdbb60-3148-4461-9cfe-7a63038e499e None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:34.283671 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e290e1-61bf-4fb6-a141-ea1e689e4e14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:03:34.292107 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-f8e290e1-61bf-4fb6-a141-ea1e689e4e14 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 18:03:34.292107 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:03:34.292107 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:03:34.292107 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:03:34.292107 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:03:34.292107 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:03:34.292107 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:03:34.292107 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:03:34.292107 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:03:34.292107 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:03:34.292107 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:03:34.292107 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:03:34.292107 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:03:34.292107 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:03:34.292107 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:03:34.292107 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:03:34.293002 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:03:34.293002 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:03:34.293002 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:03:34.293002 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:03:34.293002 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:03:34.293002 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:03:34.293002 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:03:34.293002 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:03:34.293002 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:03:34.293002 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:03:34.293002 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:03:34.293002 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:03:34.293002 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:03:34.293002 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:03:34.293002 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:03:34.293002 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:03:34.293853 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:03:34.293853 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:03:34.293853 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:03:34.293853 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:03:34.293853 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:03:34.293853 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:03:34.293853 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:03:34.293853 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:03:34.293853 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:03:34.293853 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:03:34.293853 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 18:03:34.293853 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:03:34.293853 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 132/256] 10.222.0.65 () {56 vars in 1114 bytes} [Tue May 17 18:03:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:03:34.299247 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e290e1-61bf-4fb6-a141-ea1e689e4e14 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:34.407831 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e290e1-61bf-4fb6-a141-ea1e689e4e14 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:34.444640 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3cedfe-21cc-46ae-a221-87167b9318b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:34.445540 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3cedfe-21cc-46ae-a221-87167b9318b9 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:34.445824 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3cedfe-21cc-46ae-a221-87167b9318b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:34.446098 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3cedfe-21cc-46ae-a221-87167b9318b9 None admin] PATH_INFO: `/v3/users/9249a64b1d9f44488f63b0507f14baa4` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:34.447847 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3cedfe-21cc-46ae-a221-87167b9318b9 None admin] RBAC: Authorizing `identity:get_user(user_id=9249a64b1d9f44488f63b0507f14baa4)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:34.449305 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3cedfe-21cc-46ae-a221-87167b9318b9 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:34.451277 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 133/257] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 17 18:03:34 2022] GET /identity/v3/users/9249a64b1d9f44488f63b0507f14baa4 => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:34.451864 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3cedfe-21cc-46ae-a221-87167b9318b9 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:34.539911 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bdbb60-3148-4461-9cfe-7a63038e499e None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:34.557880 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3cedfe-21cc-46ae-a221-87167b9318b9 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:34.593914 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fbb350-daed-4e12-9e09-4a00ce5c07b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:34.594900 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbb350-daed-4e12-9e09-4a00ce5c07b2 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:34.595184 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbb350-daed-4e12-9e09-4a00ce5c07b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:34.595596 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbb350-daed-4e12-9e09-4a00ce5c07b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:34.596350 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fbb350-daed-4e12-9e09-4a00ce5c07b2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:34.596651 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fbb350-daed-4e12-9e09-4a00ce5c07b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:34.598202 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fbb350-daed-4e12-9e09-4a00ce5c07b2 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:34.607448 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 134/258] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 17 18:03:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:34.608571 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fbb350-daed-4e12-9e09-4a00ce5c07b2 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:34.626719 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6882f952-a18e-4247-9e06-8c2399194d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:34.627395 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882f952-a18e-4247-9e06-8c2399194d14 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:34.627679 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882f952-a18e-4247-9e06-8c2399194d14 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:34.627951 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882f952-a18e-4247-9e06-8c2399194d14 None admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:34.628700 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6882f952-a18e-4247-9e06-8c2399194d14 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:34.629000 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6882f952-a18e-4247-9e06-8c2399194d14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:34.630402 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6882f952-a18e-4247-9e06-8c2399194d14 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:34.648862 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 125/259] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 17 18:03:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:34.649730 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6882f952-a18e-4247-9e06-8c2399194d14 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:34.720980 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fbb350-daed-4e12-9e09-4a00ce5c07b2 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:34.758159 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e70de7-f462-4241-943f-beefc5bf7ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:34.759021 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e70de7-f462-4241-943f-beefc5bf7ce0 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:34.759299 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e70de7-f462-4241-943f-beefc5bf7ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:34.759570 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e70de7-f462-4241-943f-beefc5bf7ce0 None admin] PATH_INFO: `/v3/projects/3d967b497e5049b1bd80196bde0b33fd` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:34.760753 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e70de7-f462-4241-943f-beefc5bf7ce0 None admin] RBAC: Authorizing `identity:get_project(project_id=3d967b497e5049b1bd80196bde0b33fd)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:34.762239 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e70de7-f462-4241-943f-beefc5bf7ce0 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:34.764713 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 135/260] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 17 18:03:34 2022] GET /identity/v3/projects/3d967b497e5049b1bd80196bde0b33fd => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:34.766056 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e70de7-f462-4241-943f-beefc5bf7ce0 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:34.867206 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e70de7-f462-4241-943f-beefc5bf7ce0 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:34.899542 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6882f952-a18e-4247-9e06-8c2399194d14 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:34.900707 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b1acdd-2a8a-4f6b-9662-bb179864aba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:34.901605 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1acdd-2a8a-4f6b-9662-bb179864aba3 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:34.901881 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1acdd-2a8a-4f6b-9662-bb179864aba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:34.902150 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1acdd-2a8a-4f6b-9662-bb179864aba3 None admin] PATH_INFO: `/v3/users/f16a286989d94ca4a48696ab219e2cdc` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:34.903345 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b1acdd-2a8a-4f6b-9662-bb179864aba3 None admin] RBAC: Authorizing `identity:get_user(user_id=f16a286989d94ca4a48696ab219e2cdc)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:34.904804 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b1acdd-2a8a-4f6b-9662-bb179864aba3 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:34.906787 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 136/261] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 17 18:03:34 2022] GET /identity/v3/users/f16a286989d94ca4a48696ab219e2cdc => generated 283 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:34.907545 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b1acdd-2a8a-4f6b-9662-bb179864aba3 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:34.983485 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9127b9fd-b4b2-466b-809f-4c524aeb2307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:34.984877 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127b9fd-b4b2-466b-809f-4c524aeb2307 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:34.985150 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127b9fd-b4b2-466b-809f-4c524aeb2307 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:34.985415 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127b9fd-b4b2-466b-809f-4c524aeb2307 None admin] PATH_INFO: `/v3/users/f16a286989d94ca4a48696ab219e2cdc` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:34.989203 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9127b9fd-b4b2-466b-809f-4c524aeb2307 None admin] RBAC: Authorizing `identity:get_user(user_id=f16a286989d94ca4a48696ab219e2cdc)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:34.990746 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9127b9fd-b4b2-466b-809f-4c524aeb2307 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:34.992673 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 126/262] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 17 18:03:34 2022] GET /identity/v3/users/f16a286989d94ca4a48696ab219e2cdc => generated 283 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:34.993449 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9127b9fd-b4b2-466b-809f-4c524aeb2307 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:35.018876 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b1acdd-2a8a-4f6b-9662-bb179864aba3 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:35.051829 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95132fe-9ac3-4397-b509-4e8a3a226f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:35.052722 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95132fe-9ac3-4397-b509-4e8a3a226f37 None admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:35.053002 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95132fe-9ac3-4397-b509-4e8a3a226f37 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:35.053278 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95132fe-9ac3-4397-b509-4e8a3a226f37 None admin] PATH_INFO: `/v3/projects/3d967b497e5049b1bd80196bde0b33fd/users/9249a64b1d9f44488f63b0507f14baa4/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:35.055252 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95132fe-9ac3-4397-b509-4e8a3a226f37 None admin] RBAC: Authorizing `identity:create_grant(project_id=3d967b497e5049b1bd80196bde0b33fd, user_id=9249a64b1d9f44488f63b0507f14baa4, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:35.056702 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95132fe-9ac3-4397-b509-4e8a3a226f37 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:35.072930 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 137/263] 10.222.0.65 () {58 vars in 1439 bytes} [Tue May 17 18:03:34 2022] PUT /identity/v3/projects/3d967b497e5049b1bd80196bde0b33fd/users/9249a64b1d9f44488f63b0507f14baa4/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:03:35.074404 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95132fe-9ac3-4397-b509-4e8a3a226f37 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:35.201150 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9127b9fd-b4b2-466b-809f-4c524aeb2307 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:35.260781 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95132fe-9ac3-4397-b509-4e8a3a226f37 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:35.262435 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7038bd-8109-42fb-a895-c3b98c38d03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:35.263096 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7038bd-8109-42fb-a895-c3b98c38d03a None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:35.263372 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7038bd-8109-42fb-a895-c3b98c38d03a None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:35.263642 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7038bd-8109-42fb-a895-c3b98c38d03a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:35.333912 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3bcca4-90f4-43d4-8a2c-7f14c2985196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:35.334571 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bcca4-90f4-43d4-8a2c-7f14c2985196 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:35.334852 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bcca4-90f4-43d4-8a2c-7f14c2985196 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:35.335126 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bcca4-90f4-43d4-8a2c-7f14c2985196 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:35.341336 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7038bd-8109-42fb-a895-c3b98c38d03a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:35.343040 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7038bd-8109-42fb-a895-c3b98c38d03a None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:35.447263 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 127/264] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 17 18:03:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 18:03:35.453355 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7038bd-8109-42fb-a895-c3b98c38d03a None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:35.479577 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3bcca4-90f4-43d4-8a2c-7f14c2985196 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:35.481414 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3bcca4-90f4-43d4-8a2c-7f14c2985196 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:35.635095 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7038bd-8109-42fb-a895-c3b98c38d03a None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:35.679856 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 138/265] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 17 18:03:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 606 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 18:03:35.685046 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3bcca4-90f4-43d4-8a2c-7f14c2985196 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:35.706264 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b9b188-49b8-4d2d-a98e-c38b95d59e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:35.707426 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9b188-49b8-4d2d-a98e-c38b95d59e1b None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:35.707908 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9b188-49b8-4d2d-a98e-c38b95d59e1b None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:35.708402 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9b188-49b8-4d2d-a98e-c38b95d59e1b None admin] PATH_INFO: `/v3/projects/3d967b497e5049b1bd80196bde0b33fd` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:35.709920 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b9b188-49b8-4d2d-a98e-c38b95d59e1b None admin] RBAC: Authorizing `identity:get_project(project_id=3d967b497e5049b1bd80196bde0b33fd)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:35.711732 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b9b188-49b8-4d2d-a98e-c38b95d59e1b None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:35.718864 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 128/266] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 17 18:03:35 2022] GET /identity/v3/projects/3d967b497e5049b1bd80196bde0b33fd => generated 302 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:35.722100 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b9b188-49b8-4d2d-a98e-c38b95d59e1b None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:35.887125 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3bcca4-90f4-43d4-8a2c-7f14c2985196 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:35.917587 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b9b188-49b8-4d2d-a98e-c38b95d59e1b None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:35.950190 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c47367d-c0bf-4c85-8659-a2a5e0467887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:35.951063 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47367d-c0bf-4c85-8659-a2a5e0467887 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:35.951340 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47367d-c0bf-4c85-8659-a2a5e0467887 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:35.951613 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47367d-c0bf-4c85-8659-a2a5e0467887 None admin] PATH_INFO: `/v3/projects/3d967b497e5049b1bd80196bde0b33fd` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:35.953443 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c47367d-c0bf-4c85-8659-a2a5e0467887 None admin] RBAC: Authorizing `identity:get_project(project_id=3d967b497e5049b1bd80196bde0b33fd)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:35.954135 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba3e671-494e-446f-bbf5-d20d5e2a9a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:35.954909 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c47367d-c0bf-4c85-8659-a2a5e0467887 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:35.955226 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3e671-494e-446f-bbf5-d20d5e2a9a45 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:35.955699 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3e671-494e-446f-bbf5-d20d5e2a9a45 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:35.956169 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3e671-494e-446f-bbf5-d20d5e2a9a45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:35.956969 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 139/267] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 17 18:03:35 2022] GET /identity/v3/projects/3d967b497e5049b1bd80196bde0b33fd => generated 302 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:35.957622 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba3e671-494e-446f-bbf5-d20d5e2a9a45 None admin] RBAC: Adding query filter params (role.id=332c8d70fd0f41e2beea20aaead5daa5, scope.project.id=3d967b497e5049b1bd80196bde0b33fd, user.id=f16a286989d94ca4a48696ab219e2cdc) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:35.958151 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba3e671-494e-446f-bbf5-d20d5e2a9a45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:35.959778 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba3e671-494e-446f-bbf5-d20d5e2a9a45 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:35.962262 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c47367d-c0bf-4c85-8659-a2a5e0467887 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:35.966943 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 129/268] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 17 18:03:35 2022] GET /identity/v3/role_assignments?user.id=f16a286989d94ca4a48696ab219e2cdc&scope.project.id=3d967b497e5049b1bd80196bde0b33fd&role.id=332c8d70fd0f41e2beea20aaead5daa5 => generated 608 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:36.079529 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc502c-f680-4ece-b0ba-76b21c2324b7 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:36.080184 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc502c-f680-4ece-b0ba-76b21c2324b7 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:36.080660 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc502c-f680-4ece-b0ba-76b21c2324b7 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:36.082807 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 130/269] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:03:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 18:03:36.089696 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4993e-b670-4514-ac4d-2fe094be807e None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:36.090471 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4993e-b670-4514-ac4d-2fe094be807e None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:36.090971 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4993e-b670-4514-ac4d-2fe094be807e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:36.129488 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c47367d-c0bf-4c85-8659-a2a5e0467887 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:36.129687 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-f4d4993e-b670-4514-ac4d-2fe094be807e None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:03:36.129687 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-f4d4993e-b670-4514-ac4d-2fe094be807e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:03:36.170923 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34c878e-01a4-4a4b-bf17-da184c838d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:36.171823 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c878e-01a4-4a4b-bf17-da184c838d5b None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:36.172101 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c878e-01a4-4a4b-bf17-da184c838d5b None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:36.172370 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c878e-01a4-4a4b-bf17-da184c838d5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:36.173208 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34c878e-01a4-4a4b-bf17-da184c838d5b None admin] RBAC: Adding query filter params (role.id=c3b3265cd6364fbcb22a731040b7b47a, scope.project.id=3d967b497e5049b1bd80196bde0b33fd, user.id=f16a286989d94ca4a48696ab219e2cdc) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:36.173534 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34c878e-01a4-4a4b-bf17-da184c838d5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:36.174992 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34c878e-01a4-4a4b-bf17-da184c838d5b None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:36.185430 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 140/270] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 17 18:03:35 2022] GET /identity/v3/role_assignments?user.id=f16a286989d94ca4a48696ab219e2cdc&scope.project.id=3d967b497e5049b1bd80196bde0b33fd&role.id=c3b3265cd6364fbcb22a731040b7b47a => generated 608 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:03:36.244108 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 131/271] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:03:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 18:03:36.283961 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34c878e-01a4-4a4b-bf17-da184c838d5b None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:36.394798 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34c878e-01a4-4a4b-bf17-da184c838d5b None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:36.432945 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb97201-708b-4094-85b5-58e6196659a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:36.433788 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb97201-708b-4094-85b5-58e6196659a3 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:36.434067 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb97201-708b-4094-85b5-58e6196659a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:36.434342 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb97201-708b-4094-85b5-58e6196659a3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:36.450999 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb97201-708b-4094-85b5-58e6196659a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:03:36.458792 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-0bb97201-708b-4094-85b5-58e6196659a3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 18:03:36.458792 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:03:36.458792 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:03:36.458792 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:03:36.458792 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:03:36.458792 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:03:36.458792 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:03:36.458792 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:03:36.458792 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:03:36.458792 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:03:36.458792 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:03:36.458792 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:03:36.458792 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:03:36.458792 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:03:36.458792 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:03:36.458792 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:03:36.459663 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:03:36.459663 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:03:36.459663 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:03:36.459663 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:03:36.459663 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:03:36.459663 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:03:36.459663 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:03:36.459663 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:03:36.459663 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:03:36.459663 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:03:36.459663 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:03:36.459663 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:03:36.459663 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:03:36.459663 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:03:36.459663 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:03:36.459663 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:03:36.460878 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:03:36.460878 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:03:36.460878 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:03:36.460878 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:03:36.460878 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:03:36.460878 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:03:36.460878 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:03:36.460878 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:03:36.460878 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:03:36.460878 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:03:36.460878 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 18:03:36.460878 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:03:36.460878 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 141/272] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 17 18:03:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:03:36.467834 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4993e-b670-4514-ac4d-2fe094be807e None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:36.570460 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de39786-256a-4d56-821c-f3e18f3ac00a None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:36.570760 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de39786-256a-4d56-821c-f3e18f3ac00a None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:36.570940 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de39786-256a-4d56-821c-f3e18f3ac00a None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:36.572483 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 142/273] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:03:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 18:03:36.578218 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81873f70-2c3c-4c16-8bba-2fac1b6ac467 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:36.578506 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81873f70-2c3c-4c16-8bba-2fac1b6ac467 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:36.578773 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81873f70-2c3c-4c16-8bba-2fac1b6ac467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:36.603104 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-81873f70-2c3c-4c16-8bba-2fac1b6ac467 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:03:36.604288 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-81873f70-2c3c-4c16-8bba-2fac1b6ac467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:03:36.607152 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4993e-b670-4514-ac4d-2fe094be807e None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:36.642438 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219f7be1-9a2a-4508-bcd7-e5ffddc35841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:36.643084 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f7be1-9a2a-4508-bcd7-e5ffddc35841 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:36.643369 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f7be1-9a2a-4508-bcd7-e5ffddc35841 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:36.643641 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f7be1-9a2a-4508-bcd7-e5ffddc35841 None admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:36.644447 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219f7be1-9a2a-4508-bcd7-e5ffddc35841 None admin] RBAC: Adding query filter params (name=member) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:36.644752 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219f7be1-9a2a-4508-bcd7-e5ffddc35841 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:36.646322 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219f7be1-9a2a-4508-bcd7-e5ffddc35841 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:36.656217 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 132/274] 10.222.0.65 () {56 vars in 1101 bytes} [Tue May 17 18:03:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:36.662239 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219f7be1-9a2a-4508-bcd7-e5ffddc35841 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:36.682160 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 143/275] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:03:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 18:03:36.709334 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81873f70-2c3c-4c16-8bba-2fac1b6ac467 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:36.788494 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219f7be1-9a2a-4508-bcd7-e5ffddc35841 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:36.818332 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81873f70-2c3c-4c16-8bba-2fac1b6ac467 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:36.831733 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85126919-6c98-404b-a350-4b7bd8c5d51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:36.832590 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85126919-6c98-404b-a350-4b7bd8c5d51b None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:36.833021 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85126919-6c98-404b-a350-4b7bd8c5d51b None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:36.833296 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85126919-6c98-404b-a350-4b7bd8c5d51b None admin] PATH_INFO: `/v3/users/536ac234b5b149e4b748abebaca8076f` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:36.851154 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85126919-6c98-404b-a350-4b7bd8c5d51b None admin] RBAC: Authorizing `identity:get_user(user_id=536ac234b5b149e4b748abebaca8076f)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:36.852941 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85126919-6c98-404b-a350-4b7bd8c5d51b None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:36.855137 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 133/276] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 17 18:03:36 2022] GET /identity/v3/users/536ac234b5b149e4b748abebaca8076f => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:03:36.860759 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23b535e-53b9-427d-8704-f87e8905edd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:36.860925 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85126919-6c98-404b-a350-4b7bd8c5d51b None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:36.861786 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b535e-53b9-427d-8704-f87e8905edd2 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:36.862158 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b535e-53b9-427d-8704-f87e8905edd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:36.862669 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b535e-53b9-427d-8704-f87e8905edd2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:36.864726 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23b535e-53b9-427d-8704-f87e8905edd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:36.866289 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23b535e-53b9-427d-8704-f87e8905edd2 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:36.868268 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 144/277] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:03:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:36.873601 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23b535e-53b9-427d-8704-f87e8905edd2 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:36.967229 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85126919-6c98-404b-a350-4b7bd8c5d51b None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:36.971019 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23b535e-53b9-427d-8704-f87e8905edd2 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:37.002786 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5c7e91-a5f2-488d-bcfe-afb063cbb4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:37.003674 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c7e91-a5f2-488d-bcfe-afb063cbb4e0 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:37.004093 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c7e91-a5f2-488d-bcfe-afb063cbb4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:37.004504 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c7e91-a5f2-488d-bcfe-afb063cbb4e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:37.005551 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5c7e91-a5f2-488d-bcfe-afb063cbb4e0 None admin] RBAC: Adding query filter params (role.id=2af599fd3ad74031901ea2d9e0408884, user.id=536ac234b5b149e4b748abebaca8076f, scope.system=all) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:37.005665 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061543f1-6f94-4711-bb41-e35d684e314b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:37.006125 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5c7e91-a5f2-488d-bcfe-afb063cbb4e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:37.006310 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061543f1-6f94-4711-bb41-e35d684e314b None admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:37.006615 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061543f1-6f94-4711-bb41-e35d684e314b None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:37.006888 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061543f1-6f94-4711-bb41-e35d684e314b None admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:37.007593 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061543f1-6f94-4711-bb41-e35d684e314b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:37.008318 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5c7e91-a5f2-488d-bcfe-afb063cbb4e0 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:37.009006 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061543f1-6f94-4711-bb41-e35d684e314b None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:37.013884 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 134/278] 10.222.0.65 () {56 vars in 1308 bytes} [Tue May 17 18:03:36 2022] GET /identity/v3/role_assignments?user.id=536ac234b5b149e4b748abebaca8076f&scope.system=all&role.id=2af599fd3ad74031901ea2d9e0408884 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:37.016662 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744bd59e-5747-4dc7-aa3a-46cf3fc2dde9 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:37.017671 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744bd59e-5747-4dc7-aa3a-46cf3fc2dde9 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:37.018083 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744bd59e-5747-4dc7-aa3a-46cf3fc2dde9 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:37.020944 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 135/279] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:03:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:03:37.027959 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc96476-5fd5-41eb-a04c-47af42ae815f None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:37.028554 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc96476-5fd5-41eb-a04c-47af42ae815f None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:37.028968 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc96476-5fd5-41eb-a04c-47af42ae815f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:37.041491 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 145/280] 10.222.0.65 () {60 vars in 1132 bytes} [Tue May 17 18:03:36 2022] POST /identity/v3/users => generated 293 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:03:37.066290 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-1dc96476-5fd5-41eb-a04c-47af42ae815f None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:03:37.067893 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-1dc96476-5fd5-41eb-a04c-47af42ae815f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:03:37.146045 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 136/281] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:03:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:03:37.169149 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061543f1-6f94-4711-bb41-e35d684e314b None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:37.279303 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061543f1-6f94-4711-bb41-e35d684e314b None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:37.314616 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d65ab6f-fe14-4104-ab51-bc4fc92f0ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:37.315382 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65ab6f-fe14-4104-ab51-bc4fc92f0ec8 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:37.315663 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65ab6f-fe14-4104-ab51-bc4fc92f0ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:37.315938 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d65ab6f-fe14-4104-ab51-bc4fc92f0ec8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:37.326364 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d65ab6f-fe14-4104-ab51-bc4fc92f0ec8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:03:37.334617 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-2d65ab6f-fe14-4104-ab51-bc4fc92f0ec8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 17 18:03:37.334617 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:03:37.334617 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:03:37.334617 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:03:37.334617 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:03:37.334617 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:03:37.334617 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:03:37.334617 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:03:37.334617 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:03:37.334617 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:03:37.334617 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:03:37.334617 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:03:37.334617 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:03:37.334617 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:03:37.334617 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:03:37.334617 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:03:37.335531 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:03:37.335531 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:03:37.335531 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:03:37.335531 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:03:37.335531 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:03:37.335531 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:03:37.335531 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:03:37.335531 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:03:37.335531 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:03:37.335531 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:03:37.335531 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:03:37.335531 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:03:37.335531 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:03:37.335531 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:03:37.335531 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:03:37.335531 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:03:37.336308 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:03:37.336308 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:03:37.336308 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:03:37.336308 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:03:37.336308 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:03:37.336308 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:03:37.336308 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:03:37.336308 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:03:37.336308 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:03:37.336308 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:03:37.336308 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 17 18:03:37.336308 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:03:37.336308 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 146/282] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 17 18:03:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:03:37.341657 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc96476-5fd5-41eb-a04c-47af42ae815f None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:37.461481 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc96476-5fd5-41eb-a04c-47af42ae815f None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:37.506712 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d2c0b-c358-4a3f-a9ed-9450d3941c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:37.507718 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d2c0b-c358-4a3f-a9ed-9450d3941c3a None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:37.508213 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d2c0b-c358-4a3f-a9ed-9450d3941c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:37.508676 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d2c0b-c358-4a3f-a9ed-9450d3941c3a None admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:37.510128 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781d2c0b-c358-4a3f-a9ed-9450d3941c3a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:37.510628 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781d2c0b-c358-4a3f-a9ed-9450d3941c3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:37.512206 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781d2c0b-c358-4a3f-a9ed-9450d3941c3a None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:37.521755 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 137/283] 10.222.0.65 () {56 vars in 1101 bytes} [Tue May 17 18:03:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:37.531503 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d65ab6f-fe14-4104-ab51-bc4fc92f0ec8 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:37.654098 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d65ab6f-fe14-4104-ab51-bc4fc92f0ec8 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:37.697847 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f03bb-38e7-41e4-a29e-ea826dd6e2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:37.698753 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f03bb-38e7-41e4-a29e-ea826dd6e2bb None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:37.699031 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f03bb-38e7-41e4-a29e-ea826dd6e2bb None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:37.699305 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f03bb-38e7-41e4-a29e-ea826dd6e2bb None admin] PATH_INFO: `/v3/users/36030fb8ad0f49d1b8330027b860bfc6` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:37.706531 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040f03bb-38e7-41e4-a29e-ea826dd6e2bb None admin] RBAC: Authorizing `identity:get_user(user_id=36030fb8ad0f49d1b8330027b860bfc6)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:37.708070 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040f03bb-38e7-41e4-a29e-ea826dd6e2bb None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:37.710254 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 147/284] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 17 18:03:37 2022] GET /identity/v3/users/36030fb8ad0f49d1b8330027b860bfc6 => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:37.716110 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d2c0b-c358-4a3f-a9ed-9450d3941c3a None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:37.883046 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d2c0b-c358-4a3f-a9ed-9450d3941c3a None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:37.913703 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195a106-21a0-4c89-a7aa-d04492a3ac47 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:37.914003 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195a106-21a0-4c89-a7aa-d04492a3ac47 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:37.914264 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195a106-21a0-4c89-a7aa-d04492a3ac47 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:37.916041 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 148/285] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:03:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 18:03:37.923368 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0e903-846f-4fa1-80cc-3f6a7b90b89a None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:37.924820 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0e903-846f-4fa1-80cc-3f6a7b90b89a None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:37.925645 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0e903-846f-4fa1-80cc-3f6a7b90b89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:37.928294 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b63ea4-2b8a-48fb-baeb-8d6dc12e1dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:37.929361 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b63ea4-2b8a-48fb-baeb-8d6dc12e1dae None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:37.930272 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b63ea4-2b8a-48fb-baeb-8d6dc12e1dae None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:37.931230 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b63ea4-2b8a-48fb-baeb-8d6dc12e1dae None admin] PATH_INFO: `/v3/projects/3d967b497e5049b1bd80196bde0b33fd` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:37.933668 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b63ea4-2b8a-48fb-baeb-8d6dc12e1dae None admin] RBAC: Authorizing `identity:get_project(project_id=3d967b497e5049b1bd80196bde0b33fd)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:37.936907 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b63ea4-2b8a-48fb-baeb-8d6dc12e1dae None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:37.945411 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 138/286] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 17 18:03:37 2022] GET /identity/v3/projects/3d967b497e5049b1bd80196bde0b33fd => generated 302 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:37.946573 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b63ea4-2b8a-48fb-baeb-8d6dc12e1dae None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:37.965153 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-a4f0e903-846f-4fa1-80cc-3f6a7b90b89a None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:03:37.966747 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-a4f0e903-846f-4fa1-80cc-3f6a7b90b89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:03:38.067752 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 149/287] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:03:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:03:38.102787 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0e903-846f-4fa1-80cc-3f6a7b90b89a None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:38.137405 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b63ea4-2b8a-48fb-baeb-8d6dc12e1dae None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:38.223596 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb9a76-8145-4f6d-b6b6-67fbcde02f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:38.224406 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb9a76-8145-4f6d-b6b6-67fbcde02f84 None admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:38.224684 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb9a76-8145-4f6d-b6b6-67fbcde02f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:38.224958 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb9a76-8145-4f6d-b6b6-67fbcde02f84 None admin] PATH_INFO: `/v3/projects/3d967b497e5049b1bd80196bde0b33fd/users/36030fb8ad0f49d1b8330027b860bfc6/roles/6f39f2f8bcc04c11b768de7f0c994fd7` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:38.226615 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0e903-846f-4fa1-80cc-3f6a7b90b89a None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:38.231079 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb9a76-8145-4f6d-b6b6-67fbcde02f84 None admin] RBAC: Authorizing `identity:create_grant(project_id=3d967b497e5049b1bd80196bde0b33fd, user_id=36030fb8ad0f49d1b8330027b860bfc6, role_id=6f39f2f8bcc04c11b768de7f0c994fd7)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:38.232565 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb9a76-8145-4f6d-b6b6-67fbcde02f84 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:38.266444 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 139/288] 10.222.0.65 () {58 vars in 1439 bytes} [Tue May 17 18:03:37 2022] PUT /identity/v3/projects/3d967b497e5049b1bd80196bde0b33fd/users/36030fb8ad0f49d1b8330027b860bfc6/roles/6f39f2f8bcc04c11b768de7f0c994fd7 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:03:38.267129 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd4fd1-d43a-4f7d-b036-098259b2e745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:38.267972 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd4fd1-d43a-4f7d-b036-098259b2e745 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:38.268254 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd4fd1-d43a-4f7d-b036-098259b2e745 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:38.268528 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd4fd1-d43a-4f7d-b036-098259b2e745 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:38.299537 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fd4fd1-d43a-4f7d-b036-098259b2e745 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:03:38.307598 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-c4fd4fd1-d43a-4f7d-b036-098259b2e745 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 18:03:38.307598 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:03:38.307598 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:03:38.307598 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:03:38.307598 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:03:38.307598 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:03:38.307598 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:03:38.307598 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:03:38.307598 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:03:38.307598 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:03:38.307598 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:03:38.307598 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:03:38.307598 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:03:38.307598 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:03:38.307598 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:03:38.307598 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:03:38.308565 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:03:38.308565 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:03:38.308565 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:03:38.308565 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:03:38.308565 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:03:38.308565 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:03:38.308565 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:03:38.308565 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:03:38.308565 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:03:38.308565 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:03:38.308565 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:03:38.308565 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:03:38.308565 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:03:38.308565 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:03:38.308565 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:03:38.308565 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:03:38.309436 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:03:38.309436 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:03:38.309436 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:03:38.309436 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:03:38.309436 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:03:38.309436 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:03:38.309436 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:03:38.309436 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:03:38.309436 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:03:38.309436 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:03:38.309436 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 18:03:38.309436 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:03:38.309436 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 150/289] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 17 18:03:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:03:38.315478 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb9a76-8145-4f6d-b6b6-67fbcde02f84 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:38.440958 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb9a76-8145-4f6d-b6b6-67fbcde02f84 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:38.483203 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d99999-11c8-4b34-abb5-914334c57607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:38.484328 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d99999-11c8-4b34-abb5-914334c57607 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:38.484609 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d99999-11c8-4b34-abb5-914334c57607 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:38.484880 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d99999-11c8-4b34-abb5-914334c57607 None admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:38.485651 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d99999-11c8-4b34-abb5-914334c57607 None admin] RBAC: Adding query filter params (name=member) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:38.485957 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d99999-11c8-4b34-abb5-914334c57607 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:38.487322 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d99999-11c8-4b34-abb5-914334c57607 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:38.496973 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 140/290] 10.222.0.65 () {56 vars in 1101 bytes} [Tue May 17 18:03:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:38.502992 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd4fd1-d43a-4f7d-b036-098259b2e745 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:38.603713 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd4fd1-d43a-4f7d-b036-098259b2e745 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:38.641556 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a8f5d-ba28-4200-8eac-057e3c83f1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:38.642701 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a8f5d-ba28-4200-8eac-057e3c83f1eb None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:38.643126 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a8f5d-ba28-4200-8eac-057e3c83f1eb None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:38.643565 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a8f5d-ba28-4200-8eac-057e3c83f1eb None admin] PATH_INFO: `/v3/users/9249a64b1d9f44488f63b0507f14baa4` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:38.650483 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456a8f5d-ba28-4200-8eac-057e3c83f1eb None admin] RBAC: Authorizing `identity:get_user(user_id=9249a64b1d9f44488f63b0507f14baa4)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:38.652230 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456a8f5d-ba28-4200-8eac-057e3c83f1eb None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:38.654180 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 151/291] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 17 18:03:38 2022] GET /identity/v3/users/9249a64b1d9f44488f63b0507f14baa4 => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:38.659922 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d99999-11c8-4b34-abb5-914334c57607 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:38.763194 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d99999-11c8-4b34-abb5-914334c57607 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:38.804916 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6e4f5-aa14-4b4a-a5ad-ca74a7fd2df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:38.805835 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6e4f5-aa14-4b4a-a5ad-ca74a7fd2df0 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:38.806260 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6e4f5-aa14-4b4a-a5ad-ca74a7fd2df0 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:38.806691 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6e4f5-aa14-4b4a-a5ad-ca74a7fd2df0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:38.895119 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed6e4f5-aa14-4b4a-a5ad-ca74a7fd2df0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:38.896589 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed6e4f5-aa14-4b4a-a5ad-ca74a7fd2df0 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:38.993340 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 141/292] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 17 18:03:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 18:03:39.002527 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a8f5d-ba28-4200-8eac-057e3c83f1eb None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:39.105120 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a8f5d-ba28-4200-8eac-057e3c83f1eb None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:39.144863 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec1f39-eb38-49e6-a42d-a1928c4a2e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:39.145737 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec1f39-eb38-49e6-a42d-a1928c4a2e42 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:39.146017 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec1f39-eb38-49e6-a42d-a1928c4a2e42 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:39.146286 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec1f39-eb38-49e6-a42d-a1928c4a2e42 None admin] PATH_INFO: `/v3/projects/3d967b497e5049b1bd80196bde0b33fd` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:39.147475 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fec1f39-eb38-49e6-a42d-a1928c4a2e42 None admin] RBAC: Authorizing `identity:get_project(project_id=3d967b497e5049b1bd80196bde0b33fd)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:39.148922 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fec1f39-eb38-49e6-a42d-a1928c4a2e42 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:39.150932 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 152/293] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 17 18:03:39 2022] GET /identity/v3/projects/3d967b497e5049b1bd80196bde0b33fd => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:39.156636 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6e4f5-aa14-4b4a-a5ad-ca74a7fd2df0 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:39.262424 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6e4f5-aa14-4b4a-a5ad-ca74a7fd2df0 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:39.297097 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6afc0b7-6ecf-497b-9f53-f9a6dd6fc65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:39.297771 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6afc0b7-6ecf-497b-9f53-f9a6dd6fc65d None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:39.298049 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6afc0b7-6ecf-497b-9f53-f9a6dd6fc65d None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:39.298316 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6afc0b7-6ecf-497b-9f53-f9a6dd6fc65d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:39.299148 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6afc0b7-6ecf-497b-9f53-f9a6dd6fc65d None admin] RBAC: Adding query filter params (role.id=2af599fd3ad74031901ea2d9e0408884, scope.project.id=3d967b497e5049b1bd80196bde0b33fd, user.id=9249a64b1d9f44488f63b0507f14baa4) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:39.299454 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6afc0b7-6ecf-497b-9f53-f9a6dd6fc65d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:39.300892 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6afc0b7-6ecf-497b-9f53-f9a6dd6fc65d None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:39.307038 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 142/294] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 17 18:03:39 2022] GET /identity/v3/role_assignments?user.id=9249a64b1d9f44488f63b0507f14baa4&scope.project.id=3d967b497e5049b1bd80196bde0b33fd&role.id=2af599fd3ad74031901ea2d9e0408884 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:39.790157 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5125cd8-a34e-4268-b8b7-ed334aa59d65 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:39.790665 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5125cd8-a34e-4268-b8b7-ed334aa59d65 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:39.790770 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5125cd8-a34e-4268-b8b7-ed334aa59d65 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:39.792275 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 153/295] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:03:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:03:39.797684 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3bcdb-3174-4088-bbd2-42e30a43cf88 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:39.798095 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3bcdb-3174-4088-bbd2-42e30a43cf88 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:39.798289 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3bcdb-3174-4088-bbd2-42e30a43cf88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:39.818072 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-c2c3bcdb-3174-4088-bbd2-42e30a43cf88 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:03:39.819250 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-c2c3bcdb-3174-4088-bbd2-42e30a43cf88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:03:39.905551 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 143/296] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:03:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:03:39.927708 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5125cd8-a34e-4268-b8b7-ed334aa59d65 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:40.029807 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5125cd8-a34e-4268-b8b7-ed334aa59d65 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:40.057887 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f75c8b8-ff31-4525-bdac-e0e34886a574 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:40.058467 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f75c8b8-ff31-4525-bdac-e0e34886a574 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:40.058943 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f75c8b8-ff31-4525-bdac-e0e34886a574 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:40.060597 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 144/297] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:03:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:03:40.064203 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f330548f-9ea8-4ea4-a138-d2537784b787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:40.064923 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f330548f-9ea8-4ea4-a138-d2537784b787 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:40.065255 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f330548f-9ea8-4ea4-a138-d2537784b787 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:40.065559 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f330548f-9ea8-4ea4-a138-d2537784b787 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:40.067507 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279476a5-7e2f-423a-a29f-dfab4cc1a9ac None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:40.068012 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279476a5-7e2f-423a-a29f-dfab4cc1a9ac None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:40.068481 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279476a5-7e2f-423a-a29f-dfab4cc1a9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:40.076093 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f330548f-9ea8-4ea4-a138-d2537784b787 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:03:40.083875 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-f330548f-9ea8-4ea4-a138-d2537784b787 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 18:03:40.083875 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:03:40.083875 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:03:40.083875 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:03:40.083875 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:03:40.083875 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:03:40.083875 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:03:40.083875 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:03:40.083875 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:03:40.083875 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:03:40.083875 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:03:40.083875 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:03:40.083875 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:03:40.083875 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:03:40.083875 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:03:40.083875 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:03:40.084793 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:03:40.084793 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:03:40.084793 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:03:40.084793 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:03:40.084793 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:03:40.084793 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:03:40.084793 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:03:40.084793 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:03:40.084793 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:03:40.084793 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:03:40.084793 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:03:40.084793 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:03:40.084793 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:03:40.084793 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:03:40.084793 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:03:40.084793 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:03:40.085618 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:03:40.085618 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:03:40.085618 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:03:40.085618 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:03:40.085618 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:03:40.085618 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:03:40.085618 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:03:40.085618 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:03:40.085618 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:03:40.085618 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:03:40.085618 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 18:03:40.085618 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:03:40.085618 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 154/298] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 17 18:03:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:03:40.086310 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1c962-9c68-4adf-94f0-fb2765137da6 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:40.086376 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-279476a5-7e2f-423a-a29f-dfab4cc1a9ac None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:03:40.087192 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1c962-9c68-4adf-94f0-fb2765137da6 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:40.087192 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1c962-9c68-4adf-94f0-fb2765137da6 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:40.088317 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 155/299] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:03:40.088733 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-279476a5-7e2f-423a-a29f-dfab4cc1a9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:03:40.094097 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a1c962-9c68-4adf-94f0-fb2765137da6 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:40.157732 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 145/300] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:03:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 18:03:40.162868 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b492d6-ffeb-4482-bfc3-781845145d99 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:40.163393 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b492d6-ffeb-4482-bfc3-781845145d99 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:40.163886 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b492d6-ffeb-4482-bfc3-781845145d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:40.184526 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-b7b492d6-ffeb-4482-bfc3-781845145d99 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:03:40.185738 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-b7b492d6-ffeb-4482-bfc3-781845145d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:03:40.195961 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a1c962-9c68-4adf-94f0-fb2765137da6 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:40.227768 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f0fe8-8382-443e-a91b-53b534deb60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:40.228449 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f0fe8-8382-443e-a91b-53b534deb60d None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:40.228696 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f0fe8-8382-443e-a91b-53b534deb60d None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:40.228970 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f0fe8-8382-443e-a91b-53b534deb60d None admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:40.229718 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f0fe8-8382-443e-a91b-53b534deb60d None admin] RBAC: Adding query filter params (name=member) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:40.230166 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f0fe8-8382-443e-a91b-53b534deb60d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:40.231695 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f0fe8-8382-443e-a91b-53b534deb60d None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:40.241925 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 156/301] 10.222.0.65 () {56 vars in 1101 bytes} [Tue May 17 18:03:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:40.242893 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f0fe8-8382-443e-a91b-53b534deb60d None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:40.263866 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 146/302] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:03:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:03:40.264939 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b492d6-ffeb-4482-bfc3-781845145d99 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:40.349823 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f0fe8-8382-443e-a91b-53b534deb60d None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:40.364912 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b492d6-ffeb-4482-bfc3-781845145d99 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:40.382809 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba8bcd-f586-48de-82ed-c6c3f21b1774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:40.383598 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba8bcd-f586-48de-82ed-c6c3f21b1774 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:40.383876 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba8bcd-f586-48de-82ed-c6c3f21b1774 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:40.384163 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba8bcd-f586-48de-82ed-c6c3f21b1774 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:40.393910 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caba8bcd-f586-48de-82ed-c6c3f21b1774 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:03:40.398059 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3c2961-8aa2-4d0b-b5b9-457898dec2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:40.398923 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c2961-8aa2-4d0b-b5b9-457898dec2b4 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:40.399202 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c2961-8aa2-4d0b-b5b9-457898dec2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:40.399475 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c2961-8aa2-4d0b-b5b9-457898dec2b4 None admin] PATH_INFO: `/v3/users/536ac234b5b149e4b748abebaca8076f` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:40.400665 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3c2961-8aa2-4d0b-b5b9-457898dec2b4 None admin] RBAC: Authorizing `identity:get_user(user_id=536ac234b5b149e4b748abebaca8076f)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:40.401997 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-caba8bcd-f586-48de-82ed-c6c3f21b1774 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 17 18:03:40.401997 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:03:40.401997 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:03:40.401997 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:03:40.401997 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:03:40.401997 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:03:40.401997 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:03:40.401997 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:03:40.401997 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:03:40.401997 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:03:40.401997 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:03:40.401997 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:03:40.401997 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:03:40.401997 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:03:40.401997 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:03:40.401997 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:03:40.402850 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:03:40.402850 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:03:40.402850 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:03:40.402850 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:03:40.402850 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:03:40.402850 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:03:40.402850 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:03:40.402850 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:03:40.402850 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:03:40.402850 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:03:40.402850 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:03:40.402850 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:03:40.402850 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:03:40.402850 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:03:40.402850 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:03:40.402850 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:03:40.409187 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:03:40.409187 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:03:40.409187 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:03:40.409187 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:03:40.409187 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:03:40.409187 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:03:40.409187 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:03:40.409187 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:03:40.409187 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:03:40.409187 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:03:40.409187 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 17 18:03:40.409187 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:03:40.409978 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3c2961-8aa2-4d0b-b5b9-457898dec2b4 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:40.410053 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 157/303] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 17 18:03:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:03:40.410053 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba8bcd-f586-48de-82ed-c6c3f21b1774 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:40.410170 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 147/304] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 17 18:03:40 2022] GET /identity/v3/users/536ac234b5b149e4b748abebaca8076f => generated 293 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:40.410170 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3c2961-8aa2-4d0b-b5b9-457898dec2b4 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:40.507330 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3c2961-8aa2-4d0b-b5b9-457898dec2b4 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:40.522331 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba8bcd-f586-48de-82ed-c6c3f21b1774 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:40.539873 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e9f90-29ef-4ee6-9c3d-0e89b02bc9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:40.540529 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e9f90-29ef-4ee6-9c3d-0e89b02bc9f5 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:40.540801 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e9f90-29ef-4ee6-9c3d-0e89b02bc9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:40.541066 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e9f90-29ef-4ee6-9c3d-0e89b02bc9f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:40.541838 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6e9f90-29ef-4ee6-9c3d-0e89b02bc9f5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:40.542135 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6e9f90-29ef-4ee6-9c3d-0e89b02bc9f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:40.543491 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6e9f90-29ef-4ee6-9c3d-0e89b02bc9f5 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:40.556459 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 148/305] 10.222.0.65 () {56 vars in 1101 bytes} [Tue May 17 18:03:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:40.556459 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e9f90-29ef-4ee6-9c3d-0e89b02bc9f5 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:40.560626 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e75f55-5540-48c9-8444-5a082609467a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:40.561420 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e75f55-5540-48c9-8444-5a082609467a None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:40.561758 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e75f55-5540-48c9-8444-5a082609467a None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:40.562043 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e75f55-5540-48c9-8444-5a082609467a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:40.563205 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e75f55-5540-48c9-8444-5a082609467a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:40.564638 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e75f55-5540-48c9-8444-5a082609467a None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:40.566269 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 158/306] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:03:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:40.567010 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e75f55-5540-48c9-8444-5a082609467a None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:40.652161 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e9f90-29ef-4ee6-9c3d-0e89b02bc9f5 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:40.666409 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e75f55-5540-48c9-8444-5a082609467a None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:40.687653 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6112c-f521-44e8-a0e0-0842eaabad5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:40.688506 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6112c-f521-44e8-a0e0-0842eaabad5d None admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:40.688788 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6112c-f521-44e8-a0e0-0842eaabad5d None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:40.689064 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6112c-f521-44e8-a0e0-0842eaabad5d None admin] PATH_INFO: `/v3/system/users/536ac234b5b149e4b748abebaca8076f/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:40.690596 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c6112c-f521-44e8-a0e0-0842eaabad5d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=536ac234b5b149e4b748abebaca8076f, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:40.691990 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c6112c-f521-44e8-a0e0-0842eaabad5d None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:40.701829 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457a316-5dfd-4ace-b121-0c50b98a2b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:40.703556 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457a316-5dfd-4ace-b121-0c50b98a2b7b None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:40.703671 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 149/307] 10.222.0.65 () {58 vars in 1334 bytes} [Tue May 17 18:03:40 2022] PUT /identity/v3/system/users/536ac234b5b149e4b748abebaca8076f/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:03:40.709510 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6112c-f521-44e8-a0e0-0842eaabad5d None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:40.714005 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457a316-5dfd-4ace-b121-0c50b98a2b7b None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:40.714441 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457a316-5dfd-4ace-b121-0c50b98a2b7b None admin] PATH_INFO: `/v3/users/b66aac32094747cf865792d7b98cb6dd` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:40.743111 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a457a316-5dfd-4ace-b121-0c50b98a2b7b None admin] RBAC: Authorizing `identity:get_user(user_id=b66aac32094747cf865792d7b98cb6dd)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:40.744607 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a457a316-5dfd-4ace-b121-0c50b98a2b7b None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:40.751134 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 159/308] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 17 18:03:40 2022] GET /identity/v3/users/b66aac32094747cf865792d7b98cb6dd => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:40.753383 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457a316-5dfd-4ace-b121-0c50b98a2b7b None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:40.835229 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6112c-f521-44e8-a0e0-0842eaabad5d None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:40.871178 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c93c7c0-72e0-4e1f-afac-9cfbe35581fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:40.871855 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93c7c0-72e0-4e1f-afac-9cfbe35581fd None admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:40.872294 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93c7c0-72e0-4e1f-afac-9cfbe35581fd None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:40.872568 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93c7c0-72e0-4e1f-afac-9cfbe35581fd None admin] PATH_INFO: `/v3/groups` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:40.873278 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c93c7c0-72e0-4e1f-afac-9cfbe35581fd None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:40.874805 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c93c7c0-72e0-4e1f-afac-9cfbe35581fd None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:40.886093 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457a316-5dfd-4ace-b121-0c50b98a2b7b None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:40.901866 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 150/309] 10.222.0.65 () {60 vars in 1134 bytes} [Tue May 17 18:03:40 2022] POST /identity/v3/groups => generated 229 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:03:40.906971 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff2f95-1207-447c-a721-d3d51bd0fea1 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:40.907170 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff2f95-1207-447c-a721-d3d51bd0fea1 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:40.907451 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff2f95-1207-447c-a721-d3d51bd0fea1 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:40.909244 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 151/310] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:03:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 18:03:40.915036 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0d336-4d33-4f24-9259-940153114d0e None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:40.916176 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0d336-4d33-4f24-9259-940153114d0e None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:40.916662 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0d336-4d33-4f24-9259-940153114d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:40.929874 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53aeb89-2220-4567-bf5a-52e71bc8559a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:40.930555 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53aeb89-2220-4567-bf5a-52e71bc8559a None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:40.930834 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53aeb89-2220-4567-bf5a-52e71bc8559a None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:40.931110 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53aeb89-2220-4567-bf5a-52e71bc8559a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:40.932124 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53aeb89-2220-4567-bf5a-52e71bc8559a None admin] RBAC: Adding query filter params (role.id=6f39f2f8bcc04c11b768de7f0c994fd7, user.id=b66aac32094747cf865792d7b98cb6dd, scope.system=all) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:40.932322 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53aeb89-2220-4567-bf5a-52e71bc8559a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:40.934379 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53aeb89-2220-4567-bf5a-52e71bc8559a None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:40.939616 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-7cb0d336-4d33-4f24-9259-940153114d0e None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:03:40.941126 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-7cb0d336-4d33-4f24-9259-940153114d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:03:40.945607 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 160/311] 10.222.0.65 () {56 vars in 1308 bytes} [Tue May 17 18:03:40 2022] GET /identity/v3/role_assignments?user.id=b66aac32094747cf865792d7b98cb6dd&scope.system=all&role.id=6f39f2f8bcc04c11b768de7f0c994fd7 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:41.025061 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 152/312] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:03:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:03:41.049373 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53aeb89-2220-4567-bf5a-52e71bc8559a None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:41.159696 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53aeb89-2220-4567-bf5a-52e71bc8559a None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:41.191868 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed55a7a-4413-4e1c-9d83-ddd0c7a5503f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:41.192905 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed55a7a-4413-4e1c-9d83-ddd0c7a5503f None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:41.193177 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed55a7a-4413-4e1c-9d83-ddd0c7a5503f None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:41.193448 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed55a7a-4413-4e1c-9d83-ddd0c7a5503f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:41.208180 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed55a7a-4413-4e1c-9d83-ddd0c7a5503f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:03:41.215786 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-1ed55a7a-4413-4e1c-9d83-ddd0c7a5503f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 17 18:03:41.215786 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:03:41.215786 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:03:41.215786 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:03:41.215786 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:03:41.215786 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:03:41.215786 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:03:41.215786 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:03:41.215786 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:03:41.215786 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:03:41.215786 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:03:41.215786 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:03:41.215786 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:03:41.215786 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:03:41.215786 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:03:41.215786 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:03:41.216665 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:03:41.216665 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:03:41.216665 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:03:41.216665 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:03:41.216665 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:03:41.216665 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:03:41.216665 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:03:41.216665 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:03:41.216665 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:03:41.216665 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:03:41.216665 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:03:41.216665 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:03:41.216665 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:03:41.216665 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:03:41.216665 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:03:41.216665 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:03:41.217447 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:03:41.217447 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:03:41.217447 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:03:41.217447 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:03:41.217447 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:03:41.217447 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:03:41.217447 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:03:41.217447 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:03:41.217447 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:03:41.217447 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:03:41.217447 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 17 18:03:41.217447 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:03:41.217447 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 161/313] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 17 18:03:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:03:41.223028 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb0d336-4d33-4f24-9259-940153114d0e None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:41.321572 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb0d336-4d33-4f24-9259-940153114d0e None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:41.355328 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089e2f29-38ee-492e-a72f-09e9fe3dd2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:41.355992 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e2f29-38ee-492e-a72f-09e9fe3dd2e9 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:41.356268 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e2f29-38ee-492e-a72f-09e9fe3dd2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:41.356535 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e2f29-38ee-492e-a72f-09e9fe3dd2e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:41.357272 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089e2f29-38ee-492e-a72f-09e9fe3dd2e9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:41.357601 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089e2f29-38ee-492e-a72f-09e9fe3dd2e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:41.359001 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089e2f29-38ee-492e-a72f-09e9fe3dd2e9 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:41.367571 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 153/314] 10.222.0.65 () {56 vars in 1101 bytes} [Tue May 17 18:03:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:41.373150 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed55a7a-4413-4e1c-9d83-ddd0c7a5503f None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:41.473177 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed55a7a-4413-4e1c-9d83-ddd0c7a5503f None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:41.506230 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5196f248-bc0e-4c4b-bf1a-70c6c641df57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:41.507096 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196f248-bc0e-4c4b-bf1a-70c6c641df57 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:41.507376 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196f248-bc0e-4c4b-bf1a-70c6c641df57 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:41.507643 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5196f248-bc0e-4c4b-bf1a-70c6c641df57 None admin] PATH_INFO: `/v3/users/36030fb8ad0f49d1b8330027b860bfc6` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:41.508848 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5196f248-bc0e-4c4b-bf1a-70c6c641df57 None admin] RBAC: Authorizing `identity:get_user(user_id=36030fb8ad0f49d1b8330027b860bfc6)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:41.510604 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5196f248-bc0e-4c4b-bf1a-70c6c641df57 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:41.512229 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 162/315] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 17 18:03:41 2022] GET /identity/v3/users/36030fb8ad0f49d1b8330027b860bfc6 => generated 297 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:41.518198 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089e2f29-38ee-492e-a72f-09e9fe3dd2e9 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:41.618290 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089e2f29-38ee-492e-a72f-09e9fe3dd2e9 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:41.651192 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe1088-a86c-472c-bc0e-e3660b2afab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:41.651836 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe1088-a86c-472c-bc0e-e3660b2afab0 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:41.652111 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe1088-a86c-472c-bc0e-e3660b2afab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:41.652379 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe1088-a86c-472c-bc0e-e3660b2afab0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:41.718987 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fe1088-a86c-472c-bc0e-e3660b2afab0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:41.720430 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fe1088-a86c-472c-bc0e-e3660b2afab0 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:41.821490 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 154/316] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 17 18:03:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 18:03:41.826903 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5196f248-bc0e-4c4b-bf1a-70c6c641df57 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:41.928240 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5196f248-bc0e-4c4b-bf1a-70c6c641df57 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:41.961897 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d4a6c-651d-4c08-a581-5a75bf26d85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:41.962750 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d4a6c-651d-4c08-a581-5a75bf26d85b None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:41.963034 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d4a6c-651d-4c08-a581-5a75bf26d85b None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:41.963293 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d4a6c-651d-4c08-a581-5a75bf26d85b None admin] PATH_INFO: `/v3/projects/3d967b497e5049b1bd80196bde0b33fd` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:41.964470 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d4a6c-651d-4c08-a581-5a75bf26d85b None admin] RBAC: Authorizing `identity:get_project(project_id=3d967b497e5049b1bd80196bde0b33fd)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:41.965933 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d4a6c-651d-4c08-a581-5a75bf26d85b None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:41.967630 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 163/317] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 17 18:03:41 2022] GET /identity/v3/projects/3d967b497e5049b1bd80196bde0b33fd => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:41.973843 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe1088-a86c-472c-bc0e-e3660b2afab0 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:42.070580 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe1088-a86c-472c-bc0e-e3660b2afab0 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:42.106229 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2f777-7657-4aa4-aaed-d4f2cd6620c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:42.106778 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2f777-7657-4aa4-aaed-d4f2cd6620c7 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:42.107053 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2f777-7657-4aa4-aaed-d4f2cd6620c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:42.107327 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2f777-7657-4aa4-aaed-d4f2cd6620c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:42.108153 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e2f777-7657-4aa4-aaed-d4f2cd6620c7 None admin] RBAC: Adding query filter params (role.id=6f39f2f8bcc04c11b768de7f0c994fd7, scope.project.id=3d967b497e5049b1bd80196bde0b33fd, user.id=36030fb8ad0f49d1b8330027b860bfc6) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:42.108458 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e2f777-7657-4aa4-aaed-d4f2cd6620c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:42.110006 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e2f777-7657-4aa4-aaed-d4f2cd6620c7 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:42.121530 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 155/318] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 17 18:03:41 2022] GET /identity/v3/role_assignments?user.id=36030fb8ad0f49d1b8330027b860bfc6&scope.project.id=3d967b497e5049b1bd80196bde0b33fd&role.id=6f39f2f8bcc04c11b768de7f0c994fd7 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:42.986408 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b25f1-b3f8-4f16-b3d0-a79543d14637 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:42.986930 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b25f1-b3f8-4f16-b3d0-a79543d14637 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:42.986930 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554b25f1-b3f8-4f16-b3d0-a79543d14637 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:42.988458 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 164/319] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:03:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:03:42.993432 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abcec36-a75c-47cd-aba9-a989d79a567f None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:42.993834 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abcec36-a75c-47cd-aba9-a989d79a567f None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:42.994013 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abcec36-a75c-47cd-aba9-a989d79a567f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:43.010577 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-7abcec36-a75c-47cd-aba9-a989d79a567f None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:03:43.011781 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-7abcec36-a75c-47cd-aba9-a989d79a567f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:03:43.083308 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 156/320] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:03:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:03:43.106334 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b25f1-b3f8-4f16-b3d0-a79543d14637 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:43.205070 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554b25f1-b3f8-4f16-b3d0-a79543d14637 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:43.205770 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef1fb8b-f148-4aff-9bf1-e383814f19d8 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:43.206062 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef1fb8b-f148-4aff-9bf1-e383814f19d8 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:43.206343 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef1fb8b-f148-4aff-9bf1-e383814f19d8 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:43.207718 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 157/321] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:03:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 18:03:43.212823 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dec944-4a8a-4fba-bc48-c5f73a3bba29 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:43.213107 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dec944-4a8a-4fba-bc48-c5f73a3bba29 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:43.213379 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dec944-4a8a-4fba-bc48-c5f73a3bba29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:43.229595 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-36dec944-4a8a-4fba-bc48-c5f73a3bba29 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:03:43.230777 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-36dec944-4a8a-4fba-bc48-c5f73a3bba29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:03:43.239311 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf7427-c8c6-4878-a733-6474eb52b0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:43.240110 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf7427-c8c6-4878-a733-6474eb52b0f7 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:43.240389 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf7427-c8c6-4878-a733-6474eb52b0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:43.240658 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf7427-c8c6-4878-a733-6474eb52b0f7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:43.250955 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf7427-c8c6-4878-a733-6474eb52b0f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:03:43.258577 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-d8cf7427-c8c6-4878-a733-6474eb52b0f7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 18:03:43.258577 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:03:43.258577 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:03:43.258577 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:03:43.258577 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:03:43.258577 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:03:43.258577 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:03:43.258577 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:03:43.258577 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:03:43.258577 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:03:43.258577 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:03:43.258577 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:03:43.258577 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:03:43.258577 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:03:43.258577 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:03:43.258577 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:03:43.259725 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:03:43.259725 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:03:43.259725 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:03:43.259725 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:03:43.259725 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:03:43.259725 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:03:43.259725 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:03:43.259725 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:03:43.259725 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:03:43.259725 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:03:43.259725 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:03:43.259725 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:03:43.259725 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:03:43.259725 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:03:43.259725 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:03:43.259725 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:03:43.260547 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:03:43.260547 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:03:43.260547 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:03:43.260547 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:03:43.260547 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:03:43.260547 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:03:43.260547 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:03:43.260547 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:03:43.260547 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:03:43.260547 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:03:43.260547 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 18:03:43.260547 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:03:43.260547 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 165/322] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 17 18:03:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:03:43.261192 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795757d-c622-4240-b4cc-a4a8f64dac77 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:43.261192 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795757d-c622-4240-b4cc-a4a8f64dac77 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:43.261484 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795757d-c622-4240-b4cc-a4a8f64dac77 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:43.262739 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 166/323] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:03:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:03:43.265779 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a795757d-c622-4240-b4cc-a4a8f64dac77 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:43.299904 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 158/324] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:03:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 18:03:43.301240 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2adbd-7822-43a0-9942-e1a305b497ce None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:43.301604 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2adbd-7822-43a0-9942-e1a305b497ce None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:43.301882 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2adbd-7822-43a0-9942-e1a305b497ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:43.316936 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-19a2adbd-7822-43a0-9942-e1a305b497ce None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:03:43.318388 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-19a2adbd-7822-43a0-9942-e1a305b497ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:03:43.360652 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a795757d-c622-4240-b4cc-a4a8f64dac77 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:43.380496 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 159/325] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:03:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:03:43.381328 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a2adbd-7822-43a0-9942-e1a305b497ce None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:43.396764 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e24a5-0723-460c-85d5-efe6f6b622e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:43.397420 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e24a5-0723-460c-85d5-efe6f6b622e4 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:43.397726 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e24a5-0723-460c-85d5-efe6f6b622e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:43.398000 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e24a5-0723-460c-85d5-efe6f6b622e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:43.398742 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286e24a5-0723-460c-85d5-efe6f6b622e4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:43.399045 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286e24a5-0723-460c-85d5-efe6f6b622e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:43.400415 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286e24a5-0723-460c-85d5-efe6f6b622e4 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:43.409225 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 167/326] 10.222.0.65 () {56 vars in 1101 bytes} [Tue May 17 18:03:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:03:43.410027 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e24a5-0723-460c-85d5-efe6f6b622e4 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:43.474662 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a2adbd-7822-43a0-9942-e1a305b497ce None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:43.501047 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e24a5-0723-460c-85d5-efe6f6b622e4 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:43.505614 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b221011c-298d-423d-90f1-97718f0ef701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:43.506386 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b221011c-298d-423d-90f1-97718f0ef701 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:43.506658 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b221011c-298d-423d-90f1-97718f0ef701 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:43.506923 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b221011c-298d-423d-90f1-97718f0ef701 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:43.516421 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b221011c-298d-423d-90f1-97718f0ef701 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:03:43.524076 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-b221011c-298d-423d-90f1-97718f0ef701 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 17 18:03:43.524076 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:03:43.524076 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:03:43.524076 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:03:43.524076 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:03:43.524076 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:03:43.524076 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:03:43.524076 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:03:43.524076 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:03:43.524076 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:03:43.524076 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:03:43.524076 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:03:43.524076 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:03:43.524076 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:03:43.524076 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:03:43.524076 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:03:43.524934 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:03:43.524934 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:03:43.524934 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:03:43.524934 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:03:43.524934 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:03:43.524934 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:03:43.524934 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:03:43.524934 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:03:43.524934 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:03:43.524934 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:03:43.524934 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:03:43.524934 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:03:43.524934 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:03:43.524934 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:03:43.524934 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:03:43.524934 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:03:43.525860 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:03:43.525860 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:03:43.525860 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:03:43.525860 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:03:43.525860 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:03:43.525860 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:03:43.525860 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:03:43.525860 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:03:43.525860 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:03:43.525860 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:03:43.525860 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 17 18:03:43.525860 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:03:43.525860 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 160/327] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 17 18:03:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:03:43.526512 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b221011c-298d-423d-90f1-97718f0ef701 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:43.536970 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f27773-929e-4762-8a07-5ca0798069f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:43.537776 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f27773-929e-4762-8a07-5ca0798069f7 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:43.538053 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f27773-929e-4762-8a07-5ca0798069f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:43.538321 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f27773-929e-4762-8a07-5ca0798069f7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:43.539456 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f27773-929e-4762-8a07-5ca0798069f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:43.540875 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f27773-929e-4762-8a07-5ca0798069f7 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:43.542486 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 168/328] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:03:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:43.543224 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f27773-929e-4762-8a07-5ca0798069f7 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:43.618319 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b221011c-298d-423d-90f1-97718f0ef701 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:43.638262 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f27773-929e-4762-8a07-5ca0798069f7 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:43.649068 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f57123-dc27-40d2-9bfe-d238bf2a7ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:43.649946 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f57123-dc27-40d2-9bfe-d238bf2a7ebc None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:43.650225 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f57123-dc27-40d2-9bfe-d238bf2a7ebc None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:43.650489 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f57123-dc27-40d2-9bfe-d238bf2a7ebc None admin] PATH_INFO: `/v3/users/536ac234b5b149e4b748abebaca8076f` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:43.651726 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f57123-dc27-40d2-9bfe-d238bf2a7ebc None admin] RBAC: Authorizing `identity:get_user(user_id=536ac234b5b149e4b748abebaca8076f)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:43.653187 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f57123-dc27-40d2-9bfe-d238bf2a7ebc None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:43.654856 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 161/329] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 17 18:03:43 2022] GET /identity/v3/users/536ac234b5b149e4b748abebaca8076f => generated 293 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:43.656116 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f57123-dc27-40d2-9bfe-d238bf2a7ebc None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:43.669826 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f797b6-72a4-4a26-ae73-3baa4781c4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:43.670477 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f797b6-72a4-4a26-ae73-3baa4781c4b7 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:43.670753 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f797b6-72a4-4a26-ae73-3baa4781c4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:43.671022 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f797b6-72a4-4a26-ae73-3baa4781c4b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:43.671821 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f797b6-72a4-4a26-ae73-3baa4781c4b7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:43.672121 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f797b6-72a4-4a26-ae73-3baa4781c4b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:43.673496 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f797b6-72a4-4a26-ae73-3baa4781c4b7 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:43.681300 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 169/330] 10.222.0.65 () {56 vars in 1101 bytes} [Tue May 17 18:03:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:43.682177 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f797b6-72a4-4a26-ae73-3baa4781c4b7 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:43.751166 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f57123-dc27-40d2-9bfe-d238bf2a7ebc None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:43.773994 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f797b6-72a4-4a26-ae73-3baa4781c4b7 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:43.782764 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb73910c-5429-47f8-bd63-8766311328eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:43.783411 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb73910c-5429-47f8-bd63-8766311328eb None admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:43.783694 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb73910c-5429-47f8-bd63-8766311328eb None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:43.783966 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb73910c-5429-47f8-bd63-8766311328eb None admin] PATH_INFO: `/v3/groups` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:43.784645 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb73910c-5429-47f8-bd63-8766311328eb None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:43.786105 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb73910c-5429-47f8-bd63-8766311328eb None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:43.799134 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 162/331] 10.222.0.65 () {60 vars in 1134 bytes} [Tue May 17 18:03:43 2022] POST /identity/v3/groups => generated 226 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:03:43.800007 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb73910c-5429-47f8-bd63-8766311328eb None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:43.809247 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24beace-4a92-4e36-9d16-f54d7abe91dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:43.809965 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24beace-4a92-4e36-9d16-f54d7abe91dd None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:43.810244 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24beace-4a92-4e36-9d16-f54d7abe91dd None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:43.810517 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24beace-4a92-4e36-9d16-f54d7abe91dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:43.811371 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24beace-4a92-4e36-9d16-f54d7abe91dd None admin] RBAC: Adding query filter params (role.id=2af599fd3ad74031901ea2d9e0408884, user.id=536ac234b5b149e4b748abebaca8076f, scope.system=all) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:43.812073 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24beace-4a92-4e36-9d16-f54d7abe91dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:43.813249 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24beace-4a92-4e36-9d16-f54d7abe91dd None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:43.828042 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 170/332] 10.222.0.65 () {56 vars in 1308 bytes} [Tue May 17 18:03:43 2022] GET /identity/v3/role_assignments?user.id=536ac234b5b149e4b748abebaca8076f&scope.system=all&role.id=2af599fd3ad74031901ea2d9e0408884 => generated 510 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:43.923451 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb73910c-5429-47f8-bd63-8766311328eb None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:43.962718 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e89145-3497-40d4-8846-eb0d9f37d36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:43.963719 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e89145-3497-40d4-8846-eb0d9f37d36d None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:43.964054 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e89145-3497-40d4-8846-eb0d9f37d36d None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:43.964337 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e89145-3497-40d4-8846-eb0d9f37d36d None admin] PATH_INFO: `/v3/users/b66aac32094747cf865792d7b98cb6dd` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:43.965718 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e89145-3497-40d4-8846-eb0d9f37d36d None admin] RBAC: Authorizing `identity:get_user(user_id=b66aac32094747cf865792d7b98cb6dd)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:43.967231 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e89145-3497-40d4-8846-eb0d9f37d36d None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:43.969320 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 163/333] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 17 18:03:43 2022] GET /identity/v3/users/b66aac32094747cf865792d7b98cb6dd => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:43.975636 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24beace-4a92-4e36-9d16-f54d7abe91dd None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:44.080518 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24beace-4a92-4e36-9d16-f54d7abe91dd None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:44.116090 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32b98ba-beea-4de9-a737-bca16f99549c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:44.117185 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b98ba-beea-4de9-a737-bca16f99549c None admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:44.117291 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b98ba-beea-4de9-a737-bca16f99549c None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:44.117515 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b98ba-beea-4de9-a737-bca16f99549c None admin] PATH_INFO: `/v3/system/users/b66aac32094747cf865792d7b98cb6dd/roles/6f39f2f8bcc04c11b768de7f0c994fd7` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:44.119028 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32b98ba-beea-4de9-a737-bca16f99549c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b66aac32094747cf865792d7b98cb6dd, role_id=6f39f2f8bcc04c11b768de7f0c994fd7)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:44.120420 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32b98ba-beea-4de9-a737-bca16f99549c None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:44.129428 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 171/334] 10.222.0.65 () {58 vars in 1334 bytes} [Tue May 17 18:03:43 2022] PUT /identity/v3/system/users/b66aac32094747cf865792d7b98cb6dd/roles/6f39f2f8bcc04c11b768de7f0c994fd7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:03:46.265949 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca7900-3c31-4c33-8998-096b09dc1ab7 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:46.266511 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca7900-3c31-4c33-8998-096b09dc1ab7 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:46.266511 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca7900-3c31-4c33-8998-096b09dc1ab7 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:46.268101 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 164/335] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:03:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:03:46.274489 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d975d56-1a52-445b-8933-a5aece341504 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:46.274932 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d975d56-1a52-445b-8933-a5aece341504 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:46.275016 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d975d56-1a52-445b-8933-a5aece341504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:46.292778 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-5d975d56-1a52-445b-8933-a5aece341504 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:03:46.294056 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-5d975d56-1a52-445b-8933-a5aece341504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:03:46.367655 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 172/336] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:03:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 18:03:46.401897 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca7900-3c31-4c33-8998-096b09dc1ab7 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:46.527578 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca7900-3c31-4c33-8998-096b09dc1ab7 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:46.565742 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be8f68-f346-4113-8c9b-4f3a6d3d3304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:46.566529 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be8f68-f346-4113-8c9b-4f3a6d3d3304 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:46.566805 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be8f68-f346-4113-8c9b-4f3a6d3d3304 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:46.567072 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be8f68-f346-4113-8c9b-4f3a6d3d3304 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:46.577358 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29be8f68-f346-4113-8c9b-4f3a6d3d3304 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:03:46.589260 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-29be8f68-f346-4113-8c9b-4f3a6d3d3304 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 18:03:46.589260 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:03:46.589260 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:03:46.589260 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:03:46.589260 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:03:46.589260 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:03:46.589260 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:03:46.589260 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:03:46.589260 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:03:46.589260 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:03:46.589260 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:03:46.589260 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:03:46.589260 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:03:46.589260 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:03:46.589260 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:03:46.589260 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:03:46.590271 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:03:46.590271 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:03:46.590271 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:03:46.590271 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:03:46.590271 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:03:46.590271 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:03:46.590271 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:03:46.590271 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:03:46.590271 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:03:46.590271 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:03:46.590271 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:03:46.590271 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:03:46.590271 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:03:46.590271 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:03:46.590271 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:03:46.590271 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:03:46.591100 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:03:46.591100 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:03:46.591100 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:03:46.591100 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:03:46.591100 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:03:46.591100 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:03:46.591100 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:03:46.591100 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:03:46.591100 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:03:46.591100 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:03:46.591100 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 18:03:46.591100 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:03:46.591100 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 165/337] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 17 18:03:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:03:46.596887 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d975d56-1a52-445b-8933-a5aece341504 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:46.737424 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d975d56-1a52-445b-8933-a5aece341504 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:46.776886 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bbe492-107a-4bab-a255-9f98c8fc78ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:46.778028 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bbe492-107a-4bab-a255-9f98c8fc78ce None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:46.778526 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bbe492-107a-4bab-a255-9f98c8fc78ce None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:46.779011 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bbe492-107a-4bab-a255-9f98c8fc78ce None admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:46.779963 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bbe492-107a-4bab-a255-9f98c8fc78ce None admin] RBAC: Adding query filter params (name=member) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:46.780554 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bbe492-107a-4bab-a255-9f98c8fc78ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:46.782263 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bbe492-107a-4bab-a255-9f98c8fc78ce None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:46.791672 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 173/338] 10.222.0.65 () {56 vars in 1101 bytes} [Tue May 17 18:03:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:46.797610 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be8f68-f346-4113-8c9b-4f3a6d3d3304 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:46.936089 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29be8f68-f346-4113-8c9b-4f3a6d3d3304 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:46.981138 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34299aaf-2b3f-48dc-9ad7-dd21ec8eb368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:46.981825 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34299aaf-2b3f-48dc-9ad7-dd21ec8eb368 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:46.982103 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34299aaf-2b3f-48dc-9ad7-dd21ec8eb368 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:46.982375 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34299aaf-2b3f-48dc-9ad7-dd21ec8eb368 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:47.060449 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34299aaf-2b3f-48dc-9ad7-dd21ec8eb368 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:47.064262 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34299aaf-2b3f-48dc-9ad7-dd21ec8eb368 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:47.077799 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aeaa78-e65b-4ad5-9b6e-fcda79fcba64 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:47.078424 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aeaa78-e65b-4ad5-9b6e-fcda79fcba64 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:47.078916 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aeaa78-e65b-4ad5-9b6e-fcda79fcba64 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:47.080512 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 174/339] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:03:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:03:47.086794 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da352ce4-687e-4632-a1e1-dcd284312565 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:47.087362 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da352ce4-687e-4632-a1e1-dcd284312565 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:47.087851 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da352ce4-687e-4632-a1e1-dcd284312565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:47.123545 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-da352ce4-687e-4632-a1e1-dcd284312565 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:03:47.126384 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-da352ce4-687e-4632-a1e1-dcd284312565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:03:47.169714 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 166/340] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 17 18:03:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 18:03:47.175810 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34299aaf-2b3f-48dc-9ad7-dd21ec8eb368 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:47.227182 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 175/341] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:03:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:03:47.252050 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e88839-f8d6-45e6-9c8f-8cef3d348866 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:47.252371 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e88839-f8d6-45e6-9c8f-8cef3d348866 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:47.252602 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e88839-f8d6-45e6-9c8f-8cef3d348866 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:47.254178 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 176/342] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:03:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 18:03:47.259742 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896490e9-c12b-4a61-8cd8-2b3dfe3143f4 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:47.260062 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896490e9-c12b-4a61-8cd8-2b3dfe3143f4 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:47.260284 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896490e9-c12b-4a61-8cd8-2b3dfe3143f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:47.286104 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-896490e9-c12b-4a61-8cd8-2b3dfe3143f4 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:03:47.287358 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-896490e9-c12b-4a61-8cd8-2b3dfe3143f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:03:47.333215 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34299aaf-2b3f-48dc-9ad7-dd21ec8eb368 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:47.368455 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 177/343] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:03:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:03:47.369309 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896490e9-c12b-4a61-8cd8-2b3dfe3143f4 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:47.373793 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d08fe-9723-471c-8b5e-74d6a9904b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:47.375178 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d08fe-9723-471c-8b5e-74d6a9904b38 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:47.375446 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d08fe-9723-471c-8b5e-74d6a9904b38 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:47.375711 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d08fe-9723-471c-8b5e-74d6a9904b38 None admin] PATH_INFO: `/v3/projects/d7cf4e05380e477d8f7793c92acc9742` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:47.377589 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852d08fe-9723-471c-8b5e-74d6a9904b38 None admin] RBAC: Authorizing `identity:get_project(project_id=d7cf4e05380e477d8f7793c92acc9742)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:47.379036 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852d08fe-9723-471c-8b5e-74d6a9904b38 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:47.380737 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 167/344] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 17 18:03:47 2022] GET /identity/v3/projects/d7cf4e05380e477d8f7793c92acc9742 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:03:47.386107 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac30d2a-3ab9-4776-b610-ace98668c7a5 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:47.386384 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac30d2a-3ab9-4776-b610-ace98668c7a5 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:47.386653 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac30d2a-3ab9-4776-b610-ace98668c7a5 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:47.387893 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 168/345] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:03:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:03:47.388928 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac30d2a-3ab9-4776-b610-ace98668c7a5 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:47.484281 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896490e9-c12b-4a61-8cd8-2b3dfe3143f4 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:47.496236 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac30d2a-3ab9-4776-b610-ace98668c7a5 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:47.521207 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a4ae2-14c9-41e9-b664-d8ab374d87b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:47.522086 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a4ae2-14c9-41e9-b664-d8ab374d87b1 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:47.522362 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a4ae2-14c9-41e9-b664-d8ab374d87b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:47.522630 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a4ae2-14c9-41e9-b664-d8ab374d87b1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:47.531628 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df80c3-b179-4053-ad1e-b7f81fa0435b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:47.532476 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df80c3-b179-4053-ad1e-b7f81fa0435b None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:47.532751 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df80c3-b179-4053-ad1e-b7f81fa0435b None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:47.533018 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df80c3-b179-4053-ad1e-b7f81fa0435b None admin] PATH_INFO: `/v3/groups/8f23a524ffa445058805d48e211ec189` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:47.534262 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036a4ae2-14c9-41e9-b664-d8ab374d87b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:03:47.540226 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27df80c3-b179-4053-ad1e-b7f81fa0435b None admin] RBAC: Authorizing `identity:get_group(group_id=8f23a524ffa445058805d48e211ec189)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:47.541712 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27df80c3-b179-4053-ad1e-b7f81fa0435b None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:47.542316 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-036a4ae2-14c9-41e9-b664-d8ab374d87b1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 18:03:47.542316 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:03:47.542316 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:03:47.542316 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:03:47.542316 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:03:47.542316 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:03:47.542316 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:03:47.542316 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:03:47.542316 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:03:47.542316 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:03:47.542316 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:03:47.542316 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:03:47.542316 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:03:47.542316 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:03:47.542316 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:03:47.542316 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:03:47.543171 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:03:47.543171 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:03:47.543171 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:03:47.543171 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:03:47.543171 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:03:47.543171 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:03:47.543171 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:03:47.543171 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:03:47.543171 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:03:47.543171 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:03:47.543171 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:03:47.543171 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:03:47.543171 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:03:47.543171 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:03:47.543171 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:03:47.543171 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:03:47.545735 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:03:47.545735 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:03:47.545735 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:03:47.545735 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:03:47.545735 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:03:47.545735 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:03:47.545735 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:03:47.545735 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:03:47.545735 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:03:47.545735 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:03:47.545735 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 18:03:47.545735 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:03:47.547308 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 169/346] 10.222.0.65 () {56 vars in 1180 bytes} [Tue May 17 18:03:47 2022] GET /identity/v3/groups/8f23a524ffa445058805d48e211ec189 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:47.547445 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 178/347] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 17 18:03:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:03:47.547445 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a4ae2-14c9-41e9-b664-d8ab374d87b1 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:47.547668 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a93ada-43ea-48d5-94d4-5cc17f2dad5c None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:47.547668 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a93ada-43ea-48d5-94d4-5cc17f2dad5c None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:47.547668 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a93ada-43ea-48d5-94d4-5cc17f2dad5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:47.572404 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-e4a93ada-43ea-48d5-94d4-5cc17f2dad5c None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:03:47.573792 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-e4a93ada-43ea-48d5-94d4-5cc17f2dad5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:03:47.646701 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 170/348] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:03:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:03:47.653490 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a93ada-43ea-48d5-94d4-5cc17f2dad5c None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:47.674190 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a4ae2-14c9-41e9-b664-d8ab374d87b1 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:47.719756 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140de777-7040-49de-8ef2-113fdb806482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:47.720811 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140de777-7040-49de-8ef2-113fdb806482 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:47.721265 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140de777-7040-49de-8ef2-113fdb806482 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:47.721732 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140de777-7040-49de-8ef2-113fdb806482 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:47.732389 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140de777-7040-49de-8ef2-113fdb806482 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:03:47.742744 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-140de777-7040-49de-8ef2-113fdb806482 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 18:03:47.742744 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:03:47.742744 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:03:47.742744 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:03:47.742744 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:03:47.742744 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:03:47.742744 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:03:47.742744 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:03:47.742744 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:03:47.742744 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:03:47.742744 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:03:47.742744 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:03:47.742744 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:03:47.742744 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:03:47.742744 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:03:47.742744 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:03:47.743872 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:03:47.743872 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:03:47.743872 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:03:47.743872 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:03:47.743872 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:03:47.743872 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:03:47.743872 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:03:47.743872 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:03:47.743872 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:03:47.743872 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:03:47.743872 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:03:47.743872 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:03:47.743872 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:03:47.743872 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:03:47.743872 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:03:47.743872 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:03:47.744715 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:03:47.744715 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:03:47.744715 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:03:47.744715 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:03:47.744715 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:03:47.744715 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:03:47.744715 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:03:47.744715 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:03:47.744715 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:03:47.744715 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:03:47.744715 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 18:03:47.744715 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:03:47.747358 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 179/349] 10.222.0.65 () {56 vars in 1114 bytes} [Tue May 17 18:03:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:03:47.748338 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140de777-7040-49de-8ef2-113fdb806482 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:47.754300 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a93ada-43ea-48d5-94d4-5cc17f2dad5c None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:47.794858 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8795985d-586a-4ae4-913e-c574e5e1c2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:47.795502 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8795985d-586a-4ae4-913e-c574e5e1c2d2 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:47.798197 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8795985d-586a-4ae4-913e-c574e5e1c2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:47.798197 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8795985d-586a-4ae4-913e-c574e5e1c2d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:47.798197 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8795985d-586a-4ae4-913e-c574e5e1c2d2 None admin] RBAC: Adding query filter params (group.id=8f23a524ffa445058805d48e211ec189, role.id=2af599fd3ad74031901ea2d9e0408884, scope.project.id=d7cf4e05380e477d8f7793c92acc9742) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:47.798197 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8795985d-586a-4ae4-913e-c574e5e1c2d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:47.800518 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8795985d-586a-4ae4-913e-c574e5e1c2d2 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:47.806756 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 171/350] 10.222.0.65 () {56 vars in 1376 bytes} [Tue May 17 18:03:47 2022] GET /identity/v3/role_assignments?group.id=8f23a524ffa445058805d48e211ec189&scope.project.id=d7cf4e05380e477d8f7793c92acc9742&role.id=2af599fd3ad74031901ea2d9e0408884 => generated 260 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:47.807568 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8795985d-586a-4ae4-913e-c574e5e1c2d2 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:47.909197 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140de777-7040-49de-8ef2-113fdb806482 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:47.920247 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8795985d-586a-4ae4-913e-c574e5e1c2d2 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:47.957539 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d6eef5-ef96-498d-a314-c3e8b1c05951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:47.958363 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6eef5-ef96-498d-a314-c3e8b1c05951 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:47.958649 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6eef5-ef96-498d-a314-c3e8b1c05951 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:47.958910 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6eef5-ef96-498d-a314-c3e8b1c05951 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:47.975805 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7189968-d61f-4e4b-b9b0-ad1de036554a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:47.976898 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7189968-d61f-4e4b-b9b0-ad1de036554a None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:47.977353 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7189968-d61f-4e4b-b9b0-ad1de036554a None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:47.977834 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7189968-d61f-4e4b-b9b0-ad1de036554a None admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:47.979106 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7189968-d61f-4e4b-b9b0-ad1de036554a None admin] RBAC: Adding query filter params (name=member) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:47.979597 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7189968-d61f-4e4b-b9b0-ad1de036554a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:47.981823 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7189968-d61f-4e4b-b9b0-ad1de036554a None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:47.985900 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d6eef5-ef96-498d-a314-c3e8b1c05951 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:03:48.000252 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-03d6eef5-ef96-498d-a314-c3e8b1c05951 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 17 18:03:48.000252 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:03:48.000252 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:03:48.000252 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:03:48.000252 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:03:48.000252 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:03:48.000252 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:03:48.000252 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:03:48.000252 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:03:48.000252 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:03:48.000252 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:03:48.000252 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:03:48.000252 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:03:48.000252 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:03:48.000252 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:03:48.000252 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:03:48.001307 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:03:48.001307 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:03:48.001307 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:03:48.001307 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:03:48.001307 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:03:48.001307 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:03:48.001307 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:03:48.001307 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:03:48.001307 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:03:48.001307 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:03:48.001307 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:03:48.001307 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:03:48.001307 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:03:48.001307 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:03:48.001307 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:03:48.001307 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:03:48.002302 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:03:48.002302 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:03:48.002302 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:03:48.002302 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:03:48.002302 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:03:48.002302 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:03:48.002302 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:03:48.002302 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:03:48.002302 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:03:48.002302 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:03:48.002302 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 17 18:03:48.002302 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:03:48.003500 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 172/351] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 17 18:03:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:03:48.004414 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d6eef5-ef96-498d-a314-c3e8b1c05951 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:48.006517 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 180/352] 10.222.0.65 () {56 vars in 1101 bytes} [Tue May 17 18:03:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:48.012821 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7189968-d61f-4e4b-b9b0-ad1de036554a None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:48.165724 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7189968-d61f-4e4b-b9b0-ad1de036554a None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:48.182697 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d6eef5-ef96-498d-a314-c3e8b1c05951 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:48.216752 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3974cdae-b8c5-438f-8ef1-03d71b1f0867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:48.217975 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974cdae-b8c5-438f-8ef1-03d71b1f0867 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:48.218443 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974cdae-b8c5-438f-8ef1-03d71b1f0867 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:48.218914 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3974cdae-b8c5-438f-8ef1-03d71b1f0867 None admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:48.219990 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3974cdae-b8c5-438f-8ef1-03d71b1f0867 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:48.220469 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3974cdae-b8c5-438f-8ef1-03d71b1f0867 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:48.222289 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3974cdae-b8c5-438f-8ef1-03d71b1f0867 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:48.239852 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 181/353] 10.222.0.65 () {56 vars in 1101 bytes} [Tue May 17 18:03:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:03:48.241904 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3974cdae-b8c5-438f-8ef1-03d71b1f0867 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:48.247284 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e45cc-0167-4095-9e31-969201b78efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:48.248204 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e45cc-0167-4095-9e31-969201b78efb None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:48.248656 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e45cc-0167-4095-9e31-969201b78efb None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:48.249675 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e45cc-0167-4095-9e31-969201b78efb None admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:48.250621 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e45cc-0167-4095-9e31-969201b78efb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:48.251111 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e45cc-0167-4095-9e31-969201b78efb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:48.252733 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e45cc-0167-4095-9e31-969201b78efb None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:48.261719 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 173/354] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 17 18:03:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:48.262796 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e45cc-0167-4095-9e31-969201b78efb None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:48.372096 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e45cc-0167-4095-9e31-969201b78efb None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:48.372712 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3974cdae-b8c5-438f-8ef1-03d71b1f0867 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:48.409188 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec4c053-8dca-4a4a-8180-ea44bd4c44df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:48.409871 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4c053-8dca-4a4a-8180-ea44bd4c44df None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:48.410638 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4c053-8dca-4a4a-8180-ea44bd4c44df None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:48.410638 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4c053-8dca-4a4a-8180-ea44bd4c44df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:48.413141 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ddc53-9647-4e4f-b558-77b0455a5268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:48.414262 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ddc53-9647-4e4f-b558-77b0455a5268 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:48.414539 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ddc53-9647-4e4f-b558-77b0455a5268 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:48.414808 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ddc53-9647-4e4f-b558-77b0455a5268 None admin] PATH_INFO: `/v3/users/b66aac32094747cf865792d7b98cb6dd` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:48.417008 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7ddc53-9647-4e4f-b558-77b0455a5268 None admin] RBAC: Authorizing `identity:get_user(user_id=b66aac32094747cf865792d7b98cb6dd)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:48.418523 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7ddc53-9647-4e4f-b558-77b0455a5268 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:48.420296 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 174/355] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 17 18:03:48 2022] GET /identity/v3/users/b66aac32094747cf865792d7b98cb6dd => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:48.422203 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ddc53-9647-4e4f-b558-77b0455a5268 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:48.495784 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec4c053-8dca-4a4a-8180-ea44bd4c44df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:48.498285 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec4c053-8dca-4a4a-8180-ea44bd4c44df None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:48.549132 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ddc53-9647-4e4f-b558-77b0455a5268 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:48.594767 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49de3f65-5d30-447c-9b87-2274b89c907f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:48.595417 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de3f65-5d30-447c-9b87-2274b89c907f None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:48.595692 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de3f65-5d30-447c-9b87-2274b89c907f None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:48.595961 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de3f65-5d30-447c-9b87-2274b89c907f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:48.625046 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 182/356] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 17 18:03:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 18:03:48.626476 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82b266-00c0-47f3-935d-4ff75f3dd6ff None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:48.626767 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82b266-00c0-47f3-935d-4ff75f3dd6ff None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:48.627044 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82b266-00c0-47f3-935d-4ff75f3dd6ff None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:48.628563 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 183/357] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:03:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:03:48.629271 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82b266-00c0-47f3-935d-4ff75f3dd6ff None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:48.670557 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49de3f65-5d30-447c-9b87-2274b89c907f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:48.671995 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49de3f65-5d30-447c-9b87-2274b89c907f None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:48.737301 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82b266-00c0-47f3-935d-4ff75f3dd6ff None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:48.787427 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab14189-e62c-41e7-932b-1da4086849f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:48.788098 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab14189-e62c-41e7-932b-1da4086849f5 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:48.788708 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab14189-e62c-41e7-932b-1da4086849f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:48.788990 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab14189-e62c-41e7-932b-1da4086849f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:48.790142 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab14189-e62c-41e7-932b-1da4086849f5 None admin] RBAC: Adding query filter params (role.id=6f39f2f8bcc04c11b768de7f0c994fd7, user.id=b66aac32094747cf865792d7b98cb6dd, scope.system=all) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:48.790460 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab14189-e62c-41e7-932b-1da4086849f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:48.792072 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 175/358] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 17 18:03:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 18:03:48.792208 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab14189-e62c-41e7-932b-1da4086849f5 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:48.792920 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49de3f65-5d30-447c-9b87-2274b89c907f None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:48.807311 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 184/359] 10.222.0.65 () {56 vars in 1308 bytes} [Tue May 17 18:03:48 2022] GET /identity/v3/role_assignments?user.id=b66aac32094747cf865792d7b98cb6dd&scope.system=all&role.id=6f39f2f8bcc04c11b768de7f0c994fd7 => generated 510 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:48.808827 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb2ff4-3f1e-4972-b86c-49daef600c60 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:48.809120 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb2ff4-3f1e-4972-b86c-49daef600c60 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:48.809397 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb2ff4-3f1e-4972-b86c-49daef600c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:48.828917 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-38fb2ff4-3f1e-4972-b86c-49daef600c60 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:03:48.830591 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-38fb2ff4-3f1e-4972-b86c-49daef600c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:03:48.930094 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 185/360] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:03:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:03:48.931578 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377757d-768c-481c-bbd9-2f1febad952b None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:48.931959 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377757d-768c-481c-bbd9-2f1febad952b None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:48.932332 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377757d-768c-481c-bbd9-2f1febad952b None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:48.934021 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 186/361] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:03:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:03:48.934812 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d377757d-768c-481c-bbd9-2f1febad952b None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:48.937361 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49de3f65-5d30-447c-9b87-2274b89c907f None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:48.988316 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d456d52c-f94a-45cf-84f8-daee7dfd22bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:48.989442 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456d52c-f94a-45cf-84f8-daee7dfd22bf None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:48.989740 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456d52c-f94a-45cf-84f8-daee7dfd22bf None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:48.990057 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456d52c-f94a-45cf-84f8-daee7dfd22bf None admin] PATH_INFO: `/v3/projects/3d967b497e5049b1bd80196bde0b33fd` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:48.991308 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d456d52c-f94a-45cf-84f8-daee7dfd22bf None admin] RBAC: Authorizing `identity:get_project(project_id=3d967b497e5049b1bd80196bde0b33fd)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:48.992908 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d456d52c-f94a-45cf-84f8-daee7dfd22bf None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:48.994815 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 176/362] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 17 18:03:48 2022] GET /identity/v3/projects/3d967b497e5049b1bd80196bde0b33fd => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:48.996040 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7494033-57e8-4b86-bd96-0b197343bddb None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:48.996320 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7494033-57e8-4b86-bd96-0b197343bddb None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:48.996644 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7494033-57e8-4b86-bd96-0b197343bddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:49.021740 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-c7494033-57e8-4b86-bd96-0b197343bddb None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:03:49.022972 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-c7494033-57e8-4b86-bd96-0b197343bddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:03:49.061222 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d377757d-768c-481c-bbd9-2f1febad952b None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:49.109344 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9746814-b8cf-4cd8-8595-2810bbd61760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:49.110234 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9746814-b8cf-4cd8-8595-2810bbd61760 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:49.110512 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9746814-b8cf-4cd8-8595-2810bbd61760 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:49.110784 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9746814-b8cf-4cd8-8595-2810bbd61760 None admin] PATH_INFO: `/v3/projects/d7cf4e05380e477d8f7793c92acc9742` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:49.112071 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9746814-b8cf-4cd8-8595-2810bbd61760 None admin] RBAC: Authorizing `identity:get_project(project_id=d7cf4e05380e477d8f7793c92acc9742)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:49.113543 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9746814-b8cf-4cd8-8595-2810bbd61760 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:49.115816 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 187/363] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 17 18:03:48 2022] GET /identity/v3/projects/d7cf4e05380e477d8f7793c92acc9742 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:49.116759 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9746814-b8cf-4cd8-8595-2810bbd61760 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:49.133897 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 177/364] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:03:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:03:49.134832 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7494033-57e8-4b86-bd96-0b197343bddb None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:49.238322 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9746814-b8cf-4cd8-8595-2810bbd61760 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:49.254255 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7494033-57e8-4b86-bd96-0b197343bddb None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:49.291119 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6cf63b-7220-4f2a-954e-bf2f64104492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:49.291934 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6cf63b-7220-4f2a-954e-bf2f64104492 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:49.292213 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6cf63b-7220-4f2a-954e-bf2f64104492 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:49.292484 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6cf63b-7220-4f2a-954e-bf2f64104492 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:49.292754 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425107f8-89c7-49f7-a3a5-892d6dc1af3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:49.293810 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425107f8-89c7-49f7-a3a5-892d6dc1af3a None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:49.294087 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425107f8-89c7-49f7-a3a5-892d6dc1af3a None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:49.294356 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425107f8-89c7-49f7-a3a5-892d6dc1af3a None admin] PATH_INFO: `/v3/groups/8f23a524ffa445058805d48e211ec189` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:49.295704 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425107f8-89c7-49f7-a3a5-892d6dc1af3a None admin] RBAC: Authorizing `identity:get_group(group_id=8f23a524ffa445058805d48e211ec189)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:49.297619 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425107f8-89c7-49f7-a3a5-892d6dc1af3a None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:49.299482 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 178/365] 10.222.0.65 () {56 vars in 1180 bytes} [Tue May 17 18:03:49 2022] GET /identity/v3/groups/8f23a524ffa445058805d48e211ec189 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:49.300191 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425107f8-89c7-49f7-a3a5-892d6dc1af3a None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:49.308549 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6cf63b-7220-4f2a-954e-bf2f64104492 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:03:49.318825 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-7c6cf63b-7220-4f2a-954e-bf2f64104492 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 18:03:49.318825 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:03:49.318825 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:03:49.318825 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:03:49.318825 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:03:49.318825 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:03:49.318825 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:03:49.318825 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:03:49.318825 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:03:49.318825 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:03:49.318825 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:03:49.318825 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:03:49.318825 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:03:49.318825 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:03:49.318825 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:03:49.318825 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:03:49.319814 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:03:49.319814 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:03:49.319814 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:03:49.319814 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:03:49.319814 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:03:49.319814 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:03:49.319814 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:03:49.319814 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:03:49.319814 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:03:49.319814 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:03:49.319814 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:03:49.319814 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:03:49.319814 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:03:49.319814 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:03:49.319814 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:03:49.319814 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:03:49.320616 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:03:49.320616 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:03:49.320616 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:03:49.320616 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:03:49.320616 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:03:49.320616 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:03:49.320616 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:03:49.320616 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:03:49.320616 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:03:49.320616 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:03:49.320616 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 18:03:49.320616 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:03:49.321939 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 188/366] 10.222.0.65 () {56 vars in 1114 bytes} [Tue May 17 18:03:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:03:49.322853 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6cf63b-7220-4f2a-954e-bf2f64104492 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:49.413286 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425107f8-89c7-49f7-a3a5-892d6dc1af3a None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:49.458857 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5cf7b0-4ef1-4cad-9edb-4644273aaa2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:49.459686 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5cf7b0-4ef1-4cad-9edb-4644273aaa2c None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:49.459975 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5cf7b0-4ef1-4cad-9edb-4644273aaa2c None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:49.460239 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5cf7b0-4ef1-4cad-9edb-4644273aaa2c None admin] PATH_INFO: `/v3/groups/8f23a524ffa445058805d48e211ec189` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:49.461236 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6cf63b-7220-4f2a-954e-bf2f64104492 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:49.461694 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5cf7b0-4ef1-4cad-9edb-4644273aaa2c None admin] RBAC: Authorizing `identity:get_group(group_id=8f23a524ffa445058805d48e211ec189)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:49.462892 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5cf7b0-4ef1-4cad-9edb-4644273aaa2c None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:49.464668 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 179/367] 10.222.0.65 () {56 vars in 1180 bytes} [Tue May 17 18:03:49 2022] GET /identity/v3/groups/8f23a524ffa445058805d48e211ec189 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:49.465557 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5cf7b0-4ef1-4cad-9edb-4644273aaa2c None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:49.499124 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004444d-e220-47aa-a767-295ce496e31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:49.499839 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004444d-e220-47aa-a767-295ce496e31b None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:49.500113 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004444d-e220-47aa-a767-295ce496e31b None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:49.500383 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004444d-e220-47aa-a767-295ce496e31b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:49.512549 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c004444d-e220-47aa-a767-295ce496e31b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:03:49.520308 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-c004444d-e220-47aa-a767-295ce496e31b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:03:49.520308 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:03:49.520308 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:03:49.520308 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:03:49.520308 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:03:49.520308 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:03:49.520308 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:03:49.520308 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:03:49.520308 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:03:49.520308 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:03:49.520308 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:03:49.520308 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:03:49.520308 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:03:49.520308 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:03:49.520308 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:03:49.520308 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:03:49.521407 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:03:49.521407 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:03:49.521407 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:03:49.521407 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:03:49.521407 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:03:49.521407 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:03:49.521407 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:03:49.521407 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:03:49.521407 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:03:49.521407 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:03:49.521407 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:03:49.521407 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:03:49.521407 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:03:49.521407 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:03:49.521407 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:03:49.521407 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:03:49.522494 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:03:49.522494 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:03:49.522494 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:03:49.522494 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:03:49.522494 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:03:49.522494 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:03:49.522494 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:03:49.522494 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:03:49.522494 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:03:49.522494 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:03:49.522494 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:03:49.522494 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:03:49.526747 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 189/368] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 17 18:03:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:03:49.526747 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004444d-e220-47aa-a767-295ce496e31b None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:49.590189 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5cf7b0-4ef1-4cad-9edb-4644273aaa2c None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:49.636572 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc27055-774e-473b-bbe1-3606bddc2847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:49.637312 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc27055-774e-473b-bbe1-3606bddc2847 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:49.638448 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc27055-774e-473b-bbe1-3606bddc2847 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:49.638448 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc27055-774e-473b-bbe1-3606bddc2847 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:49.638904 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc27055-774e-473b-bbe1-3606bddc2847 None admin] RBAC: Adding query filter params (group.id=8f23a524ffa445058805d48e211ec189, role.id=2af599fd3ad74031901ea2d9e0408884, scope.project.id=3d967b497e5049b1bd80196bde0b33fd) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:49.639281 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc27055-774e-473b-bbe1-3606bddc2847 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:49.641367 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc27055-774e-473b-bbe1-3606bddc2847 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:49.644322 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004444d-e220-47aa-a767-295ce496e31b None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:49.647564 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 180/369] 10.222.0.65 () {56 vars in 1376 bytes} [Tue May 17 18:03:49 2022] GET /identity/v3/role_assignments?group.id=8f23a524ffa445058805d48e211ec189&scope.project.id=3d967b497e5049b1bd80196bde0b33fd&role.id=2af599fd3ad74031901ea2d9e0408884 => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:49.648448 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc27055-774e-473b-bbe1-3606bddc2847 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:49.688071 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8582b26d-ba1e-4597-860c-7a06a0d071ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:49.689138 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582b26d-ba1e-4597-860c-7a06a0d071ad None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:49.689824 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582b26d-ba1e-4597-860c-7a06a0d071ad None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:49.690298 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582b26d-ba1e-4597-860c-7a06a0d071ad None admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:49.691268 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8582b26d-ba1e-4597-860c-7a06a0d071ad None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:49.691773 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8582b26d-ba1e-4597-860c-7a06a0d071ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:49.693720 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8582b26d-ba1e-4597-860c-7a06a0d071ad None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:49.703640 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 190/370] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 17 18:03:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:49.709408 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8582b26d-ba1e-4597-860c-7a06a0d071ad None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:49.783940 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc27055-774e-473b-bbe1-3606bddc2847 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:49.834017 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f99af-b366-4b4d-82c9-0ebc2fc744c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:49.834847 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f99af-b366-4b4d-82c9-0ebc2fc744c6 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:49.834977 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f99af-b366-4b4d-82c9-0ebc2fc744c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:49.835217 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f99af-b366-4b4d-82c9-0ebc2fc744c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:49.836058 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521f99af-b366-4b4d-82c9-0ebc2fc744c6 None admin] RBAC: Adding query filter params (group.id=8f23a524ffa445058805d48e211ec189, role.id=c3b3265cd6364fbcb22a731040b7b47a, scope.project.id=d7cf4e05380e477d8f7793c92acc9742) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:49.836442 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521f99af-b366-4b4d-82c9-0ebc2fc744c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:49.837846 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521f99af-b366-4b4d-82c9-0ebc2fc744c6 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:49.838785 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8582b26d-ba1e-4597-860c-7a06a0d071ad None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:49.847474 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 181/371] 10.222.0.65 () {56 vars in 1376 bytes} [Tue May 17 18:03:49 2022] GET /identity/v3/role_assignments?group.id=8f23a524ffa445058805d48e211ec189&scope.project.id=d7cf4e05380e477d8f7793c92acc9742&role.id=c3b3265cd6364fbcb22a731040b7b47a => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:49.847474 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f99af-b366-4b4d-82c9-0ebc2fc744c6 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:49.878239 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d19fa4-87e6-4153-8942-e2d0a7102b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:49.879080 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d19fa4-87e6-4153-8942-e2d0a7102b95 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:49.879458 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d19fa4-87e6-4153-8942-e2d0a7102b95 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:49.879828 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d19fa4-87e6-4153-8942-e2d0a7102b95 None admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:49.880799 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d19fa4-87e6-4153-8942-e2d0a7102b95 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:49.881206 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d19fa4-87e6-4153-8942-e2d0a7102b95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:49.882808 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d19fa4-87e6-4153-8942-e2d0a7102b95 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:49.893589 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 191/372] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 17 18:03:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:49.901193 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d19fa4-87e6-4153-8942-e2d0a7102b95 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:49.959192 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f99af-b366-4b4d-82c9-0ebc2fc744c6 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:49.996200 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b46fa98-aa88-44a6-a143-a618fa2f3a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:49.997010 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46fa98-aa88-44a6-a143-a618fa2f3a0b None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:49.997215 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46fa98-aa88-44a6-a143-a618fa2f3a0b None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:49.997561 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46fa98-aa88-44a6-a143-a618fa2f3a0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:50.014144 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d19fa4-87e6-4153-8942-e2d0a7102b95 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:50.049551 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1c36da-27a8-4789-90ca-6c28c5db882f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:50.050145 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c36da-27a8-4789-90ca-6c28c5db882f None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:50.050423 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c36da-27a8-4789-90ca-6c28c5db882f None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:50.050692 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1c36da-27a8-4789-90ca-6c28c5db882f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:50.070985 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b46fa98-aa88-44a6-a143-a618fa2f3a0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:50.072470 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b46fa98-aa88-44a6-a143-a618fa2f3a0b None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:50.120315 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1c36da-27a8-4789-90ca-6c28c5db882f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:50.121798 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1c36da-27a8-4789-90ca-6c28c5db882f None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:50.177089 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 182/373] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 17 18:03:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 18:03:50.187455 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b46fa98-aa88-44a6-a143-a618fa2f3a0b None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:50.251559 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 192/374] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 17 18:03:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 17 18:03:50.257235 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1c36da-27a8-4789-90ca-6c28c5db882f None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:50.331609 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b46fa98-aa88-44a6-a143-a618fa2f3a0b None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:50.379969 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a0775-2a0b-46ef-a681-1bbca431d515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:50.380832 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a0775-2a0b-46ef-a681-1bbca431d515 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:50.381104 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a0775-2a0b-46ef-a681-1bbca431d515 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:50.381374 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0a0775-2a0b-46ef-a681-1bbca431d515 None admin] PATH_INFO: `/v3/projects/3d967b497e5049b1bd80196bde0b33fd` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:50.384998 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0a0775-2a0b-46ef-a681-1bbca431d515 None admin] RBAC: Authorizing `identity:get_project(project_id=3d967b497e5049b1bd80196bde0b33fd)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:50.386505 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0a0775-2a0b-46ef-a681-1bbca431d515 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:50.388455 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 183/375] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 17 18:03:50 2022] GET /identity/v3/projects/3d967b497e5049b1bd80196bde0b33fd => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:50.395408 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a0775-2a0b-46ef-a681-1bbca431d515 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:50.439128 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1c36da-27a8-4789-90ca-6c28c5db882f None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:50.475847 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc9032-6c18-4faf-beaf-76fbda8f9f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:50.477353 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc9032-6c18-4faf-beaf-76fbda8f9f00 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:50.477683 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc9032-6c18-4faf-beaf-76fbda8f9f00 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:50.477962 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc9032-6c18-4faf-beaf-76fbda8f9f00 None admin] PATH_INFO: `/v3/projects/22a045ecfd2045b79def0497d463b2a3` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:50.479444 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddc9032-6c18-4faf-beaf-76fbda8f9f00 None admin] RBAC: Authorizing `identity:get_project(project_id=22a045ecfd2045b79def0497d463b2a3)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:50.481851 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddc9032-6c18-4faf-beaf-76fbda8f9f00 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:50.484439 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 193/376] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 17 18:03:50 2022] GET /identity/v3/projects/22a045ecfd2045b79def0497d463b2a3 => generated 344 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:03:50.489762 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc9032-6c18-4faf-beaf-76fbda8f9f00 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:50.525680 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0a0775-2a0b-46ef-a681-1bbca431d515 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:50.578300 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077e2822-2453-4346-a609-745a717bf634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:50.579160 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e2822-2453-4346-a609-745a717bf634 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:50.579432 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e2822-2453-4346-a609-745a717bf634 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:50.579694 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e2822-2453-4346-a609-745a717bf634 None admin] PATH_INFO: `/v3/groups/8f23a524ffa445058805d48e211ec189` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:50.581010 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077e2822-2453-4346-a609-745a717bf634 None admin] RBAC: Authorizing `identity:get_group(group_id=8f23a524ffa445058805d48e211ec189)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:50.583032 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077e2822-2453-4346-a609-745a717bf634 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:50.584812 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 184/377] 10.222.0.65 () {56 vars in 1180 bytes} [Tue May 17 18:03:50 2022] GET /identity/v3/groups/8f23a524ffa445058805d48e211ec189 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:50.590848 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077e2822-2453-4346-a609-745a717bf634 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:50.646834 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc9032-6c18-4faf-beaf-76fbda8f9f00 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:50.696635 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7595e579-6434-4070-98b5-e6ebfd817291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:50.697538 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595e579-6434-4070-98b5-e6ebfd817291 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:50.697891 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595e579-6434-4070-98b5-e6ebfd817291 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:50.698152 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595e579-6434-4070-98b5-e6ebfd817291 None admin] PATH_INFO: `/v3/groups/6cdc1d9a8aae4e459182451deb133424` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:50.705403 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7595e579-6434-4070-98b5-e6ebfd817291 None admin] RBAC: Authorizing `identity:get_group(group_id=6cdc1d9a8aae4e459182451deb133424)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:50.706879 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7595e579-6434-4070-98b5-e6ebfd817291 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:50.712539 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 194/378] 10.222.0.65 () {56 vars in 1180 bytes} [Tue May 17 18:03:50 2022] GET /identity/v3/groups/6cdc1d9a8aae4e459182451deb133424 => generated 229 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:50.712539 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015009c4-fa8a-47a0-a5c1-9f9d9d1c3a13 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:50.712539 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015009c4-fa8a-47a0-a5c1-9f9d9d1c3a13 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:50.712539 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015009c4-fa8a-47a0-a5c1-9f9d9d1c3a13 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:50.712539 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 195/379] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:03:50.715983 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015009c4-fa8a-47a0-a5c1-9f9d9d1c3a13 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:50.753174 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077e2822-2453-4346-a609-745a717bf634 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:50.796792 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fae2ed-23f6-454f-ad78-b3086e8bcf21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:50.797443 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fae2ed-23f6-454f-ad78-b3086e8bcf21 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:50.797745 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fae2ed-23f6-454f-ad78-b3086e8bcf21 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:50.798017 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fae2ed-23f6-454f-ad78-b3086e8bcf21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:50.798843 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fae2ed-23f6-454f-ad78-b3086e8bcf21 None admin] RBAC: Adding query filter params (group.id=8f23a524ffa445058805d48e211ec189, role.id=c3b3265cd6364fbcb22a731040b7b47a, scope.project.id=3d967b497e5049b1bd80196bde0b33fd) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:50.799149 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fae2ed-23f6-454f-ad78-b3086e8bcf21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:50.800627 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fae2ed-23f6-454f-ad78-b3086e8bcf21 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:50.806723 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 185/380] 10.222.0.65 () {56 vars in 1376 bytes} [Tue May 17 18:03:50 2022] GET /identity/v3/role_assignments?group.id=8f23a524ffa445058805d48e211ec189&scope.project.id=3d967b497e5049b1bd80196bde0b33fd&role.id=c3b3265cd6364fbcb22a731040b7b47a => generated 260 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:03:50.807935 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea240d-ff6a-4b31-a889-84e717cd5119 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:50.808215 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea240d-ff6a-4b31-a889-84e717cd5119 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:50.808486 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea240d-ff6a-4b31-a889-84e717cd5119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:50.826995 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-41ea240d-ff6a-4b31-a889-84e717cd5119 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:03:50.828789 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-41ea240d-ff6a-4b31-a889-84e717cd5119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:03:50.850049 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015009c4-fa8a-47a0-a5c1-9f9d9d1c3a13 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:50.890323 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08038236-7088-4541-a876-56873bb29751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:50.891231 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08038236-7088-4541-a876-56873bb29751 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:50.891642 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08038236-7088-4541-a876-56873bb29751 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:50.892037 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08038236-7088-4541-a876-56873bb29751 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:50.893042 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08038236-7088-4541-a876-56873bb29751 None admin] RBAC: Adding query filter params (group.id=6cdc1d9a8aae4e459182451deb133424, role.id=332c8d70fd0f41e2beea20aaead5daa5, scope.project.id=22a045ecfd2045b79def0497d463b2a3) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:50.893502 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08038236-7088-4541-a876-56873bb29751 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:50.895091 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08038236-7088-4541-a876-56873bb29751 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:50.902831 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 196/381] 10.222.0.65 () {56 vars in 1376 bytes} [Tue May 17 18:03:50 2022] GET /identity/v3/role_assignments?group.id=6cdc1d9a8aae4e459182451deb133424&scope.project.id=22a045ecfd2045b79def0497d463b2a3&role.id=332c8d70fd0f41e2beea20aaead5daa5 => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:50.958093 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 186/382] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:03:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:03:50.982589 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08038236-7088-4541-a876-56873bb29751 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:51.093564 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08038236-7088-4541-a876-56873bb29751 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:51.135170 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a36f60-9acb-4bb8-822e-c45648927499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:51.136213 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a36f60-9acb-4bb8-822e-c45648927499 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:51.136633 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a36f60-9acb-4bb8-822e-c45648927499 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:51.137077 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a36f60-9acb-4bb8-822e-c45648927499 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:51.150109 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a36f60-9acb-4bb8-822e-c45648927499 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:03:51.159046 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-30a36f60-9acb-4bb8-822e-c45648927499 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 18:03:51.159046 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:03:51.159046 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:03:51.159046 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:03:51.159046 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:03:51.159046 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:03:51.159046 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:03:51.159046 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:03:51.159046 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:03:51.159046 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:03:51.159046 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:03:51.159046 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:03:51.159046 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:03:51.159046 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:03:51.159046 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:03:51.159046 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:03:51.160199 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:03:51.160199 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:03:51.160199 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:03:51.160199 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:03:51.160199 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:03:51.160199 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:03:51.160199 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:03:51.160199 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:03:51.160199 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:03:51.160199 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:03:51.160199 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:03:51.160199 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:03:51.160199 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:03:51.160199 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:03:51.160199 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:03:51.160199 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:03:51.161162 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:03:51.161162 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:03:51.161162 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:03:51.161162 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:03:51.161162 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:03:51.161162 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:03:51.161162 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:03:51.161162 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:03:51.161162 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:03:51.161162 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:03:51.161162 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 18:03:51.161162 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:03:51.163196 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 197/383] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 17 18:03:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:03:51.170182 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea240d-ff6a-4b31-a889-84e717cd5119 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:51.281753 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea240d-ff6a-4b31-a889-84e717cd5119 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:51.317090 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1645839-cd00-4630-b877-faf13653e97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:51.318248 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1645839-cd00-4630-b877-faf13653e97b None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:51.318686 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1645839-cd00-4630-b877-faf13653e97b None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:51.319100 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1645839-cd00-4630-b877-faf13653e97b None admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:51.319977 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1645839-cd00-4630-b877-faf13653e97b None admin] RBAC: Adding query filter params (name=member) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:51.320417 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1645839-cd00-4630-b877-faf13653e97b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:51.321962 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1645839-cd00-4630-b877-faf13653e97b None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:51.336647 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 187/384] 10.222.0.65 () {56 vars in 1101 bytes} [Tue May 17 18:03:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:03:51.342326 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a36f60-9acb-4bb8-822e-c45648927499 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:51.461962 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a36f60-9acb-4bb8-822e-c45648927499 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:51.505968 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f117d83-c77f-4d6c-b1a6-c2840a02b1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:51.512233 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f117d83-c77f-4d6c-b1a6-c2840a02b1dd None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:51.512524 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f117d83-c77f-4d6c-b1a6-c2840a02b1dd None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:51.512789 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f117d83-c77f-4d6c-b1a6-c2840a02b1dd None admin] PATH_INFO: `/v3/groups/8f23a524ffa445058805d48e211ec189` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:51.518319 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f117d83-c77f-4d6c-b1a6-c2840a02b1dd None admin] RBAC: Authorizing `identity:get_group(group_id=8f23a524ffa445058805d48e211ec189)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:51.519970 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f117d83-c77f-4d6c-b1a6-c2840a02b1dd None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:51.522037 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 198/385] 10.222.0.65 () {56 vars in 1180 bytes} [Tue May 17 18:03:51 2022] GET /identity/v3/groups/8f23a524ffa445058805d48e211ec189 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:51.527164 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1645839-cd00-4630-b877-faf13653e97b None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:51.668133 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1645839-cd00-4630-b877-faf13653e97b None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:51.708198 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf4541-fa51-4084-83a6-3804602f936e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:51.709388 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf4541-fa51-4084-83a6-3804602f936e None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:51.709883 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf4541-fa51-4084-83a6-3804602f936e None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:51.710370 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf4541-fa51-4084-83a6-3804602f936e None admin] PATH_INFO: `/v3/projects/d7cf4e05380e477d8f7793c92acc9742` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:51.714237 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf4541-fa51-4084-83a6-3804602f936e None admin] RBAC: Authorizing `identity:get_project(project_id=d7cf4e05380e477d8f7793c92acc9742)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:51.716338 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf4541-fa51-4084-83a6-3804602f936e None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:51.718812 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 188/386] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 17 18:03:51 2022] GET /identity/v3/projects/d7cf4e05380e477d8f7793c92acc9742 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:51.724532 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f117d83-c77f-4d6c-b1a6-c2840a02b1dd None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:51.846258 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f117d83-c77f-4d6c-b1a6-c2840a02b1dd None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:51.883872 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308204d-c6cf-4acf-86e9-5b35055bf3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:51.885040 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308204d-c6cf-4acf-86e9-5b35055bf3d1 None admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:51.885589 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308204d-c6cf-4acf-86e9-5b35055bf3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:51.886057 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308204d-c6cf-4acf-86e9-5b35055bf3d1 None admin] PATH_INFO: `/v3/projects/d7cf4e05380e477d8f7793c92acc9742/groups/8f23a524ffa445058805d48e211ec189/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:51.888082 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8308204d-c6cf-4acf-86e9-5b35055bf3d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=d7cf4e05380e477d8f7793c92acc9742, group_id=8f23a524ffa445058805d48e211ec189, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:51.889601 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8308204d-c6cf-4acf-86e9-5b35055bf3d1 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:51.908680 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 199/387] 10.222.0.65 () {58 vars in 1442 bytes} [Tue May 17 18:03:51 2022] PUT /identity/v3/projects/d7cf4e05380e477d8f7793c92acc9742/groups/8f23a524ffa445058805d48e211ec189/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:03:52.622226 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4cc67-296f-403b-b9c0-69274580f3db None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:52.623295 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4cc67-296f-403b-b9c0-69274580f3db None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:52.623771 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4cc67-296f-403b-b9c0-69274580f3db None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:52.625664 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 189/388] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:03:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:03:52.639669 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78cfd3b-2b6c-4e2b-a108-bea186f10e01 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:52.640176 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78cfd3b-2b6c-4e2b-a108-bea186f10e01 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:52.640270 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78cfd3b-2b6c-4e2b-a108-bea186f10e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:52.662639 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-c78cfd3b-2b6c-4e2b-a108-bea186f10e01 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:03:52.663847 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-c78cfd3b-2b6c-4e2b-a108-bea186f10e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:03:52.750452 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 200/389] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:03:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:03:52.794134 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c4cc67-296f-403b-b9c0-69274580f3db None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:52.910005 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c4cc67-296f-403b-b9c0-69274580f3db None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:52.953814 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358262cf-bc46-4016-91cc-43da7a605641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:52.954810 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358262cf-bc46-4016-91cc-43da7a605641 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:52.955286 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358262cf-bc46-4016-91cc-43da7a605641 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:52.955761 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358262cf-bc46-4016-91cc-43da7a605641 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:52.975140 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358262cf-bc46-4016-91cc-43da7a605641 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:03:52.988447 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-358262cf-bc46-4016-91cc-43da7a605641 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 18:03:52.988447 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:03:52.988447 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:03:52.988447 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:03:52.988447 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:03:52.988447 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:03:52.988447 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:03:52.988447 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:03:52.988447 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:03:52.988447 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:03:52.988447 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:03:52.988447 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:03:52.988447 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:03:52.988447 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:03:52.988447 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:03:52.988447 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:03:52.989370 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:03:52.989370 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:03:52.989370 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:03:52.989370 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:03:52.989370 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:03:52.989370 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:03:52.989370 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:03:52.989370 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:03:52.989370 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:03:52.989370 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:03:52.989370 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:03:52.989370 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:03:52.989370 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:03:52.989370 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:03:52.989370 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:03:52.989370 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:03:52.990192 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:03:52.990192 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:03:52.990192 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:03:52.990192 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:03:52.990192 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:03:52.990192 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:03:52.990192 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:03:52.990192 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:03:52.990192 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:03:52.990192 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:03:52.990192 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 18:03:52.990192 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:03:52.993475 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 190/390] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 17 18:03:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:03:52.999063 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78cfd3b-2b6c-4e2b-a108-bea186f10e01 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:53.123517 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78cfd3b-2b6c-4e2b-a108-bea186f10e01 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:53.138763 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb4815-787a-4c23-a784-dfd65019ac7a None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:53.139069 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb4815-787a-4c23-a784-dfd65019ac7a None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:53.139312 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb4815-787a-4c23-a784-dfd65019ac7a None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:53.140847 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 191/391] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:03:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 18:03:53.146689 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416a856-e318-49f8-a58c-0525f10efeda None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:53.147208 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416a856-e318-49f8-a58c-0525f10efeda None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:53.147714 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416a856-e318-49f8-a58c-0525f10efeda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:53.165096 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa8c784-f875-4711-9003-68278924744e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:53.165714 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa8c784-f875-4711-9003-68278924744e None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:53.165996 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa8c784-f875-4711-9003-68278924744e None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:53.166268 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa8c784-f875-4711-9003-68278924744e None admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:53.167076 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa8c784-f875-4711-9003-68278924744e None admin] RBAC: Adding query filter params (name=member) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:53.167383 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa8c784-f875-4711-9003-68278924744e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:53.168240 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-9416a856-e318-49f8-a58c-0525f10efeda None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:03:53.168933 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa8c784-f875-4711-9003-68278924744e None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:53.169925 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-9416a856-e318-49f8-a58c-0525f10efeda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:03:53.180998 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 201/392] 10.222.0.65 () {56 vars in 1101 bytes} [Tue May 17 18:03:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:53.187515 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa8c784-f875-4711-9003-68278924744e None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:53.264166 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 192/393] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:03:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:03:53.299572 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9416a856-e318-49f8-a58c-0525f10efeda None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:53.301100 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa8c784-f875-4711-9003-68278924744e None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:53.346302 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc71321-b95d-4617-a364-73fea3047718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:53.347177 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc71321-b95d-4617-a364-73fea3047718 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:53.347452 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc71321-b95d-4617-a364-73fea3047718 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:53.347719 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc71321-b95d-4617-a364-73fea3047718 None admin] PATH_INFO: `/v3/groups/8f23a524ffa445058805d48e211ec189` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:53.350302 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc71321-b95d-4617-a364-73fea3047718 None admin] RBAC: Authorizing `identity:get_group(group_id=8f23a524ffa445058805d48e211ec189)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:53.352599 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc71321-b95d-4617-a364-73fea3047718 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:53.357053 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 202/394] 10.222.0.65 () {56 vars in 1180 bytes} [Tue May 17 18:03:53 2022] GET /identity/v3/groups/8f23a524ffa445058805d48e211ec189 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:53.367127 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc71321-b95d-4617-a364-73fea3047718 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:53.480768 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9416a856-e318-49f8-a58c-0525f10efeda None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:53.525165 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c919b65a-2166-4d31-bc63-e9df12cc7925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:53.526381 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c919b65a-2166-4d31-bc63-e9df12cc7925 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:53.526857 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c919b65a-2166-4d31-bc63-e9df12cc7925 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:53.527354 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c919b65a-2166-4d31-bc63-e9df12cc7925 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:53.530136 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc71321-b95d-4617-a364-73fea3047718 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:53.543106 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c919b65a-2166-4d31-bc63-e9df12cc7925 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:03:53.556177 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-c919b65a-2166-4d31-bc63-e9df12cc7925 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 18:03:53.556177 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:03:53.556177 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:03:53.556177 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:03:53.556177 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:03:53.556177 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:03:53.556177 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:03:53.556177 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:03:53.556177 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:03:53.556177 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:03:53.556177 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:03:53.556177 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:03:53.556177 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:03:53.556177 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:03:53.556177 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:03:53.556177 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:03:53.557084 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:03:53.557084 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:03:53.557084 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:03:53.557084 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:03:53.557084 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:03:53.557084 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:03:53.557084 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:03:53.557084 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:03:53.557084 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:03:53.557084 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:03:53.557084 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:03:53.557084 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:03:53.557084 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:03:53.557084 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:03:53.557084 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:03:53.557084 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:03:53.557916 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:03:53.557916 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:03:53.557916 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:03:53.557916 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:03:53.557916 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:03:53.557916 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:03:53.557916 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:03:53.557916 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:03:53.557916 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:03:53.557916 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:03:53.557916 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 18:03:53.557916 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:03:53.560577 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 193/395] 10.222.0.65 () {56 vars in 1114 bytes} [Tue May 17 18:03:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:03:53.567016 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c919b65a-2166-4d31-bc63-e9df12cc7925 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:53.580836 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946254f-cc1c-4dca-b7ab-b42ce09e5adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:53.582135 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946254f-cc1c-4dca-b7ab-b42ce09e5adf None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:53.582621 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946254f-cc1c-4dca-b7ab-b42ce09e5adf None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:53.583129 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946254f-cc1c-4dca-b7ab-b42ce09e5adf None admin] PATH_INFO: `/v3/projects/3d967b497e5049b1bd80196bde0b33fd` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:53.586663 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e946254f-cc1c-4dca-b7ab-b42ce09e5adf None admin] RBAC: Authorizing `identity:get_project(project_id=3d967b497e5049b1bd80196bde0b33fd)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:53.588479 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e946254f-cc1c-4dca-b7ab-b42ce09e5adf None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:53.590592 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 203/396] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 17 18:03:53 2022] GET /identity/v3/projects/3d967b497e5049b1bd80196bde0b33fd => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:53.596737 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946254f-cc1c-4dca-b7ab-b42ce09e5adf None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:53.741264 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c919b65a-2166-4d31-bc63-e9df12cc7925 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:53.765340 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946254f-cc1c-4dca-b7ab-b42ce09e5adf None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:53.791669 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9fba91-e022-434e-820f-1411c62f1ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:53.792331 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9fba91-e022-434e-820f-1411c62f1ffe None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:53.792606 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9fba91-e022-434e-820f-1411c62f1ffe None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:53.792874 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9fba91-e022-434e-820f-1411c62f1ffe None admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:53.793663 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9fba91-e022-434e-820f-1411c62f1ffe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:53.793963 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9fba91-e022-434e-820f-1411c62f1ffe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:53.795333 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9fba91-e022-434e-820f-1411c62f1ffe None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:53.804362 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 194/397] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 17 18:03:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:53.809799 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c4614-1df9-418b-889f-e69b3dc2274a None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:53.809799 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c4614-1df9-418b-889f-e69b3dc2274a None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:53.809799 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c4614-1df9-418b-889f-e69b3dc2274a None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:53.809799 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 195/398] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:03:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:03:53.811795 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99c4614-1df9-418b-889f-e69b3dc2274a None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:53.818154 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52976011-ef67-4429-8a9f-0c0bdb558ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:53.819039 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52976011-ef67-4429-8a9f-0c0bdb558ab7 None admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:53.819309 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52976011-ef67-4429-8a9f-0c0bdb558ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:53.819579 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52976011-ef67-4429-8a9f-0c0bdb558ab7 None admin] PATH_INFO: `/v3/projects/3d967b497e5049b1bd80196bde0b33fd/groups/8f23a524ffa445058805d48e211ec189/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:53.821690 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52976011-ef67-4429-8a9f-0c0bdb558ab7 None admin] RBAC: Authorizing `identity:create_grant(project_id=3d967b497e5049b1bd80196bde0b33fd, group_id=8f23a524ffa445058805d48e211ec189, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:53.823130 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52976011-ef67-4429-8a9f-0c0bdb558ab7 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:53.839394 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 204/399] 10.222.0.65 () {58 vars in 1442 bytes} [Tue May 17 18:03:53 2022] PUT /identity/v3/projects/3d967b497e5049b1bd80196bde0b33fd/groups/8f23a524ffa445058805d48e211ec189/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:03:53.841126 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e0707-175d-4dd6-8428-2d6da5b34d76 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:53.841486 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e0707-175d-4dd6-8428-2d6da5b34d76 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:53.842015 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e0707-175d-4dd6-8428-2d6da5b34d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:53.864094 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-778e0707-175d-4dd6-8428-2d6da5b34d76 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:03:53.865762 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-778e0707-175d-4dd6-8428-2d6da5b34d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:03:53.935595 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99c4614-1df9-418b-889f-e69b3dc2274a None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:53.938844 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 205/400] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:03:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:03:53.965900 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778e0707-175d-4dd6-8428-2d6da5b34d76 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:53.983658 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba8525-6cbd-4ea9-a5fb-cbbe96054993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:53.985483 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba8525-6cbd-4ea9-a5fb-cbbe96054993 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:53.985596 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba8525-6cbd-4ea9-a5fb-cbbe96054993 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:53.985988 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba8525-6cbd-4ea9-a5fb-cbbe96054993 None admin] PATH_INFO: `/v3/groups/8f23a524ffa445058805d48e211ec189` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:53.988489 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecba8525-6cbd-4ea9-a5fb-cbbe96054993 None admin] RBAC: Authorizing `identity:get_group(group_id=8f23a524ffa445058805d48e211ec189)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:53.991004 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecba8525-6cbd-4ea9-a5fb-cbbe96054993 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:53.997447 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 196/401] 10.222.0.65 () {56 vars in 1180 bytes} [Tue May 17 18:03:53 2022] GET /identity/v3/groups/8f23a524ffa445058805d48e211ec189 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:54.002237 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba8525-6cbd-4ea9-a5fb-cbbe96054993 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:54.139133 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778e0707-175d-4dd6-8428-2d6da5b34d76 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:54.162414 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba8525-6cbd-4ea9-a5fb-cbbe96054993 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:54.199051 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb08e2e4-c34d-42ed-8c25-93e1cf22da90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:54.199929 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08e2e4-c34d-42ed-8c25-93e1cf22da90 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:54.200210 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08e2e4-c34d-42ed-8c25-93e1cf22da90 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:54.200484 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08e2e4-c34d-42ed-8c25-93e1cf22da90 None admin] PATH_INFO: `/v3/projects/d7cf4e05380e477d8f7793c92acc9742` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:54.202364 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb08e2e4-c34d-42ed-8c25-93e1cf22da90 None admin] RBAC: Authorizing `identity:get_project(project_id=d7cf4e05380e477d8f7793c92acc9742)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:54.203852 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb08e2e4-c34d-42ed-8c25-93e1cf22da90 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:54.205916 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 197/402] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 17 18:03:54 2022] GET /identity/v3/projects/d7cf4e05380e477d8f7793c92acc9742 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:54.207481 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d097c35-da6e-4760-bfdf-7a93e656a499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:54.208319 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d097c35-da6e-4760-bfdf-7a93e656a499 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:54.208600 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d097c35-da6e-4760-bfdf-7a93e656a499 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:54.208873 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d097c35-da6e-4760-bfdf-7a93e656a499 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:54.215336 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb08e2e4-c34d-42ed-8c25-93e1cf22da90 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:54.235086 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d097c35-da6e-4760-bfdf-7a93e656a499 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:03:54.244075 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-2d097c35-da6e-4760-bfdf-7a93e656a499 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 18:03:54.244075 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:03:54.244075 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:03:54.244075 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:03:54.244075 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:03:54.244075 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:03:54.244075 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:03:54.244075 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:03:54.244075 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:03:54.244075 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:03:54.244075 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:03:54.244075 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:03:54.244075 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:03:54.244075 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:03:54.244075 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:03:54.244075 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:03:54.245003 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:03:54.245003 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:03:54.245003 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:03:54.245003 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:03:54.245003 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:03:54.245003 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:03:54.245003 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:03:54.245003 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:03:54.245003 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:03:54.245003 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:03:54.245003 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:03:54.245003 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:03:54.245003 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:03:54.245003 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:03:54.245003 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:03:54.245003 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:03:54.245847 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:03:54.245847 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:03:54.245847 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:03:54.245847 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:03:54.245847 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:03:54.245847 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:03:54.245847 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:03:54.245847 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:03:54.245847 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:03:54.245847 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:03:54.245847 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 18:03:54.245847 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:03:54.245847 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 206/403] 10.222.0.65 () {56 vars in 1114 bytes} [Tue May 17 18:03:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:03:54.253540 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d097c35-da6e-4760-bfdf-7a93e656a499 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:54.356637 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb08e2e4-c34d-42ed-8c25-93e1cf22da90 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:54.391392 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb41ac-427d-465c-8c4c-e40ce87a37b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:54.392268 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb41ac-427d-465c-8c4c-e40ce87a37b3 None admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:54.392549 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb41ac-427d-465c-8c4c-e40ce87a37b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:54.392823 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb41ac-427d-465c-8c4c-e40ce87a37b3 None admin] PATH_INFO: `/v3/projects/d7cf4e05380e477d8f7793c92acc9742/groups/8f23a524ffa445058805d48e211ec189/roles/c3b3265cd6364fbcb22a731040b7b47a` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:54.395128 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdb41ac-427d-465c-8c4c-e40ce87a37b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=d7cf4e05380e477d8f7793c92acc9742, group_id=8f23a524ffa445058805d48e211ec189, role_id=c3b3265cd6364fbcb22a731040b7b47a)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:54.396567 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdb41ac-427d-465c-8c4c-e40ce87a37b3 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:54.414605 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 198/404] 10.222.0.65 () {58 vars in 1442 bytes} [Tue May 17 18:03:54 2022] PUT /identity/v3/projects/d7cf4e05380e477d8f7793c92acc9742/groups/8f23a524ffa445058805d48e211ec189/roles/c3b3265cd6364fbcb22a731040b7b47a => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:03:54.422402 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d097c35-da6e-4760-bfdf-7a93e656a499 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:54.452889 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c91a7-a91a-46fb-ada0-5a9a2fcf559d None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:54.453230 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c91a7-a91a-46fb-ada0-5a9a2fcf559d None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:54.453411 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c91a7-a91a-46fb-ada0-5a9a2fcf559d None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:54.455097 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 199/405] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:03:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 18:03:54.460519 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c718168b-6e19-45ac-854a-b37cedb5fa7d None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:54.460798 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e976f51-1e63-4d04-91d8-4e3ced3f24cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:54.460973 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c718168b-6e19-45ac-854a-b37cedb5fa7d None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:54.461209 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c718168b-6e19-45ac-854a-b37cedb5fa7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:54.461378 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e976f51-1e63-4d04-91d8-4e3ced3f24cc None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:54.461695 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e976f51-1e63-4d04-91d8-4e3ced3f24cc None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:54.461969 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e976f51-1e63-4d04-91d8-4e3ced3f24cc None admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:54.462721 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e976f51-1e63-4d04-91d8-4e3ced3f24cc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:54.463026 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e976f51-1e63-4d04-91d8-4e3ced3f24cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:54.464521 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e976f51-1e63-4d04-91d8-4e3ced3f24cc None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:54.475940 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 207/406] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 17 18:03:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:54.478219 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-c718168b-6e19-45ac-854a-b37cedb5fa7d None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:03:54.479485 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-c718168b-6e19-45ac-854a-b37cedb5fa7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:03:54.484317 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e976f51-1e63-4d04-91d8-4e3ced3f24cc None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:54.603888 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 200/407] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:03:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 18:03:54.609748 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e976f51-1e63-4d04-91d8-4e3ced3f24cc None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:54.643218 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c718168b-6e19-45ac-854a-b37cedb5fa7d None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:54.650192 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77163ef-a78b-4c90-b6ab-8cacb196112b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:54.650828 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77163ef-a78b-4c90-b6ab-8cacb196112b None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:54.651113 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77163ef-a78b-4c90-b6ab-8cacb196112b None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:54.651388 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77163ef-a78b-4c90-b6ab-8cacb196112b None admin] PATH_INFO: `/v3/groups/8f23a524ffa445058805d48e211ec189` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:54.652732 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77163ef-a78b-4c90-b6ab-8cacb196112b None admin] RBAC: Authorizing `identity:get_group(group_id=8f23a524ffa445058805d48e211ec189)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:54.654260 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77163ef-a78b-4c90-b6ab-8cacb196112b None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:54.656858 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 208/408] 10.222.0.65 () {56 vars in 1180 bytes} [Tue May 17 18:03:54 2022] GET /identity/v3/groups/8f23a524ffa445058805d48e211ec189 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:54.663635 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77163ef-a78b-4c90-b6ab-8cacb196112b None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:54.776563 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c718168b-6e19-45ac-854a-b37cedb5fa7d None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:54.777559 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77163ef-a78b-4c90-b6ab-8cacb196112b None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:54.811732 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f72d5-72c6-44ca-af7c-c8f1880d0d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:54.812376 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f72d5-72c6-44ca-af7c-c8f1880d0d15 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:54.812657 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f72d5-72c6-44ca-af7c-c8f1880d0d15 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:54.812931 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f72d5-72c6-44ca-af7c-c8f1880d0d15 None admin] PATH_INFO: `/v3/projects/3d967b497e5049b1bd80196bde0b33fd` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:54.814199 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f72d5-72c6-44ca-af7c-c8f1880d0d15 None admin] RBAC: Authorizing `identity:get_project(project_id=3d967b497e5049b1bd80196bde0b33fd)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:54.815844 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f72d5-72c6-44ca-af7c-c8f1880d0d15 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:54.818119 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 209/409] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 17 18:03:54 2022] GET /identity/v3/projects/3d967b497e5049b1bd80196bde0b33fd => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:03:54.826372 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f72d5-72c6-44ca-af7c-c8f1880d0d15 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:54.830134 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2cad01-3abe-4184-9e49-5a88c4842c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:54.830935 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2cad01-3abe-4184-9e49-5a88c4842c1c None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:54.831610 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2cad01-3abe-4184-9e49-5a88c4842c1c None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:54.831885 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2cad01-3abe-4184-9e49-5a88c4842c1c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:54.851867 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2cad01-3abe-4184-9e49-5a88c4842c1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:03:54.865132 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-3a2cad01-3abe-4184-9e49-5a88c4842c1c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:03:54.865132 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:03:54.865132 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:03:54.865132 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:03:54.865132 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:03:54.865132 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:03:54.865132 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:03:54.865132 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:03:54.865132 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:03:54.865132 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:03:54.865132 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:03:54.865132 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:03:54.865132 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:03:54.865132 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:03:54.865132 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:03:54.865132 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:03:54.866081 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:03:54.866081 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:03:54.866081 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:03:54.866081 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:03:54.866081 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:03:54.866081 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:03:54.866081 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:03:54.866081 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:03:54.866081 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:03:54.866081 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:03:54.866081 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:03:54.866081 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:03:54.866081 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:03:54.866081 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:03:54.866081 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:03:54.866081 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:03:54.866885 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:03:54.866885 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:03:54.866885 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:03:54.866885 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:03:54.866885 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:03:54.866885 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:03:54.866885 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:03:54.866885 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:03:54.866885 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:03:54.866885 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:03:54.866885 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:03:54.866885 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:03:54.867484 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 201/410] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 17 18:03:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:03:54.870124 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c206802-4aed-4c02-bda7-3b65be788da0 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:54.870628 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c206802-4aed-4c02-bda7-3b65be788da0 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:54.871539 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c206802-4aed-4c02-bda7-3b65be788da0 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:54.873638 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 202/411] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:03:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:03:54.875541 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c206802-4aed-4c02-bda7-3b65be788da0 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:54.963852 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f72d5-72c6-44ca-af7c-c8f1880d0d15 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:54.999794 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a1ce1-2e20-4d57-8add-b0402cd78bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:55.000680 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a1ce1-2e20-4d57-8add-b0402cd78bf2 None admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:55.000968 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a1ce1-2e20-4d57-8add-b0402cd78bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:55.001246 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a1ce1-2e20-4d57-8add-b0402cd78bf2 None admin] PATH_INFO: `/v3/projects/3d967b497e5049b1bd80196bde0b33fd/groups/8f23a524ffa445058805d48e211ec189/roles/c3b3265cd6364fbcb22a731040b7b47a` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:55.003579 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3a1ce1-2e20-4d57-8add-b0402cd78bf2 None admin] RBAC: Authorizing `identity:create_grant(project_id=3d967b497e5049b1bd80196bde0b33fd, group_id=8f23a524ffa445058805d48e211ec189, role_id=c3b3265cd6364fbcb22a731040b7b47a)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:55.005348 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3a1ce1-2e20-4d57-8add-b0402cd78bf2 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:55.005782 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c206802-4aed-4c02-bda7-3b65be788da0 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:55.020771 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 210/412] 10.222.0.65 () {58 vars in 1442 bytes} [Tue May 17 18:03:54 2022] PUT /identity/v3/projects/3d967b497e5049b1bd80196bde0b33fd/groups/8f23a524ffa445058805d48e211ec189/roles/c3b3265cd6364fbcb22a731040b7b47a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:03:55.022201 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1dd77b-cbe7-41eb-be46-a1fc3d30738d None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:55.022546 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1dd77b-cbe7-41eb-be46-a1fc3d30738d None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:55.022830 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1dd77b-cbe7-41eb-be46-a1fc3d30738d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:55.040492 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-ff1dd77b-cbe7-41eb-be46-a1fc3d30738d None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:03:55.041768 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-ff1dd77b-cbe7-41eb-be46-a1fc3d30738d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:03:55.062488 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f50d11-827d-4c8c-b4c3-a40e1b5aa57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:55.063165 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f50d11-827d-4c8c-b4c3-a40e1b5aa57c None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:55.063494 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f50d11-827d-4c8c-b4c3-a40e1b5aa57c None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:55.063764 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f50d11-827d-4c8c-b4c3-a40e1b5aa57c None admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:55.064512 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f50d11-827d-4c8c-b4c3-a40e1b5aa57c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:55.064860 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f50d11-827d-4c8c-b4c3-a40e1b5aa57c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:55.066328 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f50d11-827d-4c8c-b4c3-a40e1b5aa57c None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:55.084605 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 203/413] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 17 18:03:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:55.089906 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f50d11-827d-4c8c-b4c3-a40e1b5aa57c None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:55.120852 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 211/414] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:03:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:03:55.146547 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1dd77b-cbe7-41eb-be46-a1fc3d30738d None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:55.260907 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1dd77b-cbe7-41eb-be46-a1fc3d30738d None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:55.296008 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f50d11-827d-4c8c-b4c3-a40e1b5aa57c None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:55.304477 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a030ab25-5a62-45fd-ae41-e9b44e9b9b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:55.305283 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030ab25-5a62-45fd-ae41-e9b44e9b9b07 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:55.306165 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030ab25-5a62-45fd-ae41-e9b44e9b9b07 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:55.306443 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a030ab25-5a62-45fd-ae41-e9b44e9b9b07 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:55.320445 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a030ab25-5a62-45fd-ae41-e9b44e9b9b07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:03:55.331296 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-a030ab25-5a62-45fd-ae41-e9b44e9b9b07 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 18:03:55.331296 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:03:55.331296 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:03:55.331296 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:03:55.331296 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:03:55.331296 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:03:55.331296 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:03:55.331296 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:03:55.331296 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:03:55.331296 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:03:55.331296 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:03:55.331296 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:03:55.331296 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:03:55.331296 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:03:55.331296 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:03:55.331296 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:03:55.332176 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:03:55.332176 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:03:55.332176 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:03:55.332176 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:03:55.332176 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:03:55.332176 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:03:55.332176 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:03:55.332176 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:03:55.332176 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:03:55.332176 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:03:55.332176 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:03:55.332176 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:03:55.332176 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:03:55.332176 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:03:55.332176 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:03:55.332176 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:03:55.332956 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:03:55.332956 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:03:55.332956 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:03:55.332956 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:03:55.332956 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:03:55.332956 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:03:55.332956 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:03:55.332956 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:03:55.332956 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:03:55.332956 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:03:55.332956 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 18:03:55.332956 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:03:55.336274 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05ca600-64fe-460a-9665-ed67d8b1cc69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:55.337126 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ca600-64fe-460a-9665-ed67d8b1cc69 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:55.337400 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ca600-64fe-460a-9665-ed67d8b1cc69 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:55.337590 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 212/415] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 17 18:03:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:03:55.337746 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ca600-64fe-460a-9665-ed67d8b1cc69 None admin] PATH_INFO: `/v3/groups/6cdc1d9a8aae4e459182451deb133424` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:55.338998 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05ca600-64fe-460a-9665-ed67d8b1cc69 None admin] RBAC: Authorizing `identity:get_group(group_id=6cdc1d9a8aae4e459182451deb133424)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:55.339183 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a030ab25-5a62-45fd-ae41-e9b44e9b9b07 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:55.340505 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05ca600-64fe-460a-9665-ed67d8b1cc69 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:55.342368 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 204/416] 10.222.0.65 () {56 vars in 1180 bytes} [Tue May 17 18:03:55 2022] GET /identity/v3/groups/6cdc1d9a8aae4e459182451deb133424 => generated 229 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:03:55.348989 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05ca600-64fe-460a-9665-ed67d8b1cc69 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:55.454201 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05ca600-64fe-460a-9665-ed67d8b1cc69 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:55.479364 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a030ab25-5a62-45fd-ae41-e9b44e9b9b07 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:55.488400 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce9210-7a45-4688-88c4-67c8bbd92661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:55.489570 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce9210-7a45-4688-88c4-67c8bbd92661 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:55.490041 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce9210-7a45-4688-88c4-67c8bbd92661 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:55.490544 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce9210-7a45-4688-88c4-67c8bbd92661 None admin] PATH_INFO: `/v3/projects/22a045ecfd2045b79def0497d463b2a3` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:55.491917 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce9210-7a45-4688-88c4-67c8bbd92661 None admin] RBAC: Authorizing `identity:get_project(project_id=22a045ecfd2045b79def0497d463b2a3)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:55.493563 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce9210-7a45-4688-88c4-67c8bbd92661 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:55.495451 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 205/417] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 17 18:03:55 2022] GET /identity/v3/projects/22a045ecfd2045b79def0497d463b2a3 => generated 344 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:55.506373 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce9210-7a45-4688-88c4-67c8bbd92661 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:55.528426 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187e55f2-c43d-435a-8b6b-1b2d8b2fadf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:55.528742 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e55f2-c43d-435a-8b6b-1b2d8b2fadf0 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:55.528921 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e55f2-c43d-435a-8b6b-1b2d8b2fadf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:55.529190 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e55f2-c43d-435a-8b6b-1b2d8b2fadf0 None admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:55.529966 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187e55f2-c43d-435a-8b6b-1b2d8b2fadf0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:55.530296 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187e55f2-c43d-435a-8b6b-1b2d8b2fadf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:55.534821 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187e55f2-c43d-435a-8b6b-1b2d8b2fadf0 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:55.552064 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 213/418] 10.222.0.65 () {56 vars in 1101 bytes} [Tue May 17 18:03:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:03:55.559407 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187e55f2-c43d-435a-8b6b-1b2d8b2fadf0 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:55.677416 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce9210-7a45-4688-88c4-67c8bbd92661 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:55.731440 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187e55f2-c43d-435a-8b6b-1b2d8b2fadf0 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:55.740894 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e955c96d-f845-4273-ba16-4986ddd4d902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:55.741825 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955c96d-f845-4273-ba16-4986ddd4d902 None admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:55.742095 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955c96d-f845-4273-ba16-4986ddd4d902 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:55.742361 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955c96d-f845-4273-ba16-4986ddd4d902 None admin] PATH_INFO: `/v3/projects/22a045ecfd2045b79def0497d463b2a3/groups/6cdc1d9a8aae4e459182451deb133424/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:55.744324 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e955c96d-f845-4273-ba16-4986ddd4d902 None admin] RBAC: Authorizing `identity:create_grant(project_id=22a045ecfd2045b79def0497d463b2a3, group_id=6cdc1d9a8aae4e459182451deb133424, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:55.745787 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e955c96d-f845-4273-ba16-4986ddd4d902 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:55.764041 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 206/419] 10.222.0.65 () {58 vars in 1442 bytes} [Tue May 17 18:03:55 2022] PUT /identity/v3/projects/22a045ecfd2045b79def0497d463b2a3/groups/6cdc1d9a8aae4e459182451deb133424/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:03:55.782448 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00758670-7fd9-4b53-8fb7-72dbe9f0b17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:55.783220 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00758670-7fd9-4b53-8fb7-72dbe9f0b17e None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:55.783540 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00758670-7fd9-4b53-8fb7-72dbe9f0b17e None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:55.783867 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00758670-7fd9-4b53-8fb7-72dbe9f0b17e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:55.882755 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00758670-7fd9-4b53-8fb7-72dbe9f0b17e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:55.884212 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00758670-7fd9-4b53-8fb7-72dbe9f0b17e None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:55.998776 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 214/420] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 17 18:03:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 18:03:56.000170 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e955c96d-f845-4273-ba16-4986ddd4d902 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:56.109413 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e955c96d-f845-4273-ba16-4986ddd4d902 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:56.144418 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e9d82-7aa3-4876-8d16-e8610aaf341e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:56.145269 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e9d82-7aa3-4876-8d16-e8610aaf341e None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:56.145581 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e9d82-7aa3-4876-8d16-e8610aaf341e None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:56.145855 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e9d82-7aa3-4876-8d16-e8610aaf341e None admin] PATH_INFO: `/v3/projects/d7cf4e05380e477d8f7793c92acc9742` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:56.147046 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6e9d82-7aa3-4876-8d16-e8610aaf341e None admin] RBAC: Authorizing `identity:get_project(project_id=d7cf4e05380e477d8f7793c92acc9742)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:56.148479 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6e9d82-7aa3-4876-8d16-e8610aaf341e None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:56.154640 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 207/421] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 17 18:03:55 2022] GET /identity/v3/projects/d7cf4e05380e477d8f7793c92acc9742 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:56.156645 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00758670-7fd9-4b53-8fb7-72dbe9f0b17e None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:56.273178 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00758670-7fd9-4b53-8fb7-72dbe9f0b17e None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:56.319288 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4921b298-c9d4-44db-b978-7860c2cfd11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:56.320163 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921b298-c9d4-44db-b978-7860c2cfd11e None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:56.320445 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921b298-c9d4-44db-b978-7860c2cfd11e None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:56.320722 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921b298-c9d4-44db-b978-7860c2cfd11e None admin] PATH_INFO: `/v3/groups/8f23a524ffa445058805d48e211ec189` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:56.321967 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4921b298-c9d4-44db-b978-7860c2cfd11e None admin] RBAC: Authorizing `identity:get_group(group_id=8f23a524ffa445058805d48e211ec189)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:56.323415 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4921b298-c9d4-44db-b978-7860c2cfd11e None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:56.325217 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 215/422] 10.222.0.65 () {56 vars in 1180 bytes} [Tue May 17 18:03:56 2022] GET /identity/v3/groups/8f23a524ffa445058805d48e211ec189 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:56.331623 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e9d82-7aa3-4876-8d16-e8610aaf341e None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:56.440723 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e9d82-7aa3-4876-8d16-e8610aaf341e None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:56.474716 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e97550-7beb-463b-863c-776ab249b9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:56.475375 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e97550-7beb-463b-863c-776ab249b9b7 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:56.475655 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e97550-7beb-463b-863c-776ab249b9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:56.475929 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e97550-7beb-463b-863c-776ab249b9b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:56.476764 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e97550-7beb-463b-863c-776ab249b9b7 None admin] RBAC: Adding query filter params (group.id=8f23a524ffa445058805d48e211ec189, role.id=2af599fd3ad74031901ea2d9e0408884, scope.project.id=d7cf4e05380e477d8f7793c92acc9742) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:56.477073 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e97550-7beb-463b-863c-776ab249b9b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:56.478548 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e97550-7beb-463b-863c-776ab249b9b7 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:56.488792 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 208/423] 10.222.0.65 () {56 vars in 1376 bytes} [Tue May 17 18:03:56 2022] GET /identity/v3/role_assignments?group.id=8f23a524ffa445058805d48e211ec189&scope.project.id=d7cf4e05380e477d8f7793c92acc9742&role.id=2af599fd3ad74031901ea2d9e0408884 => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:56.530021 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ab624-35da-4018-9f29-8859624f8a44 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:56.530336 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ab624-35da-4018-9f29-8859624f8a44 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:56.530502 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ab624-35da-4018-9f29-8859624f8a44 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:56.532128 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 216/424] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:03:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:03:56.539061 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af18ba-9f6f-4bbd-a755-10be24706f19 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:56.539355 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af18ba-9f6f-4bbd-a755-10be24706f19 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:56.539638 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af18ba-9f6f-4bbd-a755-10be24706f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:56.562061 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-53af18ba-9f6f-4bbd-a755-10be24706f19 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:03:56.563263 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-53af18ba-9f6f-4bbd-a755-10be24706f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:03:56.649564 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 209/425] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:03:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:03:56.681397 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4ab624-35da-4018-9f29-8859624f8a44 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:56.818163 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4ab624-35da-4018-9f29-8859624f8a44 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:56.856011 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827024a7-89be-455c-8801-ee0d392abde4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:56.856814 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827024a7-89be-455c-8801-ee0d392abde4 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:56.857096 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827024a7-89be-455c-8801-ee0d392abde4 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:56.857392 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827024a7-89be-455c-8801-ee0d392abde4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:56.869274 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827024a7-89be-455c-8801-ee0d392abde4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:03:56.877628 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-827024a7-89be-455c-8801-ee0d392abde4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 18:03:56.877628 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:03:56.877628 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:03:56.877628 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:03:56.877628 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:03:56.877628 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:03:56.877628 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:03:56.877628 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:03:56.877628 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:03:56.877628 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:03:56.877628 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:03:56.877628 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:03:56.877628 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:03:56.877628 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:03:56.877628 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:03:56.877628 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:03:56.878578 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:03:56.878578 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:03:56.878578 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:03:56.878578 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:03:56.878578 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:03:56.878578 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:03:56.878578 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:03:56.878578 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:03:56.878578 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:03:56.878578 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:03:56.878578 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:03:56.878578 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:03:56.878578 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:03:56.878578 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:03:56.878578 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:03:56.878578 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:03:56.879363 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:03:56.879363 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:03:56.879363 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:03:56.879363 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:03:56.879363 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:03:56.879363 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:03:56.879363 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:03:56.879363 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:03:56.879363 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:03:56.879363 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:03:56.879363 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 18:03:56.879363 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:03:56.879363 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 217/426] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 17 18:03:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:03:56.884882 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af18ba-9f6f-4bbd-a755-10be24706f19 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:57.001482 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af18ba-9f6f-4bbd-a755-10be24706f19 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:57.046268 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60741450-62a6-4dc5-8bea-959905024d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:57.046957 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60741450-62a6-4dc5-8bea-959905024d84 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:57.047235 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60741450-62a6-4dc5-8bea-959905024d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:57.047502 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60741450-62a6-4dc5-8bea-959905024d84 None admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:57.048281 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60741450-62a6-4dc5-8bea-959905024d84 None admin] RBAC: Adding query filter params (name=member) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:57.048564 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60741450-62a6-4dc5-8bea-959905024d84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:57.050033 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60741450-62a6-4dc5-8bea-959905024d84 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:57.060372 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 210/427] 10.222.0.65 () {56 vars in 1101 bytes} [Tue May 17 18:03:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:57.066642 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827024a7-89be-455c-8801-ee0d392abde4 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:57.193401 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827024a7-89be-455c-8801-ee0d392abde4 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:57.231590 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6e3a8-f2ab-4791-8229-fc55756b69e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:57.232249 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6e3a8-f2ab-4791-8229-fc55756b69e2 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:57.232527 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6e3a8-f2ab-4791-8229-fc55756b69e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:57.232804 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6e3a8-f2ab-4791-8229-fc55756b69e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:57.273130 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0fcc5-8abe-4bf5-b7e2-ef83aa883b45 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:57.273528 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0fcc5-8abe-4bf5-b7e2-ef83aa883b45 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:57.273902 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0fcc5-8abe-4bf5-b7e2-ef83aa883b45 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:57.275521 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 211/428] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:03:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 18:03:57.283268 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee4f17-84d2-4a1e-b578-04dadd74354c None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:57.283573 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee4f17-84d2-4a1e-b578-04dadd74354c None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:57.283956 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ee4f17-84d2-4a1e-b578-04dadd74354c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:57.306233 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-e6ee4f17-84d2-4a1e-b578-04dadd74354c None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:03:57.307854 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-e6ee4f17-84d2-4a1e-b578-04dadd74354c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:03:57.323817 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f6e3a8-f2ab-4791-8229-fc55756b69e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:57.325590 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f6e3a8-f2ab-4791-8229-fc55756b69e2 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:57.395627 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 212/429] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:03:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 18:03:57.422680 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ee4f17-84d2-4a1e-b578-04dadd74354c None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:57.441648 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 218/430] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 17 18:03:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 18:03:57.447851 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6e3a8-f2ab-4791-8229-fc55756b69e2 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:57.541521 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ee4f17-84d2-4a1e-b578-04dadd74354c None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:57.551882 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6e3a8-f2ab-4791-8229-fc55756b69e2 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:57.587100 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b375a050-ae77-444d-8767-d39a18562f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:57.588174 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375a050-ae77-444d-8767-d39a18562f82 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:57.588451 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375a050-ae77-444d-8767-d39a18562f82 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:57.588722 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b375a050-ae77-444d-8767-d39a18562f82 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:57.599020 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0a4c6-e116-4bc5-8e64-c1429dc3bb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:57.600158 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0a4c6-e116-4bc5-8e64-c1429dc3bb29 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:57.600660 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0a4c6-e116-4bc5-8e64-c1429dc3bb29 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:57.601130 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0a4c6-e116-4bc5-8e64-c1429dc3bb29 None admin] PATH_INFO: `/v3/projects/3d967b497e5049b1bd80196bde0b33fd` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:57.602477 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b375a050-ae77-444d-8767-d39a18562f82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:03:57.602769 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c0a4c6-e116-4bc5-8e64-c1429dc3bb29 None admin] RBAC: Authorizing `identity:get_project(project_id=3d967b497e5049b1bd80196bde0b33fd)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:57.604434 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c0a4c6-e116-4bc5-8e64-c1429dc3bb29 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:57.611422 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-b375a050-ae77-444d-8767-d39a18562f82 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 18:03:57.611422 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:03:57.611422 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:03:57.611422 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:03:57.611422 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:03:57.611422 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:03:57.611422 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:03:57.611422 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:03:57.611422 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:03:57.611422 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:03:57.611422 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:03:57.611422 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:03:57.611422 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:03:57.611422 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:03:57.611422 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:03:57.611422 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:03:57.612335 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:03:57.612335 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:03:57.612335 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:03:57.612335 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:03:57.612335 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:03:57.612335 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:03:57.612335 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:03:57.612335 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:03:57.612335 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:03:57.612335 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:03:57.612335 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:03:57.612335 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:03:57.612335 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:03:57.612335 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:03:57.612335 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:03:57.612335 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:03:57.613146 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:03:57.613146 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:03:57.613146 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:03:57.613146 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:03:57.613146 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:03:57.613146 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:03:57.613146 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:03:57.613146 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:03:57.613146 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:03:57.613146 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:03:57.613146 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 18:03:57.613146 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:03:57.613146 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 213/432] 10.222.0.65 () {56 vars in 1114 bytes} [Tue May 17 18:03:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:03:57.614466 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 219/432] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 17 18:03:57 2022] GET /identity/v3/projects/3d967b497e5049b1bd80196bde0b33fd => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:57.618200 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b375a050-ae77-444d-8767-d39a18562f82 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:57.622831 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0a4c6-e116-4bc5-8e64-c1429dc3bb29 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:57.738179 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b375a050-ae77-444d-8767-d39a18562f82 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:57.741439 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0a4c6-e116-4bc5-8e64-c1429dc3bb29 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:57.772491 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06502756-3dc9-4c7f-993c-279a4c4fdb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:57.773990 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06502756-3dc9-4c7f-993c-279a4c4fdb16 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:57.774555 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06502756-3dc9-4c7f-993c-279a4c4fdb16 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:57.775084 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06502756-3dc9-4c7f-993c-279a4c4fdb16 None admin] PATH_INFO: `/v3/groups/8f23a524ffa445058805d48e211ec189` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:57.775517 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9327a71-76c9-46a5-8bee-12c18695c5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:57.776266 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9327a71-76c9-46a5-8bee-12c18695c5af None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:57.776614 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9327a71-76c9-46a5-8bee-12c18695c5af None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:57.776955 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9327a71-76c9-46a5-8bee-12c18695c5af None admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:57.777389 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06502756-3dc9-4c7f-993c-279a4c4fdb16 None admin] RBAC: Authorizing `identity:get_group(group_id=8f23a524ffa445058805d48e211ec189)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:57.777943 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9327a71-76c9-46a5-8bee-12c18695c5af None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:57.778310 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9327a71-76c9-46a5-8bee-12c18695c5af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:57.779589 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06502756-3dc9-4c7f-993c-279a4c4fdb16 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:57.780449 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9327a71-76c9-46a5-8bee-12c18695c5af None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:57.782368 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 214/433] 10.222.0.65 () {56 vars in 1180 bytes} [Tue May 17 18:03:57 2022] GET /identity/v3/groups/8f23a524ffa445058805d48e211ec189 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:57.788329 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06502756-3dc9-4c7f-993c-279a4c4fdb16 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:57.793399 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 220/434] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 17 18:03:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:03:57.799839 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9327a71-76c9-46a5-8bee-12c18695c5af None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:57.910057 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9327a71-76c9-46a5-8bee-12c18695c5af None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:57.922411 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06502756-3dc9-4c7f-993c-279a4c4fdb16 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:57.952878 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b553d6-581f-4edc-8c3c-55c70acc1bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:57.953562 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b553d6-581f-4edc-8c3c-55c70acc1bc5 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:57.953842 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b553d6-581f-4edc-8c3c-55c70acc1bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:57.954114 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b553d6-581f-4edc-8c3c-55c70acc1bc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:57.957125 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f9ce70-148d-453b-a7c7-f6ebdc9d1152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:57.958025 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9ce70-148d-453b-a7c7-f6ebdc9d1152 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:57.958525 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9ce70-148d-453b-a7c7-f6ebdc9d1152 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:57.959005 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f9ce70-148d-453b-a7c7-f6ebdc9d1152 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:57.960030 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f9ce70-148d-453b-a7c7-f6ebdc9d1152 None admin] RBAC: Adding query filter params (group.id=8f23a524ffa445058805d48e211ec189, role.id=2af599fd3ad74031901ea2d9e0408884, scope.project.id=3d967b497e5049b1bd80196bde0b33fd) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:57.960558 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f9ce70-148d-453b-a7c7-f6ebdc9d1152 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:57.962222 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f9ce70-148d-453b-a7c7-f6ebdc9d1152 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:57.973851 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 215/435] 10.222.0.65 () {56 vars in 1376 bytes} [Tue May 17 18:03:57 2022] GET /identity/v3/role_assignments?group.id=8f23a524ffa445058805d48e211ec189&scope.project.id=3d967b497e5049b1bd80196bde0b33fd&role.id=2af599fd3ad74031901ea2d9e0408884 => generated 611 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:57.986557 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e065fb5-e12f-4c70-b324-966f72512458 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:57.986859 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e065fb5-e12f-4c70-b324-966f72512458 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:57.987120 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e065fb5-e12f-4c70-b324-966f72512458 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:57.993005 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 216/436] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:03:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 18:03:57.994455 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89105692-e258-4f73-a540-8600c2cd53c3 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:57.994747 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89105692-e258-4f73-a540-8600c2cd53c3 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:57.995032 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89105692-e258-4f73-a540-8600c2cd53c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:58.015235 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-89105692-e258-4f73-a540-8600c2cd53c3 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:03:58.016505 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-89105692-e258-4f73-a540-8600c2cd53c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:03:58.036756 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b553d6-581f-4edc-8c3c-55c70acc1bc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:58.038936 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b553d6-581f-4edc-8c3c-55c70acc1bc5 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:58.090937 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 217/437] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:03:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:03:58.115478 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89105692-e258-4f73-a540-8600c2cd53c3 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:58.171285 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 221/438] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 17 18:03:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 17 18:03:58.176743 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b553d6-581f-4edc-8c3c-55c70acc1bc5 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:58.238080 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89105692-e258-4f73-a540-8600c2cd53c3 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:58.281241 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2139e-89d4-4c81-9ea5-6d81e3d1373e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:58.282032 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2139e-89d4-4c81-9ea5-6d81e3d1373e None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:58.282307 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2139e-89d4-4c81-9ea5-6d81e3d1373e None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:58.282613 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd2139e-89d4-4c81-9ea5-6d81e3d1373e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:58.290366 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b553d6-581f-4edc-8c3c-55c70acc1bc5 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:58.293080 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd2139e-89d4-4c81-9ea5-6d81e3d1373e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:03:58.301815 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-1cd2139e-89d4-4c81-9ea5-6d81e3d1373e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 18:03:58.301815 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:03:58.301815 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:03:58.301815 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:03:58.301815 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:03:58.301815 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:03:58.301815 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:03:58.301815 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:03:58.301815 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:03:58.301815 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:03:58.301815 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:03:58.301815 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:03:58.301815 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:03:58.301815 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:03:58.301815 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:03:58.301815 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:03:58.302714 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:03:58.302714 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:03:58.302714 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:03:58.302714 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:03:58.302714 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:03:58.302714 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:03:58.302714 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:03:58.302714 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:03:58.302714 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:03:58.302714 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:03:58.302714 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:03:58.302714 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:03:58.302714 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:03:58.302714 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:03:58.302714 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:03:58.302714 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:03:58.303502 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:03:58.303502 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:03:58.303502 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:03:58.303502 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:03:58.303502 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:03:58.303502 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:03:58.303502 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:03:58.303502 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:03:58.303502 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:03:58.303502 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:03:58.303502 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 18:03:58.303502 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:03:58.303502 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 218/439] 10.222.0.65 () {56 vars in 1114 bytes} [Tue May 17 18:03:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:03:58.308585 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2139e-89d4-4c81-9ea5-6d81e3d1373e None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:58.328437 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cd0603-d4ad-46ff-b8a0-461951d5dc01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:58.329276 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd0603-d4ad-46ff-b8a0-461951d5dc01 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:58.329577 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd0603-d4ad-46ff-b8a0-461951d5dc01 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:58.329851 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd0603-d4ad-46ff-b8a0-461951d5dc01 None admin] PATH_INFO: `/v3/projects/d7cf4e05380e477d8f7793c92acc9742` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:58.331031 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cd0603-d4ad-46ff-b8a0-461951d5dc01 None admin] RBAC: Authorizing `identity:get_project(project_id=d7cf4e05380e477d8f7793c92acc9742)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:58.332445 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cd0603-d4ad-46ff-b8a0-461951d5dc01 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:58.334286 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 222/440] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 17 18:03:58 2022] GET /identity/v3/projects/d7cf4e05380e477d8f7793c92acc9742 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:03:58.339337 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cd0603-d4ad-46ff-b8a0-461951d5dc01 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:58.405319 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd2139e-89d4-4c81-9ea5-6d81e3d1373e None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:58.438053 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d594c64-8a30-4f29-9e40-9dfdc7f4c181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:58.438709 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d594c64-8a30-4f29-9e40-9dfdc7f4c181 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:58.438989 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d594c64-8a30-4f29-9e40-9dfdc7f4c181 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:58.439252 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d594c64-8a30-4f29-9e40-9dfdc7f4c181 None admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:58.439991 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d594c64-8a30-4f29-9e40-9dfdc7f4c181 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:58.440287 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d594c64-8a30-4f29-9e40-9dfdc7f4c181 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:58.441688 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d594c64-8a30-4f29-9e40-9dfdc7f4c181 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:58.443416 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cd0603-d4ad-46ff-b8a0-461951d5dc01 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:58.449766 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 219/441] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 17 18:03:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:03:58.451023 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9f206-ffc2-4831-9fba-fe2b097604de None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:58.451356 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9f206-ffc2-4831-9fba-fe2b097604de None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:58.451629 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9f206-ffc2-4831-9fba-fe2b097604de None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:58.453423 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 220/442] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:03:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:03:58.455768 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9f206-ffc2-4831-9fba-fe2b097604de None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:58.476547 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a320c32a-ba02-4c92-9fba-dcaa4b040813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:58.477393 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a320c32a-ba02-4c92-9fba-dcaa4b040813 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:58.477707 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a320c32a-ba02-4c92-9fba-dcaa4b040813 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:58.477978 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a320c32a-ba02-4c92-9fba-dcaa4b040813 None admin] PATH_INFO: `/v3/groups/8f23a524ffa445058805d48e211ec189` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:58.479149 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a320c32a-ba02-4c92-9fba-dcaa4b040813 None admin] RBAC: Authorizing `identity:get_group(group_id=8f23a524ffa445058805d48e211ec189)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:58.480587 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a320c32a-ba02-4c92-9fba-dcaa4b040813 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:58.482210 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 223/443] 10.222.0.65 () {56 vars in 1180 bytes} [Tue May 17 18:03:58 2022] GET /identity/v3/groups/8f23a524ffa445058805d48e211ec189 => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:03:58.483355 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7290ed-eaed-4dad-b3e1-401f502b06c4 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:58.483662 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7290ed-eaed-4dad-b3e1-401f502b06c4 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:58.483913 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7290ed-eaed-4dad-b3e1-401f502b06c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:58.499753 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-8b7290ed-eaed-4dad-b3e1-401f502b06c4 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:03:58.500935 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-8b7290ed-eaed-4dad-b3e1-401f502b06c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:03:58.551267 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9f206-ffc2-4831-9fba-fe2b097604de None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:58.563214 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 224/444] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:03:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:03:58.564021 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7290ed-eaed-4dad-b3e1-401f502b06c4 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:58.583578 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5eefba-62cd-4fe6-98ca-005756842347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:58.584222 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5eefba-62cd-4fe6-98ca-005756842347 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:58.584499 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5eefba-62cd-4fe6-98ca-005756842347 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:58.584771 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5eefba-62cd-4fe6-98ca-005756842347 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:58.648010 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5eefba-62cd-4fe6-98ca-005756842347 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:58.649439 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5eefba-62cd-4fe6-98ca-005756842347 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:58.656424 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7290ed-eaed-4dad-b3e1-401f502b06c4 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:58.687911 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dbd447-4c1e-4732-a38a-cded61defe7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:58.688547 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dbd447-4c1e-4732-a38a-cded61defe7b None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:58.688824 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dbd447-4c1e-4732-a38a-cded61defe7b None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:58.689096 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dbd447-4c1e-4732-a38a-cded61defe7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:58.689951 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dbd447-4c1e-4732-a38a-cded61defe7b None admin] RBAC: Adding query filter params (group.id=8f23a524ffa445058805d48e211ec189, role.id=c3b3265cd6364fbcb22a731040b7b47a, scope.project.id=d7cf4e05380e477d8f7793c92acc9742) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:58.690259 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dbd447-4c1e-4732-a38a-cded61defe7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:58.691679 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dbd447-4c1e-4732-a38a-cded61defe7b None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:58.697519 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 225/445] 10.222.0.65 () {56 vars in 1376 bytes} [Tue May 17 18:03:58 2022] GET /identity/v3/role_assignments?group.id=8f23a524ffa445058805d48e211ec189&scope.project.id=d7cf4e05380e477d8f7793c92acc9742&role.id=c3b3265cd6364fbcb22a731040b7b47a => generated 611 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:58.698362 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dbd447-4c1e-4732-a38a-cded61defe7b None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:58.750777 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 221/446] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 17 18:03:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 17 18:03:58.756463 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5eefba-62cd-4fe6-98ca-005756842347 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:58.810710 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dbd447-4c1e-4732-a38a-cded61defe7b None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:58.849288 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268628db-933d-4ffe-95e0-4943636e53ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:58.850354 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268628db-933d-4ffe-95e0-4943636e53ce None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:58.851289 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268628db-933d-4ffe-95e0-4943636e53ce None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:58.851714 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268628db-933d-4ffe-95e0-4943636e53ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:58.863291 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5eefba-62cd-4fe6-98ca-005756842347 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:58.867542 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268628db-933d-4ffe-95e0-4943636e53ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:03:58.876845 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-268628db-933d-4ffe-95e0-4943636e53ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:03:58.876845 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:03:58.876845 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:03:58.876845 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:03:58.876845 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:03:58.876845 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:03:58.876845 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:03:58.876845 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:03:58.876845 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:03:58.876845 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:03:58.876845 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:03:58.876845 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:03:58.876845 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:03:58.876845 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:03:58.876845 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:03:58.876845 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:03:58.877849 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:03:58.877849 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:03:58.877849 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:03:58.877849 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:03:58.877849 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:03:58.877849 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:03:58.877849 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:03:58.877849 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:03:58.877849 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:03:58.877849 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:03:58.877849 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:03:58.877849 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:03:58.877849 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:03:58.877849 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:03:58.877849 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:03:58.877849 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:03:58.879635 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:03:58.879635 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:03:58.879635 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:03:58.879635 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:03:58.879635 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:03:58.879635 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:03:58.879635 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:03:58.879635 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:03:58.879635 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:03:58.879635 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:03:58.879635 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:03:58.879635 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:03:58.879635 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 226/447] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 17 18:03:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:03:58.884785 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268628db-933d-4ffe-95e0-4943636e53ce None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:58.903526 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264be76b-7575-45a9-8e5b-87e5fc221da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:58.905023 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264be76b-7575-45a9-8e5b-87e5fc221da1 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:58.905023 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264be76b-7575-45a9-8e5b-87e5fc221da1 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:58.905023 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264be76b-7575-45a9-8e5b-87e5fc221da1 None admin] PATH_INFO: `/v3/projects/3d967b497e5049b1bd80196bde0b33fd` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:58.906352 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264be76b-7575-45a9-8e5b-87e5fc221da1 None admin] RBAC: Authorizing `identity:get_project(project_id=3d967b497e5049b1bd80196bde0b33fd)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:58.907675 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264be76b-7575-45a9-8e5b-87e5fc221da1 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:58.909725 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 222/448] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 17 18:03:58 2022] GET /identity/v3/projects/3d967b497e5049b1bd80196bde0b33fd => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:03:58.914856 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264be76b-7575-45a9-8e5b-87e5fc221da1 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:58.986190 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268628db-933d-4ffe-95e0-4943636e53ce None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:59.024438 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01521bb0-3e63-4b2c-af54-9feee4447977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:59.024824 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01521bb0-3e63-4b2c-af54-9feee4447977 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:59.024945 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264be76b-7575-45a9-8e5b-87e5fc221da1 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:59.025340 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01521bb0-3e63-4b2c-af54-9feee4447977 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:59.025340 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01521bb0-3e63-4b2c-af54-9feee4447977 None admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:59.026131 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01521bb0-3e63-4b2c-af54-9feee4447977 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:59.026428 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01521bb0-3e63-4b2c-af54-9feee4447977 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:59.027792 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01521bb0-3e63-4b2c-af54-9feee4447977 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:59.036037 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 227/449] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 17 18:03:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:03:59.041566 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01521bb0-3e63-4b2c-af54-9feee4447977 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:59.062159 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6e2104-c1ed-4d2a-ad66-fd092859b634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:59.062917 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e2104-c1ed-4d2a-ad66-fd092859b634 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:59.063192 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e2104-c1ed-4d2a-ad66-fd092859b634 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:59.063460 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e2104-c1ed-4d2a-ad66-fd092859b634 None admin] PATH_INFO: `/v3/groups/8f23a524ffa445058805d48e211ec189` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:59.064640 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6e2104-c1ed-4d2a-ad66-fd092859b634 None admin] RBAC: Authorizing `identity:get_group(group_id=8f23a524ffa445058805d48e211ec189)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:59.066144 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6e2104-c1ed-4d2a-ad66-fd092859b634 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:59.069502 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 223/450] 10.222.0.65 () {56 vars in 1180 bytes} [Tue May 17 18:03:58 2022] GET /identity/v3/groups/8f23a524ffa445058805d48e211ec189 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:03:59.074454 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6e2104-c1ed-4d2a-ad66-fd092859b634 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:59.149299 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01521bb0-3e63-4b2c-af54-9feee4447977 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:59.187957 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6e2104-c1ed-4d2a-ad66-fd092859b634 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:59.189835 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d4c84a-b1a8-4f1b-b976-6fd73b109b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:59.190490 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4c84a-b1a8-4f1b-b976-6fd73b109b2d None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:59.191505 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4c84a-b1a8-4f1b-b976-6fd73b109b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:59.191505 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4c84a-b1a8-4f1b-b976-6fd73b109b2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:59.224840 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f2f3fd-814d-4d41-8fa6-a1b1aa2a13ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:59.226261 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2f3fd-814d-4d41-8fa6-a1b1aa2a13ee None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:59.226261 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2f3fd-814d-4d41-8fa6-a1b1aa2a13ee None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:59.226261 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2f3fd-814d-4d41-8fa6-a1b1aa2a13ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:59.227022 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f2f3fd-814d-4d41-8fa6-a1b1aa2a13ee None admin] RBAC: Adding query filter params (group.id=8f23a524ffa445058805d48e211ec189, role.id=c3b3265cd6364fbcb22a731040b7b47a, scope.project.id=3d967b497e5049b1bd80196bde0b33fd) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:59.227329 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f2f3fd-814d-4d41-8fa6-a1b1aa2a13ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:59.228761 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f2f3fd-814d-4d41-8fa6-a1b1aa2a13ee None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:59.235727 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 224/451] 10.222.0.65 () {56 vars in 1376 bytes} [Tue May 17 18:03:59 2022] GET /identity/v3/role_assignments?group.id=8f23a524ffa445058805d48e211ec189&scope.project.id=3d967b497e5049b1bd80196bde0b33fd&role.id=c3b3265cd6364fbcb22a731040b7b47a => generated 611 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:03:59.268002 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d4c84a-b1a8-4f1b-b976-6fd73b109b2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:59.269513 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d4c84a-b1a8-4f1b-b976-6fd73b109b2d None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:59.369853 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 228/452] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 17 18:03:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 17 18:03:59.376111 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f2f3fd-814d-4d41-8fa6-a1b1aa2a13ee None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:59.473798 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f2f3fd-814d-4d41-8fa6-a1b1aa2a13ee None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:59.505507 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451da75-6d48-4874-9f62-d073fbd793f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:59.506357 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451da75-6d48-4874-9f62-d073fbd793f5 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:59.506636 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451da75-6d48-4874-9f62-d073fbd793f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:59.506911 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7451da75-6d48-4874-9f62-d073fbd793f5 None admin] PATH_INFO: `/v3/projects/22a045ecfd2045b79def0497d463b2a3` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:59.508080 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7451da75-6d48-4874-9f62-d073fbd793f5 None admin] RBAC: Authorizing `identity:get_project(project_id=22a045ecfd2045b79def0497d463b2a3)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:59.509569 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7451da75-6d48-4874-9f62-d073fbd793f5 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:59.511252 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 225/453] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 17 18:03:59 2022] GET /identity/v3/projects/22a045ecfd2045b79def0497d463b2a3 => generated 344 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:59.517276 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d4c84a-b1a8-4f1b-b976-6fd73b109b2d None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:59.614458 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d4c84a-b1a8-4f1b-b976-6fd73b109b2d None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:59.645801 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd431fe-228f-4b29-9270-f9fb41726b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:59.646630 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd431fe-228f-4b29-9270-f9fb41726b9c None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:59.646901 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd431fe-228f-4b29-9270-f9fb41726b9c None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:59.647164 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd431fe-228f-4b29-9270-f9fb41726b9c None admin] PATH_INFO: `/v3/groups/6cdc1d9a8aae4e459182451deb133424` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:59.648295 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd431fe-228f-4b29-9270-f9fb41726b9c None admin] RBAC: Authorizing `identity:get_group(group_id=6cdc1d9a8aae4e459182451deb133424)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:59.649747 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd431fe-228f-4b29-9270-f9fb41726b9c None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:59.651317 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 229/454] 10.222.0.65 () {56 vars in 1180 bytes} [Tue May 17 18:03:59 2022] GET /identity/v3/groups/6cdc1d9a8aae4e459182451deb133424 => generated 229 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:59.657085 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451da75-6d48-4874-9f62-d073fbd793f5 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:59.752387 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7451da75-6d48-4874-9f62-d073fbd793f5 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:59.782773 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefacb69-a8a6-48bf-a83f-674f4a352a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:59.783406 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefacb69-a8a6-48bf-a83f-674f4a352a12 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:59.783681 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefacb69-a8a6-48bf-a83f-674f4a352a12 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:59.783947 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefacb69-a8a6-48bf-a83f-674f4a352a12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:59.784757 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefacb69-a8a6-48bf-a83f-674f4a352a12 None admin] RBAC: Adding query filter params (group.id=6cdc1d9a8aae4e459182451deb133424, role.id=332c8d70fd0f41e2beea20aaead5daa5, scope.project.id=22a045ecfd2045b79def0497d463b2a3) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:59.785060 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefacb69-a8a6-48bf-a83f-674f4a352a12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:59.786494 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefacb69-a8a6-48bf-a83f-674f4a352a12 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:59.791982 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 226/455] 10.222.0.65 () {56 vars in 1376 bytes} [Tue May 17 18:03:59 2022] GET /identity/v3/role_assignments?group.id=6cdc1d9a8aae4e459182451deb133424&scope.project.id=22a045ecfd2045b79def0497d463b2a3&role.id=332c8d70fd0f41e2beea20aaead5daa5 => generated 611 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:02.478561 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050063ca-62f8-4c42-9e55-f380268140c6 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:02.479112 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050063ca-62f8-4c42-9e55-f380268140c6 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:02.479112 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050063ca-62f8-4c42-9e55-f380268140c6 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:02.480772 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 230/456] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:04:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:04:02.499493 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f10ab-9a60-43be-ae10-161dad1fb836 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:02.500007 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f10ab-9a60-43be-ae10-161dad1fb836 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:02.500007 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f10ab-9a60-43be-ae10-161dad1fb836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:02.524812 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acbfcc3-8296-4144-ae71-8b7fb8a55897 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:02.525095 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acbfcc3-8296-4144-ae71-8b7fb8a55897 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:02.525409 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acbfcc3-8296-4144-ae71-8b7fb8a55897 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:02.526794 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 231/457] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:04:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 18:04:02.529326 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-eb6f10ab-9a60-43be-ae10-161dad1fb836 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:02.532071 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a63d07-40bd-43f5-91ba-9edf8c3979a1 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:02.532353 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a63d07-40bd-43f5-91ba-9edf8c3979a1 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:02.532627 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a63d07-40bd-43f5-91ba-9edf8c3979a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:02.538381 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-eb6f10ab-9a60-43be-ae10-161dad1fb836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:02.554651 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-22a63d07-40bd-43f5-91ba-9edf8c3979a1 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:02.556531 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-22a63d07-40bd-43f5-91ba-9edf8c3979a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:02.637565 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 232/458] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:04:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 18:04:02.663742 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 227/459] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:04:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 18:04:02.668149 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a63d07-40bd-43f5-91ba-9edf8c3979a1 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:02.688905 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6f10ab-9a60-43be-ae10-161dad1fb836 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:02.805504 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a63d07-40bd-43f5-91ba-9edf8c3979a1 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:02.850278 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368094c5-dc43-49f8-bd9c-4b7ec29ce646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:02.851407 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368094c5-dc43-49f8-bd9c-4b7ec29ce646 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:02.851912 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368094c5-dc43-49f8-bd9c-4b7ec29ce646 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:02.852385 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368094c5-dc43-49f8-bd9c-4b7ec29ce646 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:02.866134 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368094c5-dc43-49f8-bd9c-4b7ec29ce646 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:02.867894 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368094c5-dc43-49f8-bd9c-4b7ec29ce646 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:02.896280 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-368094c5-dc43-49f8-bd9c-4b7ec29ce646 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:02.896280 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:02.896280 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:02.896280 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:02.896280 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:02.896280 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:02.896280 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:02.896280 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:02.896280 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:02.896280 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:02.896280 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:02.896280 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:02.896280 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:04:02.896280 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:04:02.896280 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:04:02.897202 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:04:02.897202 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:02.897202 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:02.897202 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:02.897202 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:02.897202 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:02.897202 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:02.897202 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:02.897202 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:02.897202 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:02.897202 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:02.897202 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:02.897202 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:02.897202 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:02.897202 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:02.897202 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:02.897202 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:02.898090 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:04:02.898090 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:04:02.898090 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:02.898090 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:02.909289 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 233/460] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:04:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:02.915236 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368094c5-dc43-49f8-bd9c-4b7ec29ce646 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:02.930491 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6f10ab-9a60-43be-ae10-161dad1fb836 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:02.971325 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84c43ee-f38f-4e53-8c0c-8b366f83ed89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:02.972349 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c43ee-f38f-4e53-8c0c-8b366f83ed89 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:02.972839 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c43ee-f38f-4e53-8c0c-8b366f83ed89 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:02.973306 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c43ee-f38f-4e53-8c0c-8b366f83ed89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:02.983970 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84c43ee-f38f-4e53-8c0c-8b366f83ed89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:02.985700 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84c43ee-f38f-4e53-8c0c-8b366f83ed89 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:03.003263 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-c84c43ee-f38f-4e53-8c0c-8b366f83ed89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:03.003263 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:03.003263 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:03.003263 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:03.003263 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:03.003263 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:03.003263 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:03.003263 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:03.003263 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:03.003263 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:03.003263 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:03.003263 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:03.003263 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:04:03.003263 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:04:03.003263 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:04:03.004134 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:04:03.004134 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:03.004134 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:03.004134 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:03.004134 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:03.004134 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:03.004134 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:03.004134 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:03.004134 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:03.004134 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:03.004134 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:03.004134 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:03.004134 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:03.004134 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:03.004134 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:03.004134 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:03.004134 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:03.004994 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:04:03.004994 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:04:03.004994 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:03.004994 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:03.011683 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 228/461] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:04:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:04:03.013370 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5e21f-298b-4307-9606-e6daeb4f67a5 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:03.013883 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5e21f-298b-4307-9606-e6daeb4f67a5 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:03.014555 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5e21f-298b-4307-9606-e6daeb4f67a5 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:03.020334 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 229/462] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:04:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:04:03.021397 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd5e21f-298b-4307-9606-e6daeb4f67a5 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:03.037428 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368094c5-dc43-49f8-bd9c-4b7ec29ce646 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:03.086687 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03f4f2-61b9-4056-88b6-110582009e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:03.087304 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03f4f2-61b9-4056-88b6-110582009e67 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:03.087584 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03f4f2-61b9-4056-88b6-110582009e67 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:03.087860 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03f4f2-61b9-4056-88b6-110582009e67 None admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:03.088913 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee03f4f2-61b9-4056-88b6-110582009e67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:03.089231 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee03f4f2-61b9-4056-88b6-110582009e67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:03.091082 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee03f4f2-61b9-4056-88b6-110582009e67 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:03.110055 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 234/463] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:04:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:04:03.111790 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e75646-3a9d-4b44-b3eb-d44887b5c99f None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:03.112145 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e75646-3a9d-4b44-b3eb-d44887b5c99f None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:03.112428 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e75646-3a9d-4b44-b3eb-d44887b5c99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:03.136602 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-27e75646-3a9d-4b44-b3eb-d44887b5c99f None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:03.138108 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-27e75646-3a9d-4b44-b3eb-d44887b5c99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:03.142275 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd5e21f-298b-4307-9606-e6daeb4f67a5 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:03.182009 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bed9a4-dc88-4c50-a75a-16e892b1df7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:03.183035 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bed9a4-dc88-4c50-a75a-16e892b1df7f None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:03.183550 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bed9a4-dc88-4c50-a75a-16e892b1df7f None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:03.184039 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bed9a4-dc88-4c50-a75a-16e892b1df7f None admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:03.185004 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bed9a4-dc88-4c50-a75a-16e892b1df7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:03.185595 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bed9a4-dc88-4c50-a75a-16e892b1df7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:03.187773 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bed9a4-dc88-4c50-a75a-16e892b1df7f None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:03.205951 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 230/464] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:04:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:03.207290 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bed9a4-dc88-4c50-a75a-16e892b1df7f None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:03.218250 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 235/465] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:04:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:04:03.219128 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e75646-3a9d-4b44-b3eb-d44887b5c99f None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:03.323678 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bed9a4-dc88-4c50-a75a-16e892b1df7f None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:03.336077 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e75646-3a9d-4b44-b3eb-d44887b5c99f None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:03.358797 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00bcf84-d8c2-4f1e-b627-009de25ca8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:03.359775 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00bcf84-d8c2-4f1e-b627-009de25ca8e7 None admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:03.360282 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00bcf84-d8c2-4f1e-b627-009de25ca8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:03.360750 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00bcf84-d8c2-4f1e-b627-009de25ca8e7 None admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:03.361682 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00bcf84-d8c2-4f1e-b627-009de25ca8e7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:03.363454 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00bcf84-d8c2-4f1e-b627-009de25ca8e7 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:03.371278 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c7eb8-86dc-4ac2-84a7-400d99b6c181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:03.372078 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c7eb8-86dc-4ac2-84a7-400d99b6c181 None admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:03.372415 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c7eb8-86dc-4ac2-84a7-400d99b6c181 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:03.372694 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c7eb8-86dc-4ac2-84a7-400d99b6c181 None admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:03.373775 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0c7eb8-86dc-4ac2-84a7-400d99b6c181 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:03.375455 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0c7eb8-86dc-4ac2-84a7-400d99b6c181 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:03.392294 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 231/466] 10.222.0.65 () {60 vars in 1132 bytes} [Tue May 17 18:04:03 2022] POST /identity/v3/users => generated 248 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:04:03.393721 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00bcf84-d8c2-4f1e-b627-009de25ca8e7 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:03.397512 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 236/467] 10.222.0.65 () {60 vars in 1132 bytes} [Tue May 17 18:04:03 2022] POST /identity/v3/users => generated 246 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:04:03.422969 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe6e04-d234-4cb5-9ca4-75b1473327d4 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:03.423552 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe6e04-d234-4cb5-9ca4-75b1473327d4 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:03.424712 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fe6e04-d234-4cb5-9ca4-75b1473327d4 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:03.427479 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 237/468] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:04:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:04:03.435766 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c3618-5ab2-4781-8323-ccb995e54d85 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:03.436866 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c3618-5ab2-4781-8323-ccb995e54d85 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:03.437371 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c3618-5ab2-4781-8323-ccb995e54d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:03.472802 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-f92c3618-5ab2-4781-8323-ccb995e54d85 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:03.479444 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-f92c3618-5ab2-4781-8323-ccb995e54d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:03.589913 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00bcf84-d8c2-4f1e-b627-009de25ca8e7 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:03.622890 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 238/469] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:04:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 18:04:03.644121 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a21dc-afd6-40f2-8d05-b984fa8c0f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:03.644965 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a21dc-afd6-40f2-8d05-b984fa8c0f4d None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:03.645294 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a21dc-afd6-40f2-8d05-b984fa8c0f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:03.645595 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a21dc-afd6-40f2-8d05-b984fa8c0f4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:03.658239 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c3618-5ab2-4781-8323-ccb995e54d85 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:03.658433 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427a21dc-afd6-40f2-8d05-b984fa8c0f4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:03.659857 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427a21dc-afd6-40f2-8d05-b984fa8c0f4d None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:03.681642 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-427a21dc-afd6-40f2-8d05-b984fa8c0f4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:03.681642 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:03.681642 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:03.681642 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:03.681642 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:03.681642 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:03.681642 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:03.681642 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:03.681642 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:03.681642 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:03.681642 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:03.681642 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:03.681642 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:04:03.681642 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:04:03.681642 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:04:03.682551 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:04:03.682551 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:03.682551 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:03.682551 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:03.682551 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:03.682551 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:03.682551 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:03.682551 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:03.682551 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:03.682551 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:03.682551 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:03.682551 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:03.682551 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:03.682551 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:03.682551 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:03.682551 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:03.682551 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:03.683411 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:04:03.683411 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:04:03.683411 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:03.683411 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:03.684985 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 232/470] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:04:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:03.693549 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a21dc-afd6-40f2-8d05-b984fa8c0f4d None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:03.790008 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c3618-5ab2-4781-8323-ccb995e54d85 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:03.820101 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a21dc-afd6-40f2-8d05-b984fa8c0f4d None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:03.829219 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e973c-9985-4521-84c8-72fab96ec58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:03.830050 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e973c-9985-4521-84c8-72fab96ec58c None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:03.830329 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e973c-9985-4521-84c8-72fab96ec58c None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:03.830622 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e973c-9985-4521-84c8-72fab96ec58c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:03.841876 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5e973c-9985-4521-84c8-72fab96ec58c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:03.844004 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5e973c-9985-4521-84c8-72fab96ec58c None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:03.867648 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1975e0b2-27f5-4ddc-ba54-e51a2e08f429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:03.868304 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975e0b2-27f5-4ddc-ba54-e51a2e08f429 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:03.868588 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975e0b2-27f5-4ddc-ba54-e51a2e08f429 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:03.868913 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975e0b2-27f5-4ddc-ba54-e51a2e08f429 None admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:03.869020 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-df5e973c-9985-4521-84c8-72fab96ec58c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:03.869020 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:03.869020 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:03.869020 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:03.869020 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:03.869020 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:03.869020 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:03.869020 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:03.869020 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:03.869020 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:03.869020 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:03.869020 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:03.869020 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:04:03.869020 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:04:03.869020 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:04:03.869847 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:04:03.869847 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:03.869847 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:03.869847 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:03.869847 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:03.869847 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:03.869847 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:03.869847 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:03.869847 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:03.869847 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:03.869847 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:03.869847 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:03.869847 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:03.869847 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:03.869847 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:03.869847 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:03.869847 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:03.871093 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:04:03.871093 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:04:03.871093 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:03.871093 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:03.871300 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1975e0b2-27f5-4ddc-ba54-e51a2e08f429 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:03.871300 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1975e0b2-27f5-4ddc-ba54-e51a2e08f429 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:03.871418 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 239/471] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:04:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:03.871491 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1975e0b2-27f5-4ddc-ba54-e51a2e08f429 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:03.872715 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba74a5-f3b6-4d05-bfb0-ff4703d95692 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:03.872715 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba74a5-f3b6-4d05-bfb0-ff4703d95692 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:03.872715 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba74a5-f3b6-4d05-bfb0-ff4703d95692 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:03.875224 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 240/472] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:04:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:04:03.879677 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba74a5-f3b6-4d05-bfb0-ff4703d95692 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:03.886434 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 233/473] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:04:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:04:03.887929 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6c9f5-324c-4ed2-adbe-e8a6904938ec None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:03.888417 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6c9f5-324c-4ed2-adbe-e8a6904938ec None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:03.888921 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e6c9f5-324c-4ed2-adbe-e8a6904938ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:03.905931 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-f9e6c9f5-324c-4ed2-adbe-e8a6904938ec None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:03.907426 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-f9e6c9f5-324c-4ed2-adbe-e8a6904938ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:03.976858 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 234/474] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:04:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:04:03.978007 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e6c9f5-324c-4ed2-adbe-e8a6904938ec None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:03.995122 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba74a5-f3b6-4d05-bfb0-ff4703d95692 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:04.040702 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9594b2c-77fc-4e8a-a5af-4e4db2f0e086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:04.041349 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9594b2c-77fc-4e8a-a5af-4e4db2f0e086 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:04.041651 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9594b2c-77fc-4e8a-a5af-4e4db2f0e086 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:04.042192 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9594b2c-77fc-4e8a-a5af-4e4db2f0e086 None admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:04.042628 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9594b2c-77fc-4e8a-a5af-4e4db2f0e086 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:04.042926 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9594b2c-77fc-4e8a-a5af-4e4db2f0e086 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:04.044295 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9594b2c-77fc-4e8a-a5af-4e4db2f0e086 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:04.056774 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 241/475] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:04:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:04.057666 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9594b2c-77fc-4e8a-a5af-4e4db2f0e086 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:04.085637 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e6c9f5-324c-4ed2-adbe-e8a6904938ec None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:04.124860 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3965e201-faa2-4941-b4e2-9bb7233de976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:04.125765 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965e201-faa2-4941-b4e2-9bb7233de976 None admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:04.125994 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965e201-faa2-4941-b4e2-9bb7233de976 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:04.126573 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965e201-faa2-4941-b4e2-9bb7233de976 None admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:04.127570 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3965e201-faa2-4941-b4e2-9bb7233de976 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:04.129006 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3965e201-faa2-4941-b4e2-9bb7233de976 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:04.154451 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 235/476] 10.222.0.65 () {60 vars in 1132 bytes} [Tue May 17 18:04:03 2022] POST /identity/v3/users => generated 248 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:04:04.155591 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3965e201-faa2-4941-b4e2-9bb7233de976 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:04.189949 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9594b2c-77fc-4e8a-a5af-4e4db2f0e086 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:04.282220 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c1d5e1-f65d-4edd-9391-bbc3b1298597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:04.282908 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1d5e1-f65d-4edd-9391-bbc3b1298597 None admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:04.283185 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1d5e1-f65d-4edd-9391-bbc3b1298597 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:04.283458 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1d5e1-f65d-4edd-9391-bbc3b1298597 None admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:04.284217 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c1d5e1-f65d-4edd-9391-bbc3b1298597 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:04.285696 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c1d5e1-f65d-4edd-9391-bbc3b1298597 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:04.301988 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.sql.core [None req-e2c1d5e1-f65d-4edd-9391-bbc3b1298597 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 17 18:04:04.301988 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 17 18:04:04.301988 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [parameters: {'id': '94baab831c63449084b3efb47804ece0', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 17 18:04:04.301988 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80018) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 17 18:04:04.302527 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3965e201-faa2-4941-b4e2-9bb7233de976 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:04.327950 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-e2c1d5e1-f65d-4edd-9391-bbc3b1298597 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 17 18:04:04.327950 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:04.327950 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 17 18:04:04.327950 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application self.dialect.do_execute( May 17 18:04:04.327950 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 17 18:04:04.327950 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 17 18:04:04.327950 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 17 18:04:04.327950 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application result = self._query(query) May 17 18:04:04.327950 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 17 18:04:04.327950 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application conn.query(q) May 17 18:04:04.327950 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 17 18:04:04.327950 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 17 18:04:04.327950 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 17 18:04:04.327950 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application result.read() May 17 18:04:04.327950 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 17 18:04:04.328881 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 17 18:04:04.328881 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 17 18:04:04.328881 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application packet.raise_for_error() May 17 18:04:04.328881 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 17 18:04:04.328881 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 17 18:04:04.328881 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 17 18:04:04.328881 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 17 18:04:04.328881 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 17 18:04:04.328881 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:04.328881 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 17 18:04:04.328881 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:04.328881 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:04.328881 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 17 18:04:04.328881 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 17 18:04:04.328881 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 17 18:04:04.328881 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return ref.to_dict() May 17 18:04:04.328881 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 17 18:04:04.328881 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application next(self.gen) May 17 18:04:04.329825 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 17 18:04:04.329825 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application yield resource May 17 18:04:04.329825 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 17 18:04:04.329825 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application next(self.gen) May 17 18:04:04.329825 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 17 18:04:04.329825 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application self.session.rollback() May 17 18:04:04.329825 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 17 18:04:04.329825 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application self.force_reraise() May 17 18:04:04.329825 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 17 18:04:04.329825 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise self.value May 17 18:04:04.329825 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 17 18:04:04.329825 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 17 18:04:04.329825 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 17 18:04:04.329825 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application session.commit() May 17 18:04:04.329825 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 17 18:04:04.329825 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 17 18:04:04.329825 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 17 18:04:04.330705 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application self._prepare_impl() May 17 18:04:04.330705 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 17 18:04:04.330705 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application self.session.flush() May 17 18:04:04.330705 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 17 18:04:04.330705 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application self._flush(objects) May 17 18:04:04.330705 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 17 18:04:04.330705 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 17 18:04:04.330705 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 17 18:04:04.330705 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application compat.raise_( May 17 18:04:04.330705 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 17 18:04:04.330705 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception May 17 18:04:04.330705 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 17 18:04:04.330705 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application flush_context.execute() May 17 18:04:04.330705 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 17 18:04:04.330705 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rec.execute(self) May 17 18:04:04.330705 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 17 18:04:04.330705 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 17 18:04:04.331657 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 17 18:04:04.331657 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application _emit_insert_statements( May 17 18:04:04.331657 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 17 18:04:04.331657 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application c = connection._execute_20( May 17 18:04:04.331657 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 17 18:04:04.331657 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 17 18:04:04.331657 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 17 18:04:04.331657 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 17 18:04:04.331657 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 17 18:04:04.331657 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ret = self._execute_context( May 17 18:04:04.331657 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 17 18:04:04.331657 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 17 18:04:04.331657 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 17 18:04:04.331657 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 17 18:04:04.331657 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 17 18:04:04.331657 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception May 17 18:04:04.332460 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 17 18:04:04.332460 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application self.dialect.do_execute( May 17 18:04:04.332460 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 17 18:04:04.332460 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 17 18:04:04.332460 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 17 18:04:04.332460 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application result = self._query(query) May 17 18:04:04.332460 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 17 18:04:04.332460 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application conn.query(q) May 17 18:04:04.332460 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 17 18:04:04.332460 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 17 18:04:04.332460 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 17 18:04:04.332460 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application result.read() May 17 18:04:04.332460 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 17 18:04:04.332460 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 17 18:04:04.332460 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 17 18:04:04.332460 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application packet.raise_for_error() May 17 18:04:04.333244 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 17 18:04:04.333244 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 17 18:04:04.333244 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 17 18:04:04.333244 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 17 18:04:04.333244 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 17 18:04:04.333244 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 17 18:04:04.333244 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [parameters: {'id': '94baab831c63449084b3efb47804ece0', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 17 18:04:04.333244 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 17 18:04:04.333244 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:04.333244 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 18:04:04.333244 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:04.333244 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:04.333244 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:04.333244 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:04.333244 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:04.333244 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:04.335944 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:04.335944 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:04.335944 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:04.335944 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:04.335944 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:04.335944 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:04.335944 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 17 18:04:04.335944 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 17 18:04:04.335944 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:04.335944 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:04.335944 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 17 18:04:04.335944 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 17 18:04:04.335944 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 17 18:04:04.335944 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 17 18:04:04.335944 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 17 18:04:04.335944 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:04.346014 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 242/477] 10.222.0.65 () {60 vars in 1131 bytes} [Tue May 17 18:04:04 2022] POST /identity/v3/roles => generated 144 bytes in 272 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:04.346014 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c1d5e1-f65d-4edd-9391-bbc3b1298597 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:04.346277 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504520de-1e77-4fb2-92cf-f15c2adaff6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:04.346277 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504520de-1e77-4fb2-92cf-f15c2adaff6f None admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:04.346277 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504520de-1e77-4fb2-92cf-f15c2adaff6f None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:04.346277 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504520de-1e77-4fb2-92cf-f15c2adaff6f None admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:04.347699 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504520de-1e77-4fb2-92cf-f15c2adaff6f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:04.347699 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504520de-1e77-4fb2-92cf-f15c2adaff6f None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:04.373989 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 236/478] 10.222.0.65 () {60 vars in 1132 bytes} [Tue May 17 18:04:04 2022] POST /identity/v3/users => generated 249 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:04:04.485275 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c1d5e1-f65d-4edd-9391-bbc3b1298597 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:04.521372 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f0b900-c397-415a-a484-e913c87c779c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:04.522262 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0b900-c397-415a-a484-e913c87c779c None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:04.522547 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0b900-c397-415a-a484-e913c87c779c None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:04.522819 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0b900-c397-415a-a484-e913c87c779c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:04.534657 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f0b900-c397-415a-a484-e913c87c779c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:04:04.542852 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-95f0b900-c397-415a-a484-e913c87c779c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 18:04:04.542852 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:04.542852 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:04.542852 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:04.542852 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:04.542852 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:04.542852 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:04.542852 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:04.542852 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:04.542852 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:04.542852 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:04.542852 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:04.542852 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:04:04.542852 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:04:04.542852 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:04:04.542852 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:04:04.543787 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:04:04.543787 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:04:04.543787 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:04:04.543787 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:04:04.543787 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:04.543787 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:04.543787 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:04.543787 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:04.543787 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:04.543787 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:04.543787 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:04.543787 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:04.543787 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:04.543787 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:04.543787 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:04.543787 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:04.544567 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:04.544567 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:04.544567 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:04.544567 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:04.544567 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:04:04.544567 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:04:04.544567 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:04:04.544567 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:04:04.544567 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:04:04.544567 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:04:04.544567 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 18:04:04.544567 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:04.544567 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 243/479] 10.222.0.65 () {56 vars in 1114 bytes} [Tue May 17 18:04:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:04.551888 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504520de-1e77-4fb2-92cf-f15c2adaff6f None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:04.673633 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504520de-1e77-4fb2-92cf-f15c2adaff6f None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:04.707177 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6922ca-207a-4f84-b325-81089baadc76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:04.708197 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6922ca-207a-4f84-b325-81089baadc76 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:04.708670 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6922ca-207a-4f84-b325-81089baadc76 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:04.709156 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6922ca-207a-4f84-b325-81089baadc76 None admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:04.710211 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6922ca-207a-4f84-b325-81089baadc76 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:04.710706 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6922ca-207a-4f84-b325-81089baadc76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:04.712252 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6922ca-207a-4f84-b325-81089baadc76 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:04.721306 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 237/480] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 17 18:04:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:06.097567 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1013530-f2be-4bab-9d69-98a5c8bb35c2 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:06.098182 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1013530-f2be-4bab-9d69-98a5c8bb35c2 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:06.098434 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1013530-f2be-4bab-9d69-98a5c8bb35c2 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:06.101533 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 244/481] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:04:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:04:06.108353 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59033e3a-a6e7-4e12-b334-ad93e0e6ff99 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:06.108775 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59033e3a-a6e7-4e12-b334-ad93e0e6ff99 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:06.108945 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59033e3a-a6e7-4e12-b334-ad93e0e6ff99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:06.134003 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-59033e3a-a6e7-4e12-b334-ad93e0e6ff99 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:06.135239 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-59033e3a-a6e7-4e12-b334-ad93e0e6ff99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:06.201762 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a99dbf7-0621-41d4-8bbe-2a04384cd5d3 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:06.202083 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a99dbf7-0621-41d4-8bbe-2a04384cd5d3 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:06.202320 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a99dbf7-0621-41d4-8bbe-2a04384cd5d3 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:06.203828 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 245/482] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:04:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:04:06.209152 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04625c92-ca48-43e5-82bf-30891f100475 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:06.209435 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04625c92-ca48-43e5-82bf-30891f100475 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:06.210080 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04625c92-ca48-43e5-82bf-30891f100475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:06.220070 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 238/483] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:04:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 18:04:06.229105 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-04625c92-ca48-43e5-82bf-30891f100475 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:06.230324 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-04625c92-ca48-43e5-82bf-30891f100475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:06.255639 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59033e3a-a6e7-4e12-b334-ad93e0e6ff99 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:06.304637 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 246/484] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:04:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:04:06.331952 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04625c92-ca48-43e5-82bf-30891f100475 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:06.442966 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04625c92-ca48-43e5-82bf-30891f100475 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:06.472268 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59033e3a-a6e7-4e12-b334-ad93e0e6ff99 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:06.481616 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287bad7d-d3c5-4498-b810-93164ab01306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:06.482415 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287bad7d-d3c5-4498-b810-93164ab01306 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:06.482694 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287bad7d-d3c5-4498-b810-93164ab01306 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:06.483489 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287bad7d-d3c5-4498-b810-93164ab01306 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:06.494530 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287bad7d-d3c5-4498-b810-93164ab01306 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:04:06.503517 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-287bad7d-d3c5-4498-b810-93164ab01306 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 18:04:06.503517 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:06.503517 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:06.503517 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:06.503517 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:06.503517 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:06.503517 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:06.503517 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:06.503517 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:06.503517 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:06.503517 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:06.503517 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:06.503517 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:04:06.503517 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:04:06.503517 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:04:06.503517 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:04:06.504363 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:04:06.504363 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:04:06.504363 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:04:06.504363 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:04:06.504363 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:06.504363 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:06.504363 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:06.504363 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:06.504363 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:06.504363 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:06.504363 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:06.504363 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:06.504363 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:06.504363 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:06.504363 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:06.504363 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:06.505153 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:06.505153 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:06.505153 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:06.505153 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:06.505153 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:04:06.505153 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:04:06.505153 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:04:06.505153 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:04:06.505153 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:04:06.505153 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:04:06.505153 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 18:04:06.505153 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:06.505153 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 247/485] 10.222.0.65 () {56 vars in 1102 bytes} [Tue May 17 18:04:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:06.510907 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287bad7d-d3c5-4498-b810-93164ab01306 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:06.578878 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7fe0b0-efa3-4e7a-9a6a-516062cef826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:06.579680 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7fe0b0-efa3-4e7a-9a6a-516062cef826 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:06.579954 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7fe0b0-efa3-4e7a-9a6a-516062cef826 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:06.580223 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7fe0b0-efa3-4e7a-9a6a-516062cef826 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:06.606335 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7fe0b0-efa3-4e7a-9a6a-516062cef826 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:04:06.614850 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287bad7d-d3c5-4498-b810-93164ab01306 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:06.618189 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-fb7fe0b0-efa3-4e7a-9a6a-516062cef826 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 18:04:06.618189 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:06.618189 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:06.618189 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:06.618189 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:06.618189 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:06.618189 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:06.618189 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:06.618189 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:06.618189 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:06.618189 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:06.618189 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:06.618189 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:04:06.618189 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:04:06.618189 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:04:06.618189 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:04:06.620166 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:04:06.620166 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:04:06.620166 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:04:06.620166 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:04:06.620166 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:06.620166 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:06.620166 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:06.620166 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:06.620166 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:06.620166 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:06.620166 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:06.620166 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:06.620166 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:06.620166 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:06.620166 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:06.620166 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:06.622102 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:06.622102 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:06.622102 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:06.622102 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:06.622102 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:04:06.622102 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:04:06.622102 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:04:06.622102 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:04:06.622102 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:04:06.622102 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:04:06.622102 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 18:04:06.622102 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:06.622102 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 239/486] 10.222.0.65 () {56 vars in 1102 bytes} [Tue May 17 18:04:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:04:06.626147 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7fe0b0-efa3-4e7a-9a6a-516062cef826 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:06.650514 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc5ac50-b0d7-497e-a80b-7cb00fb42561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:06.651644 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc5ac50-b0d7-497e-a80b-7cb00fb42561 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:06.651934 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc5ac50-b0d7-497e-a80b-7cb00fb42561 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:06.652210 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc5ac50-b0d7-497e-a80b-7cb00fb42561 None admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:06.652959 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc5ac50-b0d7-497e-a80b-7cb00fb42561 None admin] RBAC: Adding query filter params (name=service) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:06.653264 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc5ac50-b0d7-497e-a80b-7cb00fb42561 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:06.655204 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc5ac50-b0d7-497e-a80b-7cb00fb42561 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:06.664599 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 248/487] 10.222.0.65 () {56 vars in 1103 bytes} [Tue May 17 18:04:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:06.669976 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc5ac50-b0d7-497e-a80b-7cb00fb42561 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:06.780200 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc5ac50-b0d7-497e-a80b-7cb00fb42561 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:06.819591 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551fca5b-6844-4f0f-94d6-45beec87dba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:06.820392 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551fca5b-6844-4f0f-94d6-45beec87dba2 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:06.821139 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551fca5b-6844-4f0f-94d6-45beec87dba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:06.821424 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551fca5b-6844-4f0f-94d6-45beec87dba2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:06.837447 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551fca5b-6844-4f0f-94d6-45beec87dba2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:06.837447 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551fca5b-6844-4f0f-94d6-45beec87dba2 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:06.856231 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-551fca5b-6844-4f0f-94d6-45beec87dba2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:06.856231 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:06.856231 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:06.856231 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:06.856231 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:06.856231 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:06.856231 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:06.856231 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:06.856231 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:06.856231 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:06.856231 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:06.856231 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:06.856231 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:04:06.856231 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:04:06.856231 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:04:06.857191 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:04:06.857191 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:06.857191 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:06.857191 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:06.857191 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:06.857191 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:06.857191 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:06.857191 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:06.857191 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:06.857191 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:06.857191 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:06.857191 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:06.857191 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:06.857191 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:06.857191 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:06.857191 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:06.857191 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:06.858158 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:04:06.858158 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:04:06.858158 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:06.858158 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:06.858158 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 249/488] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:04:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:06.863465 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551fca5b-6844-4f0f-94d6-45beec87dba2 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:06.911390 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7fe0b0-efa3-4e7a-9a6a-516062cef826 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:06.971150 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551fca5b-6844-4f0f-94d6-45beec87dba2 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:06.981608 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b035edc2-2881-4415-b0d2-0b1edc44981a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:06.982627 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035edc2-2881-4415-b0d2-0b1edc44981a None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:06.983437 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035edc2-2881-4415-b0d2-0b1edc44981a None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:06.983715 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b035edc2-2881-4415-b0d2-0b1edc44981a None admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:06.984636 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b035edc2-2881-4415-b0d2-0b1edc44981a None admin] RBAC: Adding query filter params (name=service) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:06.985310 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b035edc2-2881-4415-b0d2-0b1edc44981a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:06.986987 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b035edc2-2881-4415-b0d2-0b1edc44981a None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:06.997493 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 240/489] 10.222.0.65 () {56 vars in 1103 bytes} [Tue May 17 18:04:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:06.999331 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4618f089-bd94-4cb1-8a6e-61bf6069d2a5 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:06.999765 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4618f089-bd94-4cb1-8a6e-61bf6069d2a5 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:07.000043 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4618f089-bd94-4cb1-8a6e-61bf6069d2a5 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:07.005074 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a111ca3-4665-4ee1-8b95-f741a636c9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:07.005849 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a111ca3-4665-4ee1-8b95-f741a636c9ef None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:07.006294 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a111ca3-4665-4ee1-8b95-f741a636c9ef None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:07.006446 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 241/490] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:04:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:04:07.006703 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a111ca3-4665-4ee1-8b95-f741a636c9ef None admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:07.007152 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4618f089-bd94-4cb1-8a6e-61bf6069d2a5 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:07.007804 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a111ca3-4665-4ee1-8b95-f741a636c9ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:07.008141 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a111ca3-4665-4ee1-8b95-f741a636c9ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:07.009662 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a111ca3-4665-4ee1-8b95-f741a636c9ef None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:07.023514 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 250/491] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:04:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:07.029297 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113b4a7-a97d-4c4f-9400-75c3cc4fb03a None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:07.029747 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113b4a7-a97d-4c4f-9400-75c3cc4fb03a None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:07.030147 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9113b4a7-a97d-4c4f-9400-75c3cc4fb03a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:07.048313 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-9113b4a7-a97d-4c4f-9400-75c3cc4fb03a None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:07.049552 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-9113b4a7-a97d-4c4f-9400-75c3cc4fb03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:07.117551 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 251/492] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:04:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:04:07.118592 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9113b4a7-a97d-4c4f-9400-75c3cc4fb03a None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:07.135040 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4618f089-bd94-4cb1-8a6e-61bf6069d2a5 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:07.184546 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a811f53-f4bd-4eeb-8193-19823083f7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:07.185334 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a811f53-f4bd-4eeb-8193-19823083f7cf None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:07.185640 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a811f53-f4bd-4eeb-8193-19823083f7cf None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:07.185995 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a811f53-f4bd-4eeb-8193-19823083f7cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:07.197509 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a811f53-f4bd-4eeb-8193-19823083f7cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:07.198969 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a811f53-f4bd-4eeb-8193-19823083f7cf None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:07.216186 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-0a811f53-f4bd-4eeb-8193-19823083f7cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:07.216186 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:07.216186 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:07.216186 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:07.216186 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:07.216186 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:07.216186 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:07.216186 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:07.216186 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:07.216186 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:07.216186 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:07.216186 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:07.216186 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:04:07.216186 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:04:07.216186 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:04:07.218214 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:04:07.218214 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:07.218214 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:07.218214 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:07.218214 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:07.218214 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:07.218214 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:07.218214 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:07.218214 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:07.218214 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:07.218214 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:07.218214 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:07.218214 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:07.218214 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:07.218214 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:07.218214 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:07.218214 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:07.220221 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:04:07.220221 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:04:07.220221 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:07.220221 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:07.220221 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 242/493] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:04:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:07.220221 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a811f53-f4bd-4eeb-8193-19823083f7cf None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:07.225478 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9113b4a7-a97d-4c4f-9400-75c3cc4fb03a None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:07.257216 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d0fe79-728e-47e7-9abc-536dc12a9d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:07.258043 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0fe79-728e-47e7-9abc-536dc12a9d23 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:07.258324 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0fe79-728e-47e7-9abc-536dc12a9d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:07.258593 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0fe79-728e-47e7-9abc-536dc12a9d23 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:07.266557 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d0fe79-728e-47e7-9abc-536dc12a9d23 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:07.268077 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d0fe79-728e-47e7-9abc-536dc12a9d23 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:07.285002 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-a2d0fe79-728e-47e7-9abc-536dc12a9d23 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 17 18:04:07.285002 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:07.285002 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:07.285002 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:07.285002 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:07.285002 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:07.285002 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:07.285002 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:07.285002 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:07.285002 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:07.285002 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:07.285002 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:07.285002 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 18:04:07.285002 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 18:04:07.285002 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 18:04:07.285002 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 18:04:07.287352 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:07.287352 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:07.287352 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 18:04:07.287352 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:04:07.287352 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 18:04:07.287352 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:04:07.287352 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:07.287352 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:07.287352 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:07.287352 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:07.287352 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:07.287352 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:07.287352 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:07.287352 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:07.287352 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:07.287352 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:07.287352 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:07.287352 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:07.289630 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:07.289630 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:07.289630 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 18:04:07.289630 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 18:04:07.289630 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 18:04:07.289630 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 18:04:07.289630 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 18:04:07.289630 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 18:04:07.289630 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 17 18:04:07.289630 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:07.289630 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 252/494] 10.222.0.65 () {56 vars in 1093 bytes} [Tue May 17 18:04:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:07.289630 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d0fe79-728e-47e7-9abc-536dc12a9d23 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:07.326223 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a811f53-f4bd-4eeb-8193-19823083f7cf None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:07.359964 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25fdddd-709b-4518-a036-b71f49b9fd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:07.360753 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25fdddd-709b-4518-a036-b71f49b9fd89 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:07.361031 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25fdddd-709b-4518-a036-b71f49b9fd89 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:07.361301 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25fdddd-709b-4518-a036-b71f49b9fd89 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:07.371471 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25fdddd-709b-4518-a036-b71f49b9fd89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:04:07.379834 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-a25fdddd-709b-4518-a036-b71f49b9fd89 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 18:04:07.379834 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:07.379834 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:07.379834 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:07.379834 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:07.379834 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:07.379834 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:07.379834 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:07.379834 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:07.379834 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:07.379834 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:07.379834 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:07.379834 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:04:07.379834 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:04:07.379834 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:04:07.379834 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:04:07.381911 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:04:07.381911 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:04:07.381911 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:04:07.381911 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:04:07.381911 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:07.381911 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:07.381911 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:07.381911 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:07.381911 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:07.381911 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:07.381911 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:07.381911 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:07.381911 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:07.381911 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:07.381911 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:07.381911 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:07.383812 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:07.383812 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:07.383812 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:07.383812 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:07.383812 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:04:07.383812 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:04:07.383812 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:04:07.383812 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:04:07.383812 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:04:07.383812 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:04:07.383812 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 18:04:07.383812 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:07.383812 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 243/495] 10.222.0.65 () {56 vars in 1102 bytes} [Tue May 17 18:04:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:07.383812 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25fdddd-709b-4518-a036-b71f49b9fd89 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:07.395832 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d0fe79-728e-47e7-9abc-536dc12a9d23 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:07.430036 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc566f-8d01-49e6-bcf9-62ccf1dbd8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:07.430701 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc566f-8d01-49e6-bcf9-62ccf1dbd8b8 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:07.431041 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc566f-8d01-49e6-bcf9-62ccf1dbd8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:07.431318 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc566f-8d01-49e6-bcf9-62ccf1dbd8b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:07.432093 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc566f-8d01-49e6-bcf9-62ccf1dbd8b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:07.432447 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc566f-8d01-49e6-bcf9-62ccf1dbd8b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:07.433874 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc566f-8d01-49e6-bcf9-62ccf1dbd8b8 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:07.447238 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 253/496] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:04:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:07.448325 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc566f-8d01-49e6-bcf9-62ccf1dbd8b8 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:07.483194 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25fdddd-709b-4518-a036-b71f49b9fd89 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:07.518342 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd5f7c-4008-4c70-9e6c-094b8af7d4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:07.519010 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd5f7c-4008-4c70-9e6c-094b8af7d4b1 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:07.519296 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd5f7c-4008-4c70-9e6c-094b8af7d4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:07.519578 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd5f7c-4008-4c70-9e6c-094b8af7d4b1 None admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:07.521042 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dd5f7c-4008-4c70-9e6c-094b8af7d4b1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:07.521645 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dd5f7c-4008-4c70-9e6c-094b8af7d4b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:07.524320 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dd5f7c-4008-4c70-9e6c-094b8af7d4b1 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:07.547882 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc566f-8d01-49e6-bcf9-62ccf1dbd8b8 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:07.560342 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 244/497] 10.222.0.65 () {56 vars in 1133 bytes} [Tue May 17 18:04:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:07.561715 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd5f7c-4008-4c70-9e6c-094b8af7d4b1 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:07.580204 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655c5e31-34c6-412d-ac46-01a4a30c621d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:07.580796 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c5e31-34c6-412d-ac46-01a4a30c621d None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:07.581073 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c5e31-34c6-412d-ac46-01a4a30c621d None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:07.581345 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c5e31-34c6-412d-ac46-01a4a30c621d None admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:07.582107 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655c5e31-34c6-412d-ac46-01a4a30c621d None admin] RBAC: Adding query filter params (name=service) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:07.582409 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655c5e31-34c6-412d-ac46-01a4a30c621d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:07.583777 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655c5e31-34c6-412d-ac46-01a4a30c621d None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:07.591213 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 254/498] 10.222.0.65 () {56 vars in 1103 bytes} [Tue May 17 18:04:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:07.592417 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4161e-192a-493f-916d-c61f11cb4ffa None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:07.592697 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4161e-192a-493f-916d-c61f11cb4ffa None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:07.592966 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4161e-192a-493f-916d-c61f11cb4ffa None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:07.597432 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 255/499] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:04:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:04:07.597432 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde09cc-34e7-482b-ab90-2b7a16f18adb None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:07.597432 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde09cc-34e7-482b-ab90-2b7a16f18adb None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:07.597432 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde09cc-34e7-482b-ab90-2b7a16f18adb None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:07.597432 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 256/500] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:04:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:04:07.598008 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde09cc-34e7-482b-ab90-2b7a16f18adb None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:07.660603 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd5f7c-4008-4c70-9e6c-094b8af7d4b1 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:07.691226 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde09cc-34e7-482b-ab90-2b7a16f18adb None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:07.692199 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f3d6d-b56c-4105-b926-939740e43267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:07.693242 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f3d6d-b56c-4105-b926-939740e43267 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:07.693549 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f3d6d-b56c-4105-b926-939740e43267 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:07.693822 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f3d6d-b56c-4105-b926-939740e43267 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:07.700560 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018f3d6d-b56c-4105-b926-939740e43267 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:07.702597 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018f3d6d-b56c-4105-b926-939740e43267 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:07.719208 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-018f3d6d-b56c-4105-b926-939740e43267 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 17 18:04:07.719208 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:07.719208 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:07.719208 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:07.719208 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:07.719208 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:07.719208 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:07.719208 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:07.719208 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:07.719208 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:07.719208 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:07.719208 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:07.719208 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 18:04:07.719208 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 18:04:07.719208 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 18:04:07.719208 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 18:04:07.720323 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:07.720323 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:07.720323 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 18:04:07.720323 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:04:07.720323 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 18:04:07.720323 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:04:07.720323 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:07.720323 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:07.720323 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:07.720323 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:07.720323 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:07.720323 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:07.720323 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:07.720323 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:07.720323 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:07.720323 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:07.720323 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:07.720323 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:07.721395 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:07.721395 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:07.721395 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 18:04:07.721395 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 18:04:07.721395 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 18:04:07.721395 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 18:04:07.721395 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 18:04:07.721395 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 18:04:07.721395 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 17 18:04:07.721395 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:07.721395 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 245/501] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 17 18:04:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:07.721395 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f3d6d-b56c-4105-b926-939740e43267 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:07.726182 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95869463-5b03-41cc-a59e-1f4a56de4cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:07.726824 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95869463-5b03-41cc-a59e-1f4a56de4cc6 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:07.727104 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95869463-5b03-41cc-a59e-1f4a56de4cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:07.727378 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95869463-5b03-41cc-a59e-1f4a56de4cc6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:07.790507 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95869463-5b03-41cc-a59e-1f4a56de4cc6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:07.791955 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95869463-5b03-41cc-a59e-1f4a56de4cc6 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:07.813283 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f3d6d-b56c-4105-b926-939740e43267 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:07.846343 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b97ca3-366c-4e33-9d3c-d917edb8100f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:07.847120 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b97ca3-366c-4e33-9d3c-d917edb8100f None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:07.847393 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b97ca3-366c-4e33-9d3c-d917edb8100f None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:07.847662 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b97ca3-366c-4e33-9d3c-d917edb8100f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:07.857256 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b97ca3-366c-4e33-9d3c-d917edb8100f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:07.858769 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b97ca3-366c-4e33-9d3c-d917edb8100f None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:07.875365 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-b3b97ca3-366c-4e33-9d3c-d917edb8100f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:07.875365 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:07.875365 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:07.875365 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:07.875365 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:07.875365 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:07.875365 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:07.875365 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:07.875365 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:07.875365 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:07.875365 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:07.875365 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:07.875365 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:04:07.875365 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:04:07.875365 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:04:07.876371 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:04:07.876371 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:07.876371 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:07.876371 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:07.876371 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:07.876371 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:07.876371 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:07.876371 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:07.876371 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:07.876371 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:07.876371 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:07.876371 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:07.876371 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:07.876371 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:07.876371 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:07.876371 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:07.876371 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:07.877415 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:04:07.877415 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:04:07.877415 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:07.877415 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:07.877415 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 246/502] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:04:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:07.877778 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da34ed3-a689-4fdf-a3ec-219a18189700 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:07.877939 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da34ed3-a689-4fdf-a3ec-219a18189700 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:07.878207 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da34ed3-a689-4fdf-a3ec-219a18189700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:07.893182 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 257/503] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 17 18:04:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 18:04:07.893182 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8eafff-beea-4d53-84c1-894f9137c18d None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:07.893182 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8eafff-beea-4d53-84c1-894f9137c18d None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:07.893182 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8eafff-beea-4d53-84c1-894f9137c18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:07.895982 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-7da34ed3-a689-4fdf-a3ec-219a18189700 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:07.897228 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-7da34ed3-a689-4fdf-a3ec-219a18189700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:07.906775 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-4e8eafff-beea-4d53-84c1-894f9137c18d None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:07.907947 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-4e8eafff-beea-4d53-84c1-894f9137c18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:07.959680 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 247/504] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:04:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:04:07.960494 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da34ed3-a689-4fdf-a3ec-219a18189700 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:07.971567 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 258/505] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:04:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:04:07.972387 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8eafff-beea-4d53-84c1-894f9137c18d None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:08.062059 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da34ed3-a689-4fdf-a3ec-219a18189700 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:08.064954 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8eafff-beea-4d53-84c1-894f9137c18d None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:08.094458 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70822e12-9108-4eb1-a91a-01a22ec56f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:08.095049 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70822e12-9108-4eb1-a91a-01a22ec56f64 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:08.095325 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70822e12-9108-4eb1-a91a-01a22ec56f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:08.095594 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70822e12-9108-4eb1-a91a-01a22ec56f64 None admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:08.096422 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70822e12-9108-4eb1-a91a-01a22ec56f64 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:08.096729 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70822e12-9108-4eb1-a91a-01a22ec56f64 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:08.097532 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ae429-e1fe-409b-8f0f-70a87959186a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:08.098181 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ae429-e1fe-409b-8f0f-70a87959186a None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:08.098268 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70822e12-9108-4eb1-a91a-01a22ec56f64 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:08.098455 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ae429-e1fe-409b-8f0f-70a87959186a None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:08.098721 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ae429-e1fe-409b-8f0f-70a87959186a None admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:08.099431 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35ae429-e1fe-409b-8f0f-70a87959186a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:08.099892 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35ae429-e1fe-409b-8f0f-70a87959186a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:08.101245 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35ae429-e1fe-409b-8f0f-70a87959186a None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:08.118675 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 259/506] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:04:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:08.118675 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ae429-e1fe-409b-8f0f-70a87959186a None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:08.126847 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 248/507] 10.222.0.65 () {56 vars in 1137 bytes} [Tue May 17 18:04:07 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:08.126847 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70822e12-9108-4eb1-a91a-01a22ec56f64 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:08.208023 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ae429-e1fe-409b-8f0f-70a87959186a None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:08.215841 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70822e12-9108-4eb1-a91a-01a22ec56f64 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:08.238290 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8414f8b7-1e81-418a-a21c-b22a1e70e50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:08.239061 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414f8b7-1e81-418a-a21c-b22a1e70e50f None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:08.239334 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414f8b7-1e81-418a-a21c-b22a1e70e50f None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:08.239613 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414f8b7-1e81-418a-a21c-b22a1e70e50f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:08.246522 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aadfee4-8a83-4685-8254-51473f67e9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:08.247285 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aadfee4-8a83-4685-8254-51473f67e9e8 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:08.247563 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aadfee4-8a83-4685-8254-51473f67e9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:08.247834 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aadfee4-8a83-4685-8254-51473f67e9e8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:08.250067 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8414f8b7-1e81-418a-a21c-b22a1e70e50f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:08.251495 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8414f8b7-1e81-418a-a21c-b22a1e70e50f None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:08.258169 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aadfee4-8a83-4685-8254-51473f67e9e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:04:08.265813 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-3aadfee4-8a83-4685-8254-51473f67e9e8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 18:04:08.265813 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:08.265813 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:08.265813 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:08.265813 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:08.265813 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:08.265813 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:08.265813 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:08.265813 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:08.265813 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:08.265813 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:08.265813 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:08.265813 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:04:08.265813 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:04:08.265813 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:04:08.265813 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:04:08.266699 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:04:08.266699 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:04:08.266699 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:04:08.266699 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:04:08.266699 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:08.266699 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:08.266699 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:08.266699 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:08.266699 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:08.266699 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:08.266699 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:08.266699 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:08.266699 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:08.266699 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:08.266699 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:08.266699 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:08.267501 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:08.267501 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:08.267501 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:08.267501 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:08.267501 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:04:08.267501 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:04:08.267501 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:04:08.267501 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:04:08.267501 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:04:08.267501 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:04:08.267501 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 18:04:08.267501 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:08.267501 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 249/508] 10.222.0.65 () {56 vars in 1102 bytes} [Tue May 17 18:04:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:08.268162 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aadfee4-8a83-4685-8254-51473f67e9e8 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:08.268783 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-8414f8b7-1e81-418a-a21c-b22a1e70e50f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:08.268783 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:08.268783 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:08.268783 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:08.268783 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:08.268783 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:08.268783 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:08.268783 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:08.268783 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:08.268783 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:08.268783 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:08.268783 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:08.268783 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:04:08.268783 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:04:08.268783 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:04:08.269628 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:04:08.269628 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:08.269628 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:08.269628 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:08.269628 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:08.269628 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:08.269628 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:08.269628 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:08.269628 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:08.269628 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:08.269628 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:08.269628 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:08.269628 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:08.269628 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:08.269628 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:08.269628 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:08.269628 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:08.270463 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:04:08.270463 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:04:08.270463 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:08.270463 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:08.270463 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 260/509] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:04:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:08.271168 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8414f8b7-1e81-418a-a21c-b22a1e70e50f None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:08.362258 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aadfee4-8a83-4685-8254-51473f67e9e8 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:08.364161 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8414f8b7-1e81-418a-a21c-b22a1e70e50f None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:08.392636 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f3034-8db7-4276-ac0a-8e5f23890de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:08.393416 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f3034-8db7-4276-ac0a-8e5f23890de5 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:08.393721 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f3034-8db7-4276-ac0a-8e5f23890de5 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:08.393997 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f3034-8db7-4276-ac0a-8e5f23890de5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:08.395703 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2518fcdd-53d0-43bc-b745-8990dcb0a7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:08.396472 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518fcdd-53d0-43bc-b745-8990dcb0a7be None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:08.396754 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518fcdd-53d0-43bc-b745-8990dcb0a7be None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:08.397010 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518fcdd-53d0-43bc-b745-8990dcb0a7be None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:08.404037 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37f3034-8db7-4276-ac0a-8e5f23890de5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:08.404170 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2518fcdd-53d0-43bc-b745-8990dcb0a7be None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:08.406026 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37f3034-8db7-4276-ac0a-8e5f23890de5 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:08.406127 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2518fcdd-53d0-43bc-b745-8990dcb0a7be None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:08.419494 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-2518fcdd-53d0-43bc-b745-8990dcb0a7be None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 17 18:04:08.419494 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:08.419494 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:08.419494 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:08.419494 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:08.419494 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:08.419494 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:08.419494 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:08.419494 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:08.419494 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:08.419494 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:08.419494 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:08.419494 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 18:04:08.419494 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 18:04:08.419494 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 18:04:08.419494 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 18:04:08.420950 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:08.420950 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:08.420950 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 18:04:08.420950 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:04:08.420950 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 18:04:08.420950 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:04:08.420950 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:08.420950 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:08.420950 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:08.420950 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:08.420950 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:08.420950 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:08.420950 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:08.420950 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:08.420950 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:08.420950 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:08.420950 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:08.420950 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:08.422095 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:08.422095 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:08.422095 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 18:04:08.422095 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 18:04:08.422095 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 18:04:08.422095 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 18:04:08.422095 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 18:04:08.422095 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 18:04:08.422095 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 17 18:04:08.422095 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:08.422095 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 261/510] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 17 18:04:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:08.422095 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2518fcdd-53d0-43bc-b745-8990dcb0a7be None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:08.423009 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-d37f3034-8db7-4276-ac0a-8e5f23890de5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:08.423009 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:08.423009 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:08.423009 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:08.423009 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:08.423009 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:08.423009 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:08.423009 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:08.423009 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:08.423009 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:08.423009 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:08.423009 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:08.423009 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:04:08.423009 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:04:08.423009 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:04:08.424444 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:04:08.424444 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:08.424444 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:08.424444 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:08.424444 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:08.424444 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:08.424444 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:08.424444 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:08.424444 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:08.424444 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:08.424444 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:08.424444 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:08.424444 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:08.424444 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:08.424444 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:08.424444 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:08.424444 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:08.426001 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:04:08.426001 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:04:08.426001 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:08.426001 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:08.428941 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 250/511] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:04:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:08.429825 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f3034-8db7-4276-ac0a-8e5f23890de5 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:08.524239 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2518fcdd-53d0-43bc-b745-8990dcb0a7be None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:08.527188 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f3034-8db7-4276-ac0a-8e5f23890de5 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:08.557021 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eef05f-9298-4afb-850a-804a5b992cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:08.557695 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eef05f-9298-4afb-850a-804a5b992cb4 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:08.557979 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eef05f-9298-4afb-850a-804a5b992cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:08.558252 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eef05f-9298-4afb-850a-804a5b992cb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:08.559229 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e559ae87-f562-42fc-b539-bf0bc710ddd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:08.559880 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559ae87-f562-42fc-b539-bf0bc710ddd3 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:08.560161 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559ae87-f562-42fc-b539-bf0bc710ddd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:08.560437 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559ae87-f562-42fc-b539-bf0bc710ddd3 None admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:08.561156 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e559ae87-f562-42fc-b539-bf0bc710ddd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:08.561476 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e559ae87-f562-42fc-b539-bf0bc710ddd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:08.562862 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e559ae87-f562-42fc-b539-bf0bc710ddd3 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:08.574417 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 251/512] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:04:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:08.575201 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e559ae87-f562-42fc-b539-bf0bc710ddd3 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:08.622817 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eef05f-9298-4afb-850a-804a5b992cb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:08.624232 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eef05f-9298-4afb-850a-804a5b992cb4 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:08.667636 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e559ae87-f562-42fc-b539-bf0bc710ddd3 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:08.699984 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5851561c-7286-4a69-8e6d-1495f6153081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:08.700630 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851561c-7286-4a69-8e6d-1495f6153081 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:08.700964 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851561c-7286-4a69-8e6d-1495f6153081 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:08.701238 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851561c-7286-4a69-8e6d-1495f6153081 None admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:08.702562 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5851561c-7286-4a69-8e6d-1495f6153081 None admin] RBAC: Adding query filter params (name=service) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:08.702865 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5851561c-7286-4a69-8e6d-1495f6153081 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:08.704245 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5851561c-7286-4a69-8e6d-1495f6153081 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:08.711767 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 252/513] 10.222.0.65 () {56 vars in 1103 bytes} [Tue May 17 18:04:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:08.712540 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5851561c-7286-4a69-8e6d-1495f6153081 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:08.723266 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 262/514] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 17 18:04:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 18:04:08.723266 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eef05f-9298-4afb-850a-804a5b992cb4 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:08.805841 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5851561c-7286-4a69-8e6d-1495f6153081 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:08.810414 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eef05f-9298-4afb-850a-804a5b992cb4 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:08.838479 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1782123c-eff0-4ab0-b94c-b7d9ebf5bda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:08.839160 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782123c-eff0-4ab0-b94c-b7d9ebf5bda9 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:08.839440 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782123c-eff0-4ab0-b94c-b7d9ebf5bda9 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:08.839715 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782123c-eff0-4ab0-b94c-b7d9ebf5bda9 None admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:08.840562 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1782123c-eff0-4ab0-b94c-b7d9ebf5bda9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:08.840868 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1782123c-eff0-4ab0-b94c-b7d9ebf5bda9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:08.842836 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1782123c-eff0-4ab0-b94c-b7d9ebf5bda9 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:08.848035 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e85bf6-891a-427e-9355-74dd97a695db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:08.848693 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e85bf6-891a-427e-9355-74dd97a695db None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:08.848960 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e85bf6-891a-427e-9355-74dd97a695db None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:08.849227 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e85bf6-891a-427e-9355-74dd97a695db None admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:08.849979 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e85bf6-891a-427e-9355-74dd97a695db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:08.850282 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e85bf6-891a-427e-9355-74dd97a695db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:08.851644 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e85bf6-891a-427e-9355-74dd97a695db None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:08.863585 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 263/515] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:04:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:08.864404 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e85bf6-891a-427e-9355-74dd97a695db None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:08.871252 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 253/516] 10.222.0.65 () {56 vars in 1137 bytes} [Tue May 17 18:04:08 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:08.871252 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1782123c-eff0-4ab0-b94c-b7d9ebf5bda9 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:08.959621 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e85bf6-891a-427e-9355-74dd97a695db None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:08.967734 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1782123c-eff0-4ab0-b94c-b7d9ebf5bda9 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:08.990831 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a09117b-3179-410c-b99e-fe0b5bce41d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:08.991603 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09117b-3179-410c-b99e-fe0b5bce41d0 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:08.991977 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09117b-3179-410c-b99e-fe0b5bce41d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:08.992248 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09117b-3179-410c-b99e-fe0b5bce41d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:08.998583 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a09117b-3179-410c-b99e-fe0b5bce41d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:09.000007 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a09117b-3179-410c-b99e-fe0b5bce41d0 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:09.000113 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb7dfa3-7055-42cf-a71b-e765f43c90c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:09.000841 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7dfa3-7055-42cf-a71b-e765f43c90c5 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:09.001119 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7dfa3-7055-42cf-a71b-e765f43c90c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:09.001388 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7dfa3-7055-42cf-a71b-e765f43c90c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:09.010930 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb7dfa3-7055-42cf-a71b-e765f43c90c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:09.012362 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb7dfa3-7055-42cf-a71b-e765f43c90c5 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:09.014047 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-0a09117b-3179-410c-b99e-fe0b5bce41d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:04:09.014047 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:09.014047 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:09.014047 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:09.014047 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:09.014047 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:09.014047 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:09.014047 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:09.014047 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:09.014047 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:09.014047 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:09.014047 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:09.014047 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 18:04:09.014047 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 18:04:09.014047 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 18:04:09.014893 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 18:04:09.014893 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:09.014893 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:09.014893 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:09.014893 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:09.014893 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:09.014893 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:09.014893 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:09.014893 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:09.014893 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:09.014893 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:09.014893 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:09.014893 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:09.014893 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:09.014893 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:09.014893 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:09.014893 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:09.015735 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 18:04:09.015735 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 18:04:09.015735 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 18:04:09.015735 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 18:04:09.015735 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 18:04:09.015735 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 18:04:09.015735 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:04:09.015735 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:09.015735 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 264/517] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 17 18:04:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:09.016252 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a09117b-3179-410c-b99e-fe0b5bce41d0 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:09.032946 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-beb7dfa3-7055-42cf-a71b-e765f43c90c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:09.032946 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:09.032946 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:09.032946 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:09.032946 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:09.032946 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:09.032946 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:09.032946 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:09.032946 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:09.032946 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:09.032946 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:09.032946 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:09.032946 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:04:09.032946 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:04:09.032946 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:04:09.034186 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:04:09.034186 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:09.034186 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:09.034186 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:09.034186 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:09.034186 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:09.034186 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:09.034186 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:09.034186 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:09.034186 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:09.034186 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:09.034186 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:09.034186 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:09.034186 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:09.034186 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:09.034186 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:09.034186 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:09.035048 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:04:09.035048 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:04:09.035048 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:09.035048 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:09.035048 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 254/518] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:04:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:09.035560 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb7dfa3-7055-42cf-a71b-e765f43c90c5 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:09.107911 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a09117b-3179-410c-b99e-fe0b5bce41d0 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:09.128092 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb7dfa3-7055-42cf-a71b-e765f43c90c5 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:09.140211 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e192c-90d6-4551-bb05-3857e8186fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:09.140988 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e192c-90d6-4551-bb05-3857e8186fef None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:09.141263 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e192c-90d6-4551-bb05-3857e8186fef None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:09.141559 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8e192c-90d6-4551-bb05-3857e8186fef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:09.151156 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8e192c-90d6-4551-bb05-3857e8186fef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:09.152602 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8e192c-90d6-4551-bb05-3857e8186fef None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:09.160268 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9680e88-4dc5-4bcc-a428-774a79f48850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:09.160914 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9680e88-4dc5-4bcc-a428-774a79f48850 None admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:09.161186 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9680e88-4dc5-4bcc-a428-774a79f48850 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:09.161452 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9680e88-4dc5-4bcc-a428-774a79f48850 None admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:09.162193 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9680e88-4dc5-4bcc-a428-774a79f48850 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:09.163592 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9680e88-4dc5-4bcc-a428-774a79f48850 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:09.175372 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-6d8e192c-90d6-4551-bb05-3857e8186fef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:09.175372 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:09.175372 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:09.175372 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:09.175372 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:09.175372 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:09.175372 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:09.175372 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:09.175372 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:09.175372 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:09.175372 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:09.175372 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:09.175372 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:04:09.175372 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:04:09.175372 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:04:09.176394 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:04:09.176394 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:09.176394 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:09.176394 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:09.176394 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:09.176394 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:09.176394 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:09.176394 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:09.176394 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:09.176394 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:09.176394 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:09.176394 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:09.176394 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:09.176394 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:09.176394 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:09.176394 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:09.176394 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:09.177252 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:04:09.177252 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:04:09.177252 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:09.177252 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:09.177252 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 265/519] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:04:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:09.177544 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e192c-90d6-4551-bb05-3857e8186fef None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:09.192993 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 255/520] 10.222.0.65 () {60 vars in 1132 bytes} [Tue May 17 18:04:09 2022] POST /identity/v3/users => generated 247 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:04:09.193855 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9680e88-4dc5-4bcc-a428-774a79f48850 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:09.290371 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8e192c-90d6-4551-bb05-3857e8186fef None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:09.309667 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9680e88-4dc5-4bcc-a428-774a79f48850 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:09.325087 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7753d59a-9183-495d-b9ab-31c0f1473a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:09.325779 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7753d59a-9183-495d-b9ab-31c0f1473a76 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:09.326067 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7753d59a-9183-495d-b9ab-31c0f1473a76 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:09.327187 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7753d59a-9183-495d-b9ab-31c0f1473a76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:09.347348 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd233b6-d0b1-4ea8-a8ed-4befb296f989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:09.348014 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd233b6-d0b1-4ea8-a8ed-4befb296f989 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:09.348290 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd233b6-d0b1-4ea8-a8ed-4befb296f989 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:09.348557 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd233b6-d0b1-4ea8-a8ed-4befb296f989 None admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:09.349799 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd233b6-d0b1-4ea8-a8ed-4befb296f989 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:09.349799 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd233b6-d0b1-4ea8-a8ed-4befb296f989 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:09.351109 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd233b6-d0b1-4ea8-a8ed-4befb296f989 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:09.375326 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 256/521] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 17 18:04:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:09.375326 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd233b6-d0b1-4ea8-a8ed-4befb296f989 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:09.398200 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7753d59a-9183-495d-b9ab-31c0f1473a76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:09.399412 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7753d59a-9183-495d-b9ab-31c0f1473a76 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:09.479673 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd233b6-d0b1-4ea8-a8ed-4befb296f989 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:09.495657 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 266/522] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 17 18:04:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 18:04:09.496513 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7753d59a-9183-495d-b9ab-31c0f1473a76 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:09.513762 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3152d00-3290-4bff-a824-063c514ce750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:09.514462 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3152d00-3290-4bff-a824-063c514ce750 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:09.514742 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3152d00-3290-4bff-a824-063c514ce750 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:09.515021 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3152d00-3290-4bff-a824-063c514ce750 None admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:09.515739 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3152d00-3290-4bff-a824-063c514ce750 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:09.516047 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3152d00-3290-4bff-a824-063c514ce750 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:09.517441 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3152d00-3290-4bff-a824-063c514ce750 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:09.533081 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 257/523] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:04:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:09.533081 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3152d00-3290-4bff-a824-063c514ce750 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:09.593521 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7753d59a-9183-495d-b9ab-31c0f1473a76 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:09.626257 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89822fbb-12c9-4894-8a20-e62109985d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:09.626911 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89822fbb-12c9-4894-8a20-e62109985d94 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:09.627189 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89822fbb-12c9-4894-8a20-e62109985d94 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:09.627460 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89822fbb-12c9-4894-8a20-e62109985d94 None admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:09.628173 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89822fbb-12c9-4894-8a20-e62109985d94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:09.628471 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89822fbb-12c9-4894-8a20-e62109985d94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:09.629866 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89822fbb-12c9-4894-8a20-e62109985d94 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:09.635554 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3152d00-3290-4bff-a824-063c514ce750 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:09.641414 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 267/524] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:04:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:09.642346 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89822fbb-12c9-4894-8a20-e62109985d94 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:09.670849 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddfcd94-2ac1-43aa-9f06-8810e38c5dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:09.671500 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddfcd94-2ac1-43aa-9f06-8810e38c5dbd None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:09.671782 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddfcd94-2ac1-43aa-9f06-8810e38c5dbd None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:09.672057 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddfcd94-2ac1-43aa-9f06-8810e38c5dbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:09.672879 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddfcd94-2ac1-43aa-9f06-8810e38c5dbd None admin] RBAC: Adding query filter params (role.id=60e39e2185d346a192b8698767df6018, scope.project.id=0cf165918c1f46cb96d4b54409862659, user.id=5b430b739cb54fc7911bc89f8ea2df72) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:09.673189 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddfcd94-2ac1-43aa-9f06-8810e38c5dbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:09.674647 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddfcd94-2ac1-43aa-9f06-8810e38c5dbd None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:09.689503 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 258/525] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 17 18:04:09 2022] GET /identity/v3/role_assignments?user.id=5b430b739cb54fc7911bc89f8ea2df72&scope.project.id=0cf165918c1f46cb96d4b54409862659&role.id=60e39e2185d346a192b8698767df6018 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:09.689503 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddfcd94-2ac1-43aa-9f06-8810e38c5dbd None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:09.762856 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89822fbb-12c9-4894-8a20-e62109985d94 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:09.800515 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97c98b4-87ee-4a39-9b61-522446e0a73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:09.801506 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c98b4-87ee-4a39-9b61-522446e0a73e None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:09.801893 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c98b4-87ee-4a39-9b61-522446e0a73e None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:09.802269 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c98b4-87ee-4a39-9b61-522446e0a73e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:09.809354 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddfcd94-2ac1-43aa-9f06-8810e38c5dbd None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:09.814147 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97c98b4-87ee-4a39-9b61-522446e0a73e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:09.815921 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97c98b4-87ee-4a39-9b61-522446e0a73e None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:09.837071 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-c97c98b4-87ee-4a39-9b61-522446e0a73e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:09.837071 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:09.837071 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:09.837071 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:09.837071 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:09.837071 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:09.837071 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:09.837071 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:09.837071 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:09.837071 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:09.837071 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:09.837071 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:09.837071 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:04:09.837071 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:04:09.837071 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:04:09.837929 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:04:09.837929 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:09.837929 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:09.837929 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:09.837929 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:09.837929 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:09.837929 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:09.837929 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:09.837929 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:09.837929 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:09.837929 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:09.837929 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:09.837929 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:09.837929 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:09.837929 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:09.837929 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:09.837929 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:09.838779 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:04:09.838779 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:04:09.838779 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:09.838779 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:09.838779 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 268/526] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:04:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:09.839933 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97c98b4-87ee-4a39-9b61-522446e0a73e None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:09.852634 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a8fb4-d358-41b6-b529-abefcb83ca56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:09.853380 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a8fb4-d358-41b6-b529-abefcb83ca56 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:09.854096 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a8fb4-d358-41b6-b529-abefcb83ca56 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:09.854383 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a8fb4-d358-41b6-b529-abefcb83ca56 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:09.866930 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689a8fb4-d358-41b6-b529-abefcb83ca56 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:09.869093 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689a8fb4-d358-41b6-b529-abefcb83ca56 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:09.887639 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-689a8fb4-d358-41b6-b529-abefcb83ca56 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 17 18:04:09.887639 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:09.887639 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:09.887639 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:09.887639 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:09.887639 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:09.887639 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:09.887639 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:09.887639 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:09.887639 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:09.887639 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:09.887639 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:09.887639 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 18:04:09.887639 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 18:04:09.887639 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 18:04:09.887639 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 18:04:09.888606 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:09.888606 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:09.888606 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 18:04:09.888606 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:04:09.888606 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 18:04:09.888606 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:04:09.888606 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:09.888606 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:09.888606 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:09.888606 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:09.888606 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:09.888606 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:09.888606 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:09.888606 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:09.888606 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:09.888606 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:09.888606 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:09.888606 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:09.889648 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:09.889648 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:09.889648 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 18:04:09.889648 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 18:04:09.889648 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 18:04:09.889648 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 18:04:09.889648 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 18:04:09.889648 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 18:04:09.889648 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 17 18:04:09.889648 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:09.889648 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 259/527] 10.222.0.65 () {56 vars in 1102 bytes} [Tue May 17 18:04:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:09.890371 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a8fb4-d358-41b6-b529-abefcb83ca56 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:09.947483 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97c98b4-87ee-4a39-9b61-522446e0a73e None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:09.980505 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779adfc8-7044-45f0-91d0-4abc1efafeb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:09.981605 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779adfc8-7044-45f0-91d0-4abc1efafeb0 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:09.982031 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779adfc8-7044-45f0-91d0-4abc1efafeb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:09.982463 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779adfc8-7044-45f0-91d0-4abc1efafeb0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:09.989878 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779adfc8-7044-45f0-91d0-4abc1efafeb0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:09.991530 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779adfc8-7044-45f0-91d0-4abc1efafeb0 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:09.992438 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a8fb4-d358-41b6-b529-abefcb83ca56 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:10.006470 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-779adfc8-7044-45f0-91d0-4abc1efafeb0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:04:10.006470 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:10.006470 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:10.006470 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:10.006470 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:10.006470 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:10.006470 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:10.006470 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:10.006470 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:10.006470 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:10.006470 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:10.006470 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:10.006470 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 18:04:10.006470 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 18:04:10.006470 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 18:04:10.007371 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 18:04:10.007371 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:10.007371 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:10.007371 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:10.007371 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:10.007371 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:10.007371 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:10.007371 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:10.007371 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:10.007371 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:10.007371 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:10.007371 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:10.007371 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:10.007371 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:10.007371 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:10.007371 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:10.007371 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:10.008243 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 18:04:10.008243 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 18:04:10.008243 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 18:04:10.008243 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 18:04:10.008243 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 18:04:10.008243 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 18:04:10.008243 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:04:10.008243 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:10.010803 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 269/528] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 17 18:04:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:10.011915 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779adfc8-7044-45f0-91d0-4abc1efafeb0 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:10.028901 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b20c25-b7b6-49b7-b31c-65184334ca20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:10.029653 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b20c25-b7b6-49b7-b31c-65184334ca20 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:10.029940 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b20c25-b7b6-49b7-b31c-65184334ca20 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:10.030213 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b20c25-b7b6-49b7-b31c-65184334ca20 None admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:10.030929 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b20c25-b7b6-49b7-b31c-65184334ca20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:10.031234 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b20c25-b7b6-49b7-b31c-65184334ca20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:10.032594 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b20c25-b7b6-49b7-b31c-65184334ca20 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:10.044926 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 260/529] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:04:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:10.046149 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b20c25-b7b6-49b7-b31c-65184334ca20 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:10.116049 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779adfc8-7044-45f0-91d0-4abc1efafeb0 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:10.152876 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b20c25-b7b6-49b7-b31c-65184334ca20 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:10.155201 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc9034-6c67-4d79-b883-be8de6ce1cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:10.156431 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc9034-6c67-4d79-b883-be8de6ce1cf9 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:10.156924 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc9034-6c67-4d79-b883-be8de6ce1cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:10.157392 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc9034-6c67-4d79-b883-be8de6ce1cf9 None admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:10.158536 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afc9034-6c67-4d79-b883-be8de6ce1cf9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:10.159058 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afc9034-6c67-4d79-b883-be8de6ce1cf9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:10.160700 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afc9034-6c67-4d79-b883-be8de6ce1cf9 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:10.187667 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e8ce4-31bc-4d30-b8ce-91e4b6aa1f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:10.188330 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e8ce4-31bc-4d30-b8ce-91e4b6aa1f0a None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:10.188610 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e8ce4-31bc-4d30-b8ce-91e4b6aa1f0a None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:10.188885 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163e8ce4-31bc-4d30-b8ce-91e4b6aa1f0a None admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:10.189696 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163e8ce4-31bc-4d30-b8ce-91e4b6aa1f0a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:10.190006 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163e8ce4-31bc-4d30-b8ce-91e4b6aa1f0a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:10.191442 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163e8ce4-31bc-4d30-b8ce-91e4b6aa1f0a None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:10.199520 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 270/530] 10.222.0.65 () {56 vars in 1139 bytes} [Tue May 17 18:04:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:10.200757 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc9034-6c67-4d79-b883-be8de6ce1cf9 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:10.204591 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 261/531] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 17 18:04:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:10.205451 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e8ce4-31bc-4d30-b8ce-91e4b6aa1f0a None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:10.300729 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc9034-6c67-4d79-b883-be8de6ce1cf9 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:10.304930 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163e8ce4-31bc-4d30-b8ce-91e4b6aa1f0a None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:10.336176 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c00d742-e34f-4450-9b28-739353efdb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:10.337322 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c00d742-e34f-4450-9b28-739353efdb2b None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:10.337815 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c00d742-e34f-4450-9b28-739353efdb2b None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:10.338295 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c00d742-e34f-4450-9b28-739353efdb2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:10.339959 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f9a29-405f-4cdf-958a-9acdfb81a75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:10.340607 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f9a29-405f-4cdf-958a-9acdfb81a75b None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:10.340891 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f9a29-405f-4cdf-958a-9acdfb81a75b None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:10.341168 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f9a29-405f-4cdf-958a-9acdfb81a75b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:10.346961 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c00d742-e34f-4450-9b28-739353efdb2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:10.348705 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c00d742-e34f-4450-9b28-739353efdb2b None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:10.362629 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-5c00d742-e34f-4450-9b28-739353efdb2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:04:10.362629 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:10.362629 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:10.362629 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:10.362629 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:10.362629 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:10.362629 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:10.362629 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:10.362629 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:10.362629 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:10.362629 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:10.362629 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:10.362629 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 18:04:10.362629 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 18:04:10.362629 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 18:04:10.363517 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 18:04:10.363517 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:10.363517 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:10.363517 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:10.363517 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:10.363517 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:10.363517 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:10.363517 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:10.363517 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:10.363517 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:10.363517 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:10.363517 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:10.363517 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:10.363517 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:10.363517 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:10.363517 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:10.363517 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:10.364368 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 18:04:10.364368 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 18:04:10.364368 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 18:04:10.364368 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 18:04:10.364368 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 18:04:10.364368 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 18:04:10.364368 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:04:10.364368 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:10.367109 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 271/532] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 17 18:04:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:10.368307 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c00d742-e34f-4450-9b28-739353efdb2b None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:10.414035 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1f9a29-405f-4cdf-958a-9acdfb81a75b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:10.415676 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1f9a29-405f-4cdf-958a-9acdfb81a75b None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:10.471602 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c00d742-e34f-4450-9b28-739353efdb2b None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:10.506129 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf95b2f-d61f-492f-b209-fe6627f573ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:10.507166 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf95b2f-d61f-492f-b209-fe6627f573ec None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:10.507645 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf95b2f-d61f-492f-b209-fe6627f573ec None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:10.508118 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf95b2f-d61f-492f-b209-fe6627f573ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:10.509251 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf95b2f-d61f-492f-b209-fe6627f573ec None admin] RBAC: Adding query filter params (role.id=60e39e2185d346a192b8698767df6018, scope.project.id=0cf165918c1f46cb96d4b54409862659, user.id=ce570634a66b45158d940151828f533a) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:10.509783 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf95b2f-d61f-492f-b209-fe6627f573ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:10.511433 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf95b2f-d61f-492f-b209-fe6627f573ec None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:10.517874 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 262/534] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 17 18:04:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 17 18:04:10.518127 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 272/534] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 17 18:04:10 2022] GET /identity/v3/role_assignments?user.id=ce570634a66b45158d940151828f533a&scope.project.id=0cf165918c1f46cb96d4b54409862659&role.id=60e39e2185d346a192b8698767df6018 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:10.518727 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f9a29-405f-4cdf-958a-9acdfb81a75b None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:10.532689 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf95b2f-d61f-492f-b209-fe6627f573ec None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:10.635568 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f9a29-405f-4cdf-958a-9acdfb81a75b None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:10.678352 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf95b2f-d61f-492f-b209-fe6627f573ec None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:10.681410 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a9004-42e4-4f7b-8520-cca5c2206371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:10.682493 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a9004-42e4-4f7b-8520-cca5c2206371 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:10.682493 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a9004-42e4-4f7b-8520-cca5c2206371 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:10.682655 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a9004-42e4-4f7b-8520-cca5c2206371 None admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:10.683428 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a9004-42e4-4f7b-8520-cca5c2206371 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:10.683737 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a9004-42e4-4f7b-8520-cca5c2206371 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:10.685213 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a9004-42e4-4f7b-8520-cca5c2206371 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:10.698848 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 263/535] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 17 18:04:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:10.711874 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a9004-42e4-4f7b-8520-cca5c2206371 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:10.729391 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97deb87a-e468-4e6d-b518-06c36e8a8fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:10.730430 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97deb87a-e468-4e6d-b518-06c36e8a8fb0 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:10.730880 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97deb87a-e468-4e6d-b518-06c36e8a8fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:10.731300 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97deb87a-e468-4e6d-b518-06c36e8a8fb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:10.743800 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97deb87a-e468-4e6d-b518-06c36e8a8fb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:10.745445 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97deb87a-e468-4e6d-b518-06c36e8a8fb0 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:10.762514 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-97deb87a-e468-4e6d-b518-06c36e8a8fb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:10.762514 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:10.762514 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:10.762514 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:10.762514 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:10.762514 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:10.762514 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:10.762514 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:10.762514 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:10.762514 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:10.762514 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:10.762514 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:10.762514 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:04:10.762514 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:04:10.762514 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:04:10.763515 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:04:10.763515 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:10.763515 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:10.763515 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:10.763515 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:10.763515 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:10.763515 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:10.763515 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:10.763515 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:10.763515 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:10.763515 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:10.763515 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:10.763515 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:10.763515 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:10.763515 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:10.763515 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:10.763515 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:10.765126 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:04:10.765126 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:04:10.765126 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:10.765126 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:10.766941 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 273/536] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:04:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:04:10.774449 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97deb87a-e468-4e6d-b518-06c36e8a8fb0 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:10.891314 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a9004-42e4-4f7b-8520-cca5c2206371 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:10.943930 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97deb87a-e468-4e6d-b518-06c36e8a8fb0 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:10.954915 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7f0b1-4a4e-43b2-87ea-e901b4a81553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:10.955564 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7f0b1-4a4e-43b2-87ea-e901b4a81553 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:10.955837 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7f0b1-4a4e-43b2-87ea-e901b4a81553 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:10.956102 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7f0b1-4a4e-43b2-87ea-e901b4a81553 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:10.956927 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a7f0b1-4a4e-43b2-87ea-e901b4a81553 None admin] RBAC: Adding query filter params (role.id=60e39e2185d346a192b8698767df6018, scope.project.id=0cf165918c1f46cb96d4b54409862659, user.id=769f675c28e34902a079c70dab44dbf8) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:10.957228 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a7f0b1-4a4e-43b2-87ea-e901b4a81553 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:10.958670 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a7f0b1-4a4e-43b2-87ea-e901b4a81553 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:10.969054 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 264/537] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 17 18:04:10 2022] GET /identity/v3/role_assignments?user.id=769f675c28e34902a079c70dab44dbf8&scope.project.id=0cf165918c1f46cb96d4b54409862659&role.id=60e39e2185d346a192b8698767df6018 => generated 259 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:11.020226 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a27b59-5c2e-410e-8d51-fef9f849f3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:11.020913 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a27b59-5c2e-410e-8d51-fef9f849f3dc None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:11.021193 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a27b59-5c2e-410e-8d51-fef9f849f3dc None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:11.021480 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a27b59-5c2e-410e-8d51-fef9f849f3dc None admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:11.029346 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a27b59-5c2e-410e-8d51-fef9f849f3dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:11.029346 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a27b59-5c2e-410e-8d51-fef9f849f3dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:11.029346 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a27b59-5c2e-410e-8d51-fef9f849f3dc None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:11.048202 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 274/538] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:04:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:11.053749 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7f0b1-4a4e-43b2-87ea-e901b4a81553 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:11.206158 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7f0b1-4a4e-43b2-87ea-e901b4a81553 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:11.240120 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f1a867-e8e6-4898-abb6-1a2f15f5c9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:11.240905 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1a867-e8e6-4898-abb6-1a2f15f5c9c6 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:11.241180 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1a867-e8e6-4898-abb6-1a2f15f5c9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:11.241445 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f1a867-e8e6-4898-abb6-1a2f15f5c9c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:11.248267 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f1a867-e8e6-4898-abb6-1a2f15f5c9c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:11.249729 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f1a867-e8e6-4898-abb6-1a2f15f5c9c6 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:11.264040 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-90f1a867-e8e6-4898-abb6-1a2f15f5c9c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:04:11.264040 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:11.264040 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:11.264040 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:11.264040 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:11.264040 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:11.264040 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:11.264040 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:11.264040 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:11.264040 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:11.264040 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:11.264040 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:11.264040 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 18:04:11.264040 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 18:04:11.264040 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 18:04:11.265076 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 18:04:11.265076 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:11.265076 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:11.265076 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:11.265076 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:11.265076 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:11.265076 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:11.265076 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:11.265076 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:11.265076 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:11.265076 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:11.265076 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:11.265076 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:11.265076 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:11.265076 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:11.265076 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:11.265076 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:11.266259 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 18:04:11.266259 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 18:04:11.266259 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 18:04:11.266259 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 18:04:11.266259 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 18:04:11.266259 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 18:04:11.266259 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:04:11.266259 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:11.266259 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 265/539] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 17 18:04:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:11.271093 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a27b59-5c2e-410e-8d51-fef9f849f3dc None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:11.369544 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a27b59-5c2e-410e-8d51-fef9f849f3dc None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:11.402763 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c060184-e99e-4481-aec9-848af67b62bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:11.403420 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c060184-e99e-4481-aec9-848af67b62bf None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:11.403696 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c060184-e99e-4481-aec9-848af67b62bf None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:11.403967 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c060184-e99e-4481-aec9-848af67b62bf None admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:11.405270 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c060184-e99e-4481-aec9-848af67b62bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:11.405602 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c060184-e99e-4481-aec9-848af67b62bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:11.407016 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c060184-e99e-4481-aec9-848af67b62bf None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:11.424823 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 275/540] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 17 18:04:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:11.430543 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f1a867-e8e6-4898-abb6-1a2f15f5c9c6 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:11.537141 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f1a867-e8e6-4898-abb6-1a2f15f5c9c6 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:11.571789 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f10104-9b90-48a3-9ec7-06c388efe9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:11.572439 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f10104-9b90-48a3-9ec7-06c388efe9bf None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:11.572712 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f10104-9b90-48a3-9ec7-06c388efe9bf None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:11.572983 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f10104-9b90-48a3-9ec7-06c388efe9bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:11.573836 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f10104-9b90-48a3-9ec7-06c388efe9bf None admin] RBAC: Adding query filter params (role.id=60e39e2185d346a192b8698767df6018, scope.project.id=0cf165918c1f46cb96d4b54409862659, user.id=83430939ae474ad6bab37dfb6fc8da78) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:11.574147 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f10104-9b90-48a3-9ec7-06c388efe9bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:11.575568 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f10104-9b90-48a3-9ec7-06c388efe9bf None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:11.582070 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 266/541] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 17 18:04:11 2022] GET /identity/v3/role_assignments?user.id=83430939ae474ad6bab37dfb6fc8da78&scope.project.id=0cf165918c1f46cb96d4b54409862659&role.id=60e39e2185d346a192b8698767df6018 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:11.643800 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad11c16-8aaa-42c5-8907-1b71a624c1ce None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:11.644130 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad11c16-8aaa-42c5-8907-1b71a624c1ce None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:11.644353 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad11c16-8aaa-42c5-8907-1b71a624c1ce None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:11.646044 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 276/542] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:04:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:04:11.651753 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4722b25-15e0-4374-b56b-cec59b43d96b None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:11.652035 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4722b25-15e0-4374-b56b-cec59b43d96b None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:11.652309 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4722b25-15e0-4374-b56b-cec59b43d96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:11.674693 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-a4722b25-15e0-4374-b56b-cec59b43d96b None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:11.675912 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-a4722b25-15e0-4374-b56b-cec59b43d96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:11.757813 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 267/543] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:04:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:04:11.793131 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad11c16-8aaa-42c5-8907-1b71a624c1ce None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:11.951117 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad11c16-8aaa-42c5-8907-1b71a624c1ce None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:11.989603 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c33467e-e92f-42ee-a6fd-8e578cbd71ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:11.990400 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33467e-e92f-42ee-a6fd-8e578cbd71ba None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:11.990675 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33467e-e92f-42ee-a6fd-8e578cbd71ba None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:11.990945 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33467e-e92f-42ee-a6fd-8e578cbd71ba None admin] PATH_INFO: `/v3/roles/service` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:12.002009 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c33467e-e92f-42ee-a6fd-8e578cbd71ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:04:12.009761 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-4c33467e-e92f-42ee-a6fd-8e578cbd71ba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 18:04:12.009761 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:12.009761 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:12.009761 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:12.009761 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:12.009761 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:12.009761 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:12.009761 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:12.009761 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:12.009761 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:12.009761 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:12.009761 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:12.009761 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:04:12.009761 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:04:12.009761 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:04:12.009761 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:04:12.010623 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:04:12.010623 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:04:12.010623 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:04:12.010623 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:04:12.010623 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:12.010623 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:12.010623 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:12.010623 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:12.010623 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:12.010623 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:12.010623 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:12.010623 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:12.010623 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:12.010623 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:12.010623 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:12.010623 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:12.011417 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:12.011417 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:12.011417 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:12.011417 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:12.011417 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:04:12.011417 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:04:12.011417 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:04:12.011417 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:04:12.011417 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:04:12.011417 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:04:12.011417 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 18:04:12.011417 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:12.011417 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 277/544] 10.222.0.65 () {56 vars in 1102 bytes} [Tue May 17 18:04:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:12.018134 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4722b25-15e0-4374-b56b-cec59b43d96b None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:12.122964 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4722b25-15e0-4374-b56b-cec59b43d96b None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:12.160432 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d08ad7-ca8d-4ba8-8aa0-9cb65a1c7f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:12.161132 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d08ad7-ca8d-4ba8-8aa0-9cb65a1c7f89 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:12.161475 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d08ad7-ca8d-4ba8-8aa0-9cb65a1c7f89 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:12.161753 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d08ad7-ca8d-4ba8-8aa0-9cb65a1c7f89 None admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:12.162492 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d08ad7-ca8d-4ba8-8aa0-9cb65a1c7f89 None admin] RBAC: Adding query filter params (name=service) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:12.162790 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d08ad7-ca8d-4ba8-8aa0-9cb65a1c7f89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:12.164934 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d08ad7-ca8d-4ba8-8aa0-9cb65a1c7f89 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:12.174246 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 268/545] 10.222.0.65 () {56 vars in 1103 bytes} [Tue May 17 18:04:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:04:12.182517 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c33467e-e92f-42ee-a6fd-8e578cbd71ba None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:12.290397 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c33467e-e92f-42ee-a6fd-8e578cbd71ba None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:12.293192 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e57228-0ab5-44b5-9db0-91d72e047fe2 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:12.293486 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e57228-0ab5-44b5-9db0-91d72e047fe2 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:12.293763 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e57228-0ab5-44b5-9db0-91d72e047fe2 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:12.295769 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 269/546] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:04:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 18:04:12.300658 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321568b9-4ad4-4112-a08f-f12b2021ed56 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:12.301208 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321568b9-4ad4-4112-a08f-f12b2021ed56 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:12.301719 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321568b9-4ad4-4112-a08f-f12b2021ed56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:12.330099 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8289dfb1-dbc5-4957-a583-b5cc21778dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:12.330888 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289dfb1-dbc5-4957-a583-b5cc21778dd0 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:12.331161 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289dfb1-dbc5-4957-a583-b5cc21778dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:12.331429 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289dfb1-dbc5-4957-a583-b5cc21778dd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:12.338427 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-321568b9-4ad4-4112-a08f-f12b2021ed56 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:12.339834 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-321568b9-4ad4-4112-a08f-f12b2021ed56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:12.345490 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8289dfb1-dbc5-4957-a583-b5cc21778dd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:12.345490 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8289dfb1-dbc5-4957-a583-b5cc21778dd0 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:12.363194 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-8289dfb1-dbc5-4957-a583-b5cc21778dd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:12.363194 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:12.363194 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:12.363194 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:12.363194 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:12.363194 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:12.363194 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:12.363194 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:12.363194 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:12.363194 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:12.363194 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:12.363194 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:12.363194 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:04:12.363194 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:04:12.363194 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:04:12.364064 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:04:12.364064 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:12.364064 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:12.364064 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:12.364064 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:12.364064 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:12.364064 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:12.364064 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:12.364064 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:12.364064 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:12.364064 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:12.364064 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:12.364064 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:12.364064 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:12.364064 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:12.364064 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:12.364064 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:12.364907 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:04:12.364907 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:04:12.364907 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:12.364907 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:12.364907 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 278/547] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:04:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:12.373225 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8289dfb1-dbc5-4957-a583-b5cc21778dd0 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:12.473657 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 270/548] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:04:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:04:12.508081 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321568b9-4ad4-4112-a08f-f12b2021ed56 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:12.520080 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8289dfb1-dbc5-4957-a583-b5cc21778dd0 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:12.558509 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9976b86-f1a7-4ccd-8f51-12c543e04801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:12.559546 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9976b86-f1a7-4ccd-8f51-12c543e04801 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:12.560026 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9976b86-f1a7-4ccd-8f51-12c543e04801 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:12.560512 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9976b86-f1a7-4ccd-8f51-12c543e04801 None admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:12.561483 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9976b86-f1a7-4ccd-8f51-12c543e04801 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:12.561988 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9976b86-f1a7-4ccd-8f51-12c543e04801 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:12.563577 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9976b86-f1a7-4ccd-8f51-12c543e04801 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:12.585127 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 279/549] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:04:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:04:12.594471 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9976b86-f1a7-4ccd-8f51-12c543e04801 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:12.672482 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321568b9-4ad4-4112-a08f-f12b2021ed56 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:12.740776 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78934275-56a1-4945-b114-61a1522ef62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:12.741600 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78934275-56a1-4945-b114-61a1522ef62c None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:12.741875 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78934275-56a1-4945-b114-61a1522ef62c None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:12.742145 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78934275-56a1-4945-b114-61a1522ef62c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:12.756571 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78934275-56a1-4945-b114-61a1522ef62c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:04:12.765611 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-78934275-56a1-4945-b114-61a1522ef62c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 18:04:12.765611 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:12.765611 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:12.765611 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:12.765611 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:12.765611 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:12.765611 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:12.765611 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:12.765611 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:12.765611 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:12.765611 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:12.765611 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:12.765611 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:04:12.765611 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:04:12.765611 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:04:12.765611 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:04:12.766498 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:04:12.766498 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:04:12.766498 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:04:12.766498 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:04:12.766498 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:12.766498 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:12.766498 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:12.766498 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:12.766498 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:12.766498 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:12.766498 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:12.766498 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:12.766498 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:12.766498 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:12.766498 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:12.766498 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:12.767297 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:12.767297 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:12.767297 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:12.767297 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:12.767297 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:04:12.767297 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:04:12.767297 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:04:12.767297 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:04:12.767297 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:04:12.767297 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:04:12.767297 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 18:04:12.767297 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:12.771688 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 271/550] 10.222.0.65 () {56 vars in 1102 bytes} [Tue May 17 18:04:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:04:12.772905 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78934275-56a1-4945-b114-61a1522ef62c None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:12.791568 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9976b86-f1a7-4ccd-8f51-12c543e04801 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:12.860424 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c12107-6eba-4f91-a2b6-4d39839a8d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:12.861229 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c12107-6eba-4f91-a2b6-4d39839a8d8b None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:12.861531 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c12107-6eba-4f91-a2b6-4d39839a8d8b None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:12.861810 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c12107-6eba-4f91-a2b6-4d39839a8d8b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:12.876285 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c12107-6eba-4f91-a2b6-4d39839a8d8b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:12.877773 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c12107-6eba-4f91-a2b6-4d39839a8d8b None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:12.894163 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-e0c12107-6eba-4f91-a2b6-4d39839a8d8b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 17 18:04:12.894163 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:12.894163 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:12.894163 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:12.894163 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:12.894163 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:12.894163 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:12.894163 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:12.894163 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:12.894163 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:12.894163 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:12.894163 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:12.894163 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 18:04:12.894163 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 18:04:12.894163 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 18:04:12.894163 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 18:04:12.895061 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:12.895061 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:12.895061 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 18:04:12.895061 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:04:12.895061 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 18:04:12.895061 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:04:12.895061 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:12.895061 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:12.895061 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:12.895061 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:12.895061 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:12.895061 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:12.895061 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:12.895061 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:12.895061 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:12.895061 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:12.895061 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:12.895061 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:12.895956 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:12.895956 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:12.895956 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 18:04:12.895956 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 18:04:12.895956 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 18:04:12.895956 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 18:04:12.895956 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 18:04:12.895956 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 18:04:12.895956 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 17 18:04:12.895956 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:12.895956 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 280/551] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 17 18:04:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:12.901593 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c12107-6eba-4f91-a2b6-4d39839a8d8b None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:12.924006 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78934275-56a1-4945-b114-61a1522ef62c None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:12.986726 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185476b4-cab5-4fbe-a9d9-b1d3da6a235f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:12.987406 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185476b4-cab5-4fbe-a9d9-b1d3da6a235f None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:12.987684 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185476b4-cab5-4fbe-a9d9-b1d3da6a235f None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:12.987960 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185476b4-cab5-4fbe-a9d9-b1d3da6a235f None admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:12.988710 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185476b4-cab5-4fbe-a9d9-b1d3da6a235f None admin] RBAC: Adding query filter params (name=service) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:12.989018 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185476b4-cab5-4fbe-a9d9-b1d3da6a235f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:12.990427 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185476b4-cab5-4fbe-a9d9-b1d3da6a235f None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:13.006900 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 272/552] 10.222.0.65 () {56 vars in 1103 bytes} [Tue May 17 18:04:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:13.012622 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185476b4-cab5-4fbe-a9d9-b1d3da6a235f None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:13.089911 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c12107-6eba-4f91-a2b6-4d39839a8d8b None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:13.142320 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb192d11-fa07-4aa7-87dd-f201a6dfe3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:13.143014 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb192d11-fa07-4aa7-87dd-f201a6dfe3fb None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:13.143290 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb192d11-fa07-4aa7-87dd-f201a6dfe3fb None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:13.143563 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb192d11-fa07-4aa7-87dd-f201a6dfe3fb None admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:13.144429 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb192d11-fa07-4aa7-87dd-f201a6dfe3fb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:13.144738 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb192d11-fa07-4aa7-87dd-f201a6dfe3fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:13.146269 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb192d11-fa07-4aa7-87dd-f201a6dfe3fb None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:13.183845 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185476b4-cab5-4fbe-a9d9-b1d3da6a235f None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:13.185135 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 281/553] 10.222.0.65 () {56 vars in 1135 bytes} [Tue May 17 18:04:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:13.194822 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb192d11-fa07-4aa7-87dd-f201a6dfe3fb None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:13.227452 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e70dff-cc16-475a-b4f6-d8c4b508c01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:13.228251 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e70dff-cc16-475a-b4f6-d8c4b508c01a None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:13.228527 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e70dff-cc16-475a-b4f6-d8c4b508c01a None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:13.228797 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e70dff-cc16-475a-b4f6-d8c4b508c01a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:13.246692 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e70dff-cc16-475a-b4f6-d8c4b508c01a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:13.248172 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e70dff-cc16-475a-b4f6-d8c4b508c01a None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:13.285484 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-10e70dff-cc16-475a-b4f6-d8c4b508c01a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:13.285484 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:13.285484 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:13.285484 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:13.285484 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:13.285484 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:13.285484 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:13.285484 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:13.285484 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:13.285484 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:13.285484 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:13.285484 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:13.285484 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:04:13.285484 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:04:13.285484 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:04:13.286387 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:04:13.286387 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:13.286387 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:13.286387 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:13.286387 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:13.286387 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:13.286387 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:13.286387 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:13.286387 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:13.286387 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:13.286387 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:13.286387 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:13.286387 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:13.286387 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:13.286387 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:13.286387 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:13.286387 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:13.287244 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:04:13.287244 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:04:13.287244 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:13.287244 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:13.287244 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 273/554] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:04:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:13.298800 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e70dff-cc16-475a-b4f6-d8c4b508c01a None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:13.338619 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb192d11-fa07-4aa7-87dd-f201a6dfe3fb None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:13.375055 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679d27f2-68dd-4a6f-8b23-eaee14bbc4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:13.375711 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d27f2-68dd-4a6f-8b23-eaee14bbc4a7 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:13.375992 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d27f2-68dd-4a6f-8b23-eaee14bbc4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:13.376266 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d27f2-68dd-4a6f-8b23-eaee14bbc4a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:13.461787 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679d27f2-68dd-4a6f-8b23-eaee14bbc4a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:13.463684 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679d27f2-68dd-4a6f-8b23-eaee14bbc4a7 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:13.468046 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e70dff-cc16-475a-b4f6-d8c4b508c01a None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:13.503967 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db51a2a1-86be-4655-aff2-5e2d74380ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:13.505405 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51a2a1-86be-4655-aff2-5e2d74380ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:13.505918 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51a2a1-86be-4655-aff2-5e2d74380ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:13.506412 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51a2a1-86be-4655-aff2-5e2d74380ce4 None admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:13.507396 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db51a2a1-86be-4655-aff2-5e2d74380ce4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:13.507927 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db51a2a1-86be-4655-aff2-5e2d74380ce4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:13.509564 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db51a2a1-86be-4655-aff2-5e2d74380ce4 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:13.522324 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 274/555] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:04:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:13.523899 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc04e36-e247-44b2-92d5-e6dd3a03ac2a None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:13.524385 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc04e36-e247-44b2-92d5-e6dd3a03ac2a None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:13.524882 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc04e36-e247-44b2-92d5-e6dd3a03ac2a None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:13.530754 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 275/556] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:04:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:04:13.532270 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897885d-1445-4fd5-86fa-7b8ed9279342 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:13.532755 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897885d-1445-4fd5-86fa-7b8ed9279342 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:13.533248 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897885d-1445-4fd5-86fa-7b8ed9279342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:13.551063 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-c897885d-1445-4fd5-86fa-7b8ed9279342 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:13.552576 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-c897885d-1445-4fd5-86fa-7b8ed9279342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:13.583960 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 282/557] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 17 18:04:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 17 18:04:13.584825 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679d27f2-68dd-4a6f-8b23-eaee14bbc4a7 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:13.644472 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 276/558] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:04:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:04:13.656418 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c897885d-1445-4fd5-86fa-7b8ed9279342 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:13.778792 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679d27f2-68dd-4a6f-8b23-eaee14bbc4a7 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:13.812867 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9228af12-c057-4e67-b2b7-b2cb2ae54b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:13.813677 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228af12-c057-4e67-b2b7-b2cb2ae54b33 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:13.813966 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228af12-c057-4e67-b2b7-b2cb2ae54b33 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:13.814231 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228af12-c057-4e67-b2b7-b2cb2ae54b33 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:13.821900 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9228af12-c057-4e67-b2b7-b2cb2ae54b33 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:13.823340 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9228af12-c057-4e67-b2b7-b2cb2ae54b33 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:13.848401 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c897885d-1445-4fd5-86fa-7b8ed9279342 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:13.849618 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-9228af12-c057-4e67-b2b7-b2cb2ae54b33 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 17 18:04:13.849618 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:13.849618 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:13.849618 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:13.849618 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:13.849618 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:13.849618 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:13.849618 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:13.849618 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:13.849618 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:13.849618 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:13.849618 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:13.849618 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 18:04:13.849618 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 18:04:13.849618 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 18:04:13.849618 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 18:04:13.850768 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:13.850768 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:13.850768 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 18:04:13.850768 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:04:13.850768 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 18:04:13.850768 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:04:13.850768 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:13.850768 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:13.850768 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:13.850768 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:13.850768 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:13.850768 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:13.850768 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:13.850768 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:13.850768 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:13.850768 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:13.850768 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:13.850768 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:13.851879 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:13.851879 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:13.851879 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 18:04:13.851879 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 18:04:13.851879 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 18:04:13.851879 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 18:04:13.851879 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 18:04:13.851879 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 18:04:13.851879 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 17 18:04:13.851879 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:13.853851 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 283/559] 10.222.0.65 () {56 vars in 1093 bytes} [Tue May 17 18:04:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:13.854844 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9228af12-c057-4e67-b2b7-b2cb2ae54b33 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:13.891432 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2efd900-b220-4a6f-bc82-caee278210c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:13.892241 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2efd900-b220-4a6f-bc82-caee278210c9 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:13.892519 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2efd900-b220-4a6f-bc82-caee278210c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:13.892794 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2efd900-b220-4a6f-bc82-caee278210c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:13.903515 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2efd900-b220-4a6f-bc82-caee278210c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:13.905126 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2efd900-b220-4a6f-bc82-caee278210c9 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:13.924707 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-b2efd900-b220-4a6f-bc82-caee278210c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:13.924707 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:13.924707 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:13.924707 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:13.924707 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:13.924707 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:13.924707 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:13.924707 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:13.924707 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:13.924707 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:13.924707 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:13.924707 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:13.924707 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:04:13.924707 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:04:13.924707 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:04:13.925617 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:04:13.925617 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:13.925617 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:13.925617 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:13.925617 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:13.925617 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:13.925617 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:13.925617 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:13.925617 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:13.925617 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:13.925617 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:13.925617 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:13.925617 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:13.925617 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:13.925617 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:13.925617 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:13.925617 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:13.926462 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:04:13.926462 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:04:13.926462 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:13.926462 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:13.926462 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 277/560] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:04:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:13.927731 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c80263f-94cb-4c34-93b1-eee5a2f64a5b None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:13.927731 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c80263f-94cb-4c34-93b1-eee5a2f64a5b None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:13.927731 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c80263f-94cb-4c34-93b1-eee5a2f64a5b None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:13.933858 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 278/561] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:04:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:04:13.933858 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c80263f-94cb-4c34-93b1-eee5a2f64a5b None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:13.965397 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9228af12-c057-4e67-b2b7-b2cb2ae54b33 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:13.998809 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4f4b5b-00f6-4629-80c4-886222a94025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:13.999612 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f4b5b-00f6-4629-80c4-886222a94025 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:13.999886 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f4b5b-00f6-4629-80c4-886222a94025 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:14.000161 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f4b5b-00f6-4629-80c4-886222a94025 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:14.011314 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4f4b5b-00f6-4629-80c4-886222a94025 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:04:14.019445 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-7d4f4b5b-00f6-4629-80c4-886222a94025 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 18:04:14.019445 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:14.019445 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:14.019445 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:14.019445 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:14.019445 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:14.019445 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:14.019445 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:14.019445 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:14.019445 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:14.019445 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:14.019445 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:14.019445 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:04:14.019445 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:04:14.019445 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:04:14.019445 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:04:14.020429 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:04:14.020429 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:04:14.020429 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:04:14.020429 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:04:14.020429 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:14.020429 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:14.020429 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:14.020429 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:14.020429 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:14.020429 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:14.020429 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:14.020429 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:14.020429 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:14.020429 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:14.020429 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:14.020429 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:14.022491 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:14.022491 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:14.022491 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:14.022491 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:14.022491 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:04:14.022491 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:04:14.022491 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:04:14.022491 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:04:14.022491 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:04:14.022491 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:04:14.022491 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 18:04:14.022491 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:14.022491 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 284/562] 10.222.0.65 () {56 vars in 1102 bytes} [Tue May 17 18:04:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:14.022491 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4f4b5b-00f6-4629-80c4-886222a94025 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:14.037869 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c80263f-94cb-4c34-93b1-eee5a2f64a5b None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:14.072742 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc97ea2-26c1-4abc-b670-adfd315c38a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:14.073581 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc97ea2-26c1-4abc-b670-adfd315c38a2 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:14.073870 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc97ea2-26c1-4abc-b670-adfd315c38a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:14.074438 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc97ea2-26c1-4abc-b670-adfd315c38a2 None admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:14.074978 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc97ea2-26c1-4abc-b670-adfd315c38a2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:14.075285 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc97ea2-26c1-4abc-b670-adfd315c38a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:14.076706 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc97ea2-26c1-4abc-b670-adfd315c38a2 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:14.098112 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 279/563] 10.222.0.65 () {56 vars in 1133 bytes} [Tue May 17 18:04:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:14.098112 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff43e5-da9f-4e02-9041-5f3f17d8f6ab None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:14.098112 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff43e5-da9f-4e02-9041-5f3f17d8f6ab None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:14.098112 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff43e5-da9f-4e02-9041-5f3f17d8f6ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:14.111783 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-ceff43e5-da9f-4e02-9041-5f3f17d8f6ab None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:14.112969 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-ceff43e5-da9f-4e02-9041-5f3f17d8f6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:14.135218 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4f4b5b-00f6-4629-80c4-886222a94025 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:14.168491 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ba7de-3a7e-446e-8d04-04d7d68a68b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:14.169153 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ba7de-3a7e-446e-8d04-04d7d68a68b8 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:14.169439 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ba7de-3a7e-446e-8d04-04d7d68a68b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:14.169744 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54ba7de-3a7e-446e-8d04-04d7d68a68b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:14.171684 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54ba7de-3a7e-446e-8d04-04d7d68a68b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:14.171684 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54ba7de-3a7e-446e-8d04-04d7d68a68b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:14.172546 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54ba7de-3a7e-446e-8d04-04d7d68a68b8 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:14.184863 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 285/564] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:04:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:14.186240 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ba7de-3a7e-446e-8d04-04d7d68a68b8 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:14.188587 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 280/565] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:04:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:04:14.189597 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff43e5-da9f-4e02-9041-5f3f17d8f6ab None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:14.285258 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54ba7de-3a7e-446e-8d04-04d7d68a68b8 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:14.290423 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff43e5-da9f-4e02-9041-5f3f17d8f6ab None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:14.316837 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a307247a-7a64-4fdf-8b0c-1ea954febb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:14.317781 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307247a-7a64-4fdf-8b0c-1ea954febb12 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:14.318061 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307247a-7a64-4fdf-8b0c-1ea954febb12 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:14.318335 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307247a-7a64-4fdf-8b0c-1ea954febb12 None admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:14.319067 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a307247a-7a64-4fdf-8b0c-1ea954febb12 None admin] RBAC: Adding query filter params (name=service) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:14.319375 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a307247a-7a64-4fdf-8b0c-1ea954febb12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:14.320752 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a307247a-7a64-4fdf-8b0c-1ea954febb12 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:14.322529 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c70cb-0fbf-451f-aa9b-c40561cf5518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:14.323294 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c70cb-0fbf-451f-aa9b-c40561cf5518 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:14.323572 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c70cb-0fbf-451f-aa9b-c40561cf5518 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:14.323844 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c70cb-0fbf-451f-aa9b-c40561cf5518 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:14.328572 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 286/566] 10.222.0.65 () {56 vars in 1103 bytes} [Tue May 17 18:04:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:14.329361 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a307247a-7a64-4fdf-8b0c-1ea954febb12 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:14.333819 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997c70cb-0fbf-451f-aa9b-c40561cf5518 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:14.335267 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997c70cb-0fbf-451f-aa9b-c40561cf5518 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:14.353537 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-997c70cb-0fbf-451f-aa9b-c40561cf5518 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:14.353537 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:14.353537 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:14.353537 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:14.353537 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:14.353537 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:14.353537 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:14.353537 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:14.353537 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:14.353537 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:14.353537 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:14.353537 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:14.353537 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:04:14.353537 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:04:14.353537 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:04:14.354615 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:04:14.354615 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:14.354615 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:14.354615 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:14.354615 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:14.354615 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:14.354615 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:14.354615 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:14.354615 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:14.354615 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:14.354615 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:14.354615 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:14.354615 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:14.354615 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:14.354615 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:14.354615 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:14.354615 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:14.355469 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:04:14.355469 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:04:14.355469 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:14.355469 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:14.355469 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 281/567] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:04:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:14.355955 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41dff1-3d39-4a2f-b86b-3d3fe22372cf None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:14.356167 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41dff1-3d39-4a2f-b86b-3d3fe22372cf None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:14.356513 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41dff1-3d39-4a2f-b86b-3d3fe22372cf None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:14.362141 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 282/568] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:04:14.362141 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee41dff1-3d39-4a2f-b86b-3d3fe22372cf None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:14.424044 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a307247a-7a64-4fdf-8b0c-1ea954febb12 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:14.455099 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee41dff1-3d39-4a2f-b86b-3d3fe22372cf None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:14.456623 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e006ce-527e-49c6-9ef3-d98f3b4ad710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:14.457409 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e006ce-527e-49c6-9ef3-d98f3b4ad710 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:14.457722 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e006ce-527e-49c6-9ef3-d98f3b4ad710 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:14.457995 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e006ce-527e-49c6-9ef3-d98f3b4ad710 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:14.464366 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e006ce-527e-49c6-9ef3-d98f3b4ad710 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:14.465821 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e006ce-527e-49c6-9ef3-d98f3b4ad710 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:14.480097 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-a1e006ce-527e-49c6-9ef3-d98f3b4ad710 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:04:14.480097 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:14.480097 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:14.480097 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:14.480097 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:14.480097 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:14.480097 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:14.480097 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:14.480097 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:14.480097 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:14.480097 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:14.480097 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:14.480097 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 18:04:14.480097 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 18:04:14.480097 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 18:04:14.480978 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 18:04:14.480978 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:14.480978 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:14.480978 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:14.480978 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:14.480978 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:14.480978 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:14.480978 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:14.480978 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:14.480978 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:14.480978 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:14.480978 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:14.480978 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:14.480978 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:14.480978 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:14.480978 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:14.480978 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:14.481977 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 18:04:14.481977 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 18:04:14.481977 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 18:04:14.481977 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 18:04:14.481977 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 18:04:14.481977 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 18:04:14.481977 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:04:14.481977 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:14.485721 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 287/569] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 17 18:04:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:14.486430 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e006ce-527e-49c6-9ef3-d98f3b4ad710 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:14.487022 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86666ad9-7072-466a-bccf-268d2fa9be5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:14.487794 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86666ad9-7072-466a-bccf-268d2fa9be5a None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:14.488074 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86666ad9-7072-466a-bccf-268d2fa9be5a None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:14.488345 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86666ad9-7072-466a-bccf-268d2fa9be5a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:14.498176 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86666ad9-7072-466a-bccf-268d2fa9be5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:04:14.505776 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-86666ad9-7072-466a-bccf-268d2fa9be5a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 18:04:14.505776 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:14.505776 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:14.505776 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:14.505776 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:14.505776 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:14.505776 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:14.505776 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:14.505776 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:14.505776 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:14.505776 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:14.505776 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:14.505776 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:04:14.505776 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:04:14.505776 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:04:14.505776 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:04:14.507143 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:04:14.507143 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:04:14.507143 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:04:14.507143 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:04:14.507143 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:14.507143 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:14.507143 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:14.507143 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:14.507143 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:14.507143 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:14.507143 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:14.507143 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:14.507143 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:14.507143 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:14.507143 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:14.507143 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:14.508276 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:14.508276 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:14.508276 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:14.508276 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:14.508276 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:04:14.508276 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:04:14.508276 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:04:14.508276 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:04:14.508276 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:04:14.508276 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:04:14.508276 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 18:04:14.508276 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:14.508276 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 283/570] 10.222.0.65 () {56 vars in 1102 bytes} [Tue May 17 18:04:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:14.508276 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86666ad9-7072-466a-bccf-268d2fa9be5a None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:14.578797 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e006ce-527e-49c6-9ef3-d98f3b4ad710 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:14.600931 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86666ad9-7072-466a-bccf-268d2fa9be5a None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:14.610986 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b977a34-173e-4e74-b591-a6ea29348870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:14.611773 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b977a34-173e-4e74-b591-a6ea29348870 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:14.612047 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b977a34-173e-4e74-b591-a6ea29348870 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:14.612318 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b977a34-173e-4e74-b591-a6ea29348870 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:14.621994 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b977a34-173e-4e74-b591-a6ea29348870 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:14.623473 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b977a34-173e-4e74-b591-a6ea29348870 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:14.633084 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5aab58-02e7-4c29-aa5c-f1db846d195f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:14.633769 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5aab58-02e7-4c29-aa5c-f1db846d195f None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:14.634051 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5aab58-02e7-4c29-aa5c-f1db846d195f None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:14.634323 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5aab58-02e7-4c29-aa5c-f1db846d195f None admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:14.635033 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5aab58-02e7-4c29-aa5c-f1db846d195f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:14.635335 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5aab58-02e7-4c29-aa5c-f1db846d195f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:14.636677 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5aab58-02e7-4c29-aa5c-f1db846d195f None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:14.640449 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-7b977a34-173e-4e74-b591-a6ea29348870 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:14.640449 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:14.640449 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:14.640449 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:14.640449 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:14.640449 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:14.640449 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:14.640449 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:14.640449 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:14.640449 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:14.640449 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:14.640449 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:14.640449 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:04:14.640449 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:04:14.640449 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:04:14.641330 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:04:14.641330 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:14.641330 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:14.641330 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:14.641330 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:14.641330 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:14.641330 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:14.641330 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:14.641330 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:14.641330 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:14.641330 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:14.641330 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:14.641330 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:14.641330 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:14.641330 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:14.641330 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:14.641330 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:14.642272 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:04:14.642272 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:04:14.642272 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:14.642272 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:14.642272 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 288/571] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:04:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:14.643046 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34f561-ae72-499a-a67c-24ff4cc58b8e None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:14.643046 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34f561-ae72-499a-a67c-24ff4cc58b8e None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:14.643304 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34f561-ae72-499a-a67c-24ff4cc58b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:14.648662 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 284/572] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:04:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:14.649474 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5aab58-02e7-4c29-aa5c-f1db846d195f None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:14.658969 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-9b34f561-ae72-499a-a67c-24ff4cc58b8e None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:14.660165 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-9b34f561-ae72-499a-a67c-24ff4cc58b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:14.722035 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 289/573] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:04:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:04:14.722920 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b34f561-ae72-499a-a67c-24ff4cc58b8e None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:14.745347 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5aab58-02e7-4c29-aa5c-f1db846d195f None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:14.777787 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d9a6e2-eacc-4e9b-9547-d2b6222f85c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:14.778439 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9a6e2-eacc-4e9b-9547-d2b6222f85c9 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:14.778717 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9a6e2-eacc-4e9b-9547-d2b6222f85c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:14.778990 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9a6e2-eacc-4e9b-9547-d2b6222f85c9 None admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:14.779797 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d9a6e2-eacc-4e9b-9547-d2b6222f85c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:14.780098 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d9a6e2-eacc-4e9b-9547-d2b6222f85c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:14.781538 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d9a6e2-eacc-4e9b-9547-d2b6222f85c9 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:14.801084 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 285/574] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 17 18:04:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:14.801916 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d9a6e2-eacc-4e9b-9547-d2b6222f85c9 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:14.815854 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b34f561-ae72-499a-a67c-24ff4cc58b8e None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:14.848270 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0b0671-28f1-4bf1-8e9a-41151b28fc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:14.848936 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b0671-28f1-4bf1-8e9a-41151b28fc04 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:14.849215 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b0671-28f1-4bf1-8e9a-41151b28fc04 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:14.849510 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b0671-28f1-4bf1-8e9a-41151b28fc04 None admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:14.850246 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0b0671-28f1-4bf1-8e9a-41151b28fc04 None admin] RBAC: Adding query filter params (name=service) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:14.850547 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0b0671-28f1-4bf1-8e9a-41151b28fc04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:14.851932 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0b0671-28f1-4bf1-8e9a-41151b28fc04 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:14.860152 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 290/575] 10.222.0.65 () {56 vars in 1103 bytes} [Tue May 17 18:04:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:14.860927 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0b0671-28f1-4bf1-8e9a-41151b28fc04 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:14.911170 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d9a6e2-eacc-4e9b-9547-d2b6222f85c9 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:14.943203 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dec9e8-53da-44cf-9b25-9926d5f1f796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:14.943877 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dec9e8-53da-44cf-9b25-9926d5f1f796 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:14.944152 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dec9e8-53da-44cf-9b25-9926d5f1f796 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:14.944423 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dec9e8-53da-44cf-9b25-9926d5f1f796 None admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:14.945128 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dec9e8-53da-44cf-9b25-9926d5f1f796 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:14.945425 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dec9e8-53da-44cf-9b25-9926d5f1f796 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:14.946802 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dec9e8-53da-44cf-9b25-9926d5f1f796 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:14.954351 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0b0671-28f1-4bf1-8e9a-41151b28fc04 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:14.958092 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 286/576] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:04:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:14.958921 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dec9e8-53da-44cf-9b25-9926d5f1f796 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:14.986312 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e2a0e-e0ce-49af-9e2b-7639dc551a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:14.987089 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e2a0e-e0ce-49af-9e2b-7639dc551a41 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:14.987367 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e2a0e-e0ce-49af-9e2b-7639dc551a41 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:14.987637 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e2a0e-e0ce-49af-9e2b-7639dc551a41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:14.993926 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1e2a0e-e0ce-49af-9e2b-7639dc551a41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:14.995351 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1e2a0e-e0ce-49af-9e2b-7639dc551a41 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:15.009609 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-1d1e2a0e-e0ce-49af-9e2b-7639dc551a41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:04:15.009609 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:15.009609 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:15.009609 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:15.009609 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:15.009609 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:15.009609 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:15.009609 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:15.009609 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:15.009609 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:15.009609 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:15.009609 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:15.009609 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 18:04:15.009609 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 18:04:15.009609 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 18:04:15.010789 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 18:04:15.010789 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:15.010789 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:15.010789 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:15.010789 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:15.010789 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:15.010789 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:15.010789 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:15.010789 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:15.010789 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:15.010789 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:15.010789 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:15.010789 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:15.010789 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:15.010789 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:15.010789 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:15.010789 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:15.012038 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 18:04:15.012038 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 18:04:15.012038 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 18:04:15.012038 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 18:04:15.012038 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 18:04:15.012038 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 18:04:15.012038 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:04:15.012038 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:15.012038 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 291/577] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 17 18:04:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:15.012038 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e2a0e-e0ce-49af-9e2b-7639dc551a41 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:15.053756 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dec9e8-53da-44cf-9b25-9926d5f1f796 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:15.085847 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff910445-27a5-4f38-8d8f-071c255d964c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:15.086558 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff910445-27a5-4f38-8d8f-071c255d964c None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:15.086838 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff910445-27a5-4f38-8d8f-071c255d964c None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:15.087106 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff910445-27a5-4f38-8d8f-071c255d964c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:15.097152 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff910445-27a5-4f38-8d8f-071c255d964c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:04:15.102528 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e2a0e-e0ce-49af-9e2b-7639dc551a41 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:15.104906 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-ff910445-27a5-4f38-8d8f-071c255d964c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 18:04:15.104906 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:15.104906 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:15.104906 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:15.104906 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:15.104906 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:15.104906 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:15.104906 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:15.104906 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:15.104906 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:15.104906 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:15.104906 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:15.104906 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:04:15.104906 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:04:15.104906 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:04:15.104906 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:04:15.105843 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:04:15.105843 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:04:15.105843 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:04:15.105843 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:04:15.105843 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:15.105843 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:15.105843 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:15.105843 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:15.105843 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:15.105843 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:15.105843 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:15.105843 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:15.105843 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:15.105843 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:15.105843 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:15.105843 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:15.106680 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:15.106680 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:15.106680 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:15.106680 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:15.106680 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:04:15.106680 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:04:15.106680 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:04:15.106680 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:04:15.106680 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:04:15.106680 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:04:15.106680 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 18:04:15.106680 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:15.106680 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 287/578] 10.222.0.65 () {56 vars in 1102 bytes} [Tue May 17 18:04:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:15.108018 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff910445-27a5-4f38-8d8f-071c255d964c None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:15.136582 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac2f04-e8cf-4b93-a459-db5e5ca70122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:15.137224 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac2f04-e8cf-4b93-a459-db5e5ca70122 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:15.137523 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac2f04-e8cf-4b93-a459-db5e5ca70122 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:15.137798 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac2f04-e8cf-4b93-a459-db5e5ca70122 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:15.138624 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac2f04-e8cf-4b93-a459-db5e5ca70122 None admin] RBAC: Adding query filter params (role.id=60e39e2185d346a192b8698767df6018, scope.project.id=0cf165918c1f46cb96d4b54409862659, user.id=1464e84a3a2d4321a98b98d398bc7be3) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:15.138980 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac2f04-e8cf-4b93-a459-db5e5ca70122 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:15.140406 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac2f04-e8cf-4b93-a459-db5e5ca70122 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:15.145903 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 292/579] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 17 18:04:15 2022] GET /identity/v3/role_assignments?user.id=1464e84a3a2d4321a98b98d398bc7be3&scope.project.id=0cf165918c1f46cb96d4b54409862659&role.id=60e39e2185d346a192b8698767df6018 => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:15.146612 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac2f04-e8cf-4b93-a459-db5e5ca70122 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:15.210303 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff910445-27a5-4f38-8d8f-071c255d964c None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:15.246676 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d49b631-f258-4865-81e3-2a4969948cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:15.247485 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d49b631-f258-4865-81e3-2a4969948cfb None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:15.247761 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d49b631-f258-4865-81e3-2a4969948cfb None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:15.248037 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d49b631-f258-4865-81e3-2a4969948cfb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:15.254132 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac2f04-e8cf-4b93-a459-db5e5ca70122 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:15.259566 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d49b631-f258-4865-81e3-2a4969948cfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:15.261068 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d49b631-f258-4865-81e3-2a4969948cfb None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:15.280153 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-0d49b631-f258-4865-81e3-2a4969948cfb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:15.280153 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:15.280153 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:15.280153 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:15.280153 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:15.280153 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:15.280153 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:15.280153 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:15.280153 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:15.280153 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:15.280153 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:15.280153 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:15.280153 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:04:15.280153 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:04:15.280153 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:04:15.281278 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:04:15.281278 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:15.281278 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:15.281278 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:15.281278 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:15.281278 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:15.281278 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:15.281278 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:15.281278 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:15.281278 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:15.281278 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:15.281278 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:15.281278 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:15.281278 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:15.281278 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:15.281278 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:15.281278 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:15.282533 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:04:15.282533 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:04:15.282533 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:15.282533 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:15.282533 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 288/580] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:04:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:15.282815 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d49b631-f258-4865-81e3-2a4969948cfb None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:15.292197 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0355a111-4292-4907-8734-a89d6fd6bf97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:15.293006 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0355a111-4292-4907-8734-a89d6fd6bf97 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:15.293284 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0355a111-4292-4907-8734-a89d6fd6bf97 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:15.293588 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0355a111-4292-4907-8734-a89d6fd6bf97 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:15.301774 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0355a111-4292-4907-8734-a89d6fd6bf97 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:15.303270 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0355a111-4292-4907-8734-a89d6fd6bf97 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:15.319955 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-0355a111-4292-4907-8734-a89d6fd6bf97 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 17 18:04:15.319955 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:15.319955 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:15.319955 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:15.319955 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:15.319955 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:15.319955 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:15.319955 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:15.319955 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:15.319955 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:15.319955 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:15.319955 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:15.319955 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 18:04:15.319955 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 18:04:15.319955 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 18:04:15.319955 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 18:04:15.320960 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:15.320960 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:15.320960 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 18:04:15.320960 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:04:15.320960 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 18:04:15.320960 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:04:15.320960 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:15.320960 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:15.320960 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:15.320960 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:15.320960 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:15.320960 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:15.320960 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:15.320960 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:15.320960 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:15.320960 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:15.320960 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:15.320960 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:15.327854 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:15.327854 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:15.327854 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 18:04:15.327854 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 18:04:15.327854 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 18:04:15.327854 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 18:04:15.327854 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 18:04:15.327854 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 18:04:15.327854 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 17 18:04:15.327854 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:15.327854 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 293/581] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 17 18:04:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:15.327854 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0355a111-4292-4907-8734-a89d6fd6bf97 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:15.385403 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d49b631-f258-4865-81e3-2a4969948cfb None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:15.418538 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6397550-11db-486b-b641-8505d40f1b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:15.419116 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6397550-11db-486b-b641-8505d40f1b08 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:15.419452 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6397550-11db-486b-b641-8505d40f1b08 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:15.419657 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6397550-11db-486b-b641-8505d40f1b08 None admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:15.420680 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6397550-11db-486b-b641-8505d40f1b08 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:15.420786 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6397550-11db-486b-b641-8505d40f1b08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:15.422205 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6397550-11db-486b-b641-8505d40f1b08 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:15.423214 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0355a111-4292-4907-8734-a89d6fd6bf97 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:15.438835 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 289/582] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 17 18:04:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:15.438835 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6397550-11db-486b-b641-8505d40f1b08 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:15.456606 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d776a3e-b4e7-44cf-a8d4-46ef765db834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:15.457270 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d776a3e-b4e7-44cf-a8d4-46ef765db834 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:15.457576 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d776a3e-b4e7-44cf-a8d4-46ef765db834 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:15.457851 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d776a3e-b4e7-44cf-a8d4-46ef765db834 None admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:15.458591 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d776a3e-b4e7-44cf-a8d4-46ef765db834 None admin] RBAC: Adding query filter params (name=service) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:15.458890 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d776a3e-b4e7-44cf-a8d4-46ef765db834 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:15.460262 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d776a3e-b4e7-44cf-a8d4-46ef765db834 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:15.468209 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 294/583] 10.222.0.65 () {56 vars in 1103 bytes} [Tue May 17 18:04:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:15.469251 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d776a3e-b4e7-44cf-a8d4-46ef765db834 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:15.536937 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6397550-11db-486b-b641-8505d40f1b08 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:15.566178 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d776a3e-b4e7-44cf-a8d4-46ef765db834 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:15.569555 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0215f234-0437-4193-86e9-9ca7fa6ba45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:15.570212 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215f234-0437-4193-86e9-9ca7fa6ba45d None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:15.570485 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215f234-0437-4193-86e9-9ca7fa6ba45d None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:15.570754 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215f234-0437-4193-86e9-9ca7fa6ba45d None admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:15.571463 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0215f234-0437-4193-86e9-9ca7fa6ba45d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:15.571762 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0215f234-0437-4193-86e9-9ca7fa6ba45d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:15.573111 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0215f234-0437-4193-86e9-9ca7fa6ba45d None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:15.588319 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 290/584] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:04:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:15.588319 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0215f234-0437-4193-86e9-9ca7fa6ba45d None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:15.599573 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7784d7b-190d-44a3-b0c2-062856a51bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:15.600468 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7784d7b-190d-44a3-b0c2-062856a51bcf None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:15.600750 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7784d7b-190d-44a3-b0c2-062856a51bcf None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:15.601011 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7784d7b-190d-44a3-b0c2-062856a51bcf None admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:15.601873 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7784d7b-190d-44a3-b0c2-062856a51bcf None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:15.602176 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7784d7b-190d-44a3-b0c2-062856a51bcf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:15.603676 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7784d7b-190d-44a3-b0c2-062856a51bcf None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:15.621430 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 295/585] 10.222.0.65 () {56 vars in 1137 bytes} [Tue May 17 18:04:15 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:15.622245 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7784d7b-190d-44a3-b0c2-062856a51bcf None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:15.684873 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0215f234-0437-4193-86e9-9ca7fa6ba45d None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:15.718524 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb4c36d-b6d9-40d5-9d5a-70f3de5f70b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:15.719689 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4c36d-b6d9-40d5-9d5a-70f3de5f70b5 None admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:15.719874 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7784d7b-190d-44a3-b0c2-062856a51bcf None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:15.720325 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4c36d-b6d9-40d5-9d5a-70f3de5f70b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:15.720771 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb4c36d-b6d9-40d5-9d5a-70f3de5f70b5 None admin] PATH_INFO: `/v3/projects/0cf165918c1f46cb96d4b54409862659/users/5b430b739cb54fc7911bc89f8ea2df72/roles/60e39e2185d346a192b8698767df6018` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:15.736467 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb4c36d-b6d9-40d5-9d5a-70f3de5f70b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=0cf165918c1f46cb96d4b54409862659, user_id=5b430b739cb54fc7911bc89f8ea2df72, role_id=60e39e2185d346a192b8698767df6018)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:15.738187 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb4c36d-b6d9-40d5-9d5a-70f3de5f70b5 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:15.750879 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 291/586] 10.222.0.65 () {58 vars in 1439 bytes} [Tue May 17 18:04:15 2022] PUT /identity/v3/projects/0cf165918c1f46cb96d4b54409862659/users/5b430b739cb54fc7911bc89f8ea2df72/roles/60e39e2185d346a192b8698767df6018 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:04:15.751884 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb4c36d-b6d9-40d5-9d5a-70f3de5f70b5 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:15.763956 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c5843-9f1e-4f99-b10b-43bc95a0d5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:15.765136 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c5843-9f1e-4f99-b10b-43bc95a0d5b0 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:15.765704 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c5843-9f1e-4f99-b10b-43bc95a0d5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:15.766253 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c5843-9f1e-4f99-b10b-43bc95a0d5b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:15.778276 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c5843-9f1e-4f99-b10b-43bc95a0d5b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:15.780706 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4c5843-9f1e-4f99-b10b-43bc95a0d5b0 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:15.800768 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-1c4c5843-9f1e-4f99-b10b-43bc95a0d5b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:15.800768 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:15.800768 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:15.800768 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:15.800768 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:15.800768 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:15.800768 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:15.800768 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:15.800768 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:15.800768 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:15.800768 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:15.800768 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:15.800768 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:04:15.800768 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:04:15.800768 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:04:15.801789 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:04:15.801789 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:15.801789 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:15.801789 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:15.801789 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:15.801789 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:15.801789 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:15.801789 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:15.801789 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:15.801789 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:15.801789 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:15.801789 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:15.801789 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:15.801789 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:15.801789 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:15.801789 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:15.801789 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:15.802661 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:04:15.802661 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:04:15.802661 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:15.802661 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:15.805067 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 296/587] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:04:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:15.806219 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c5843-9f1e-4f99-b10b-43bc95a0d5b0 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:15.861065 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb4c36d-b6d9-40d5-9d5a-70f3de5f70b5 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:15.896735 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f1487-51d7-4661-91cb-a1e49cb5186d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:15.897575 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f1487-51d7-4661-91cb-a1e49cb5186d None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:15.897853 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f1487-51d7-4661-91cb-a1e49cb5186d None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:15.898123 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f1487-51d7-4661-91cb-a1e49cb5186d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:15.906665 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677f1487-51d7-4661-91cb-a1e49cb5186d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:15.908150 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677f1487-51d7-4661-91cb-a1e49cb5186d None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:15.924096 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-677f1487-51d7-4661-91cb-a1e49cb5186d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 17 18:04:15.924096 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:15.924096 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:15.924096 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:15.924096 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:15.924096 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:15.924096 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:15.924096 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:15.924096 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:15.924096 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:15.924096 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:15.924096 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:15.924096 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 18:04:15.924096 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 18:04:15.924096 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 18:04:15.924096 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 18:04:15.925149 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:15.925149 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:15.925149 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 18:04:15.925149 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:04:15.925149 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 18:04:15.925149 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:04:15.925149 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:15.925149 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:15.925149 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:15.925149 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:15.925149 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:15.925149 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:15.925149 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:15.925149 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:15.925149 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:15.925149 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:15.925149 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:15.925149 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:15.926156 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:15.926156 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:15.926156 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 18:04:15.926156 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 18:04:15.926156 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 18:04:15.926156 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 18:04:15.926156 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 18:04:15.926156 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 18:04:15.926156 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 17 18:04:15.926156 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:15.926156 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 292/588] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 17 18:04:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:15.926761 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f1487-51d7-4661-91cb-a1e49cb5186d None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:15.941081 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4c5843-9f1e-4f99-b10b-43bc95a0d5b0 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:15.983517 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a3492-d7e8-4edc-8297-e0921d333898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:15.984312 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a3492-d7e8-4edc-8297-e0921d333898 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:15.984587 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a3492-d7e8-4edc-8297-e0921d333898 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:15.984856 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a3492-d7e8-4edc-8297-e0921d333898 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:15.995606 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8a3492-d7e8-4edc-8297-e0921d333898 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:15.997053 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8a3492-d7e8-4edc-8297-e0921d333898 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:16.020467 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-dc8a3492-d7e8-4edc-8297-e0921d333898 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:16.020467 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:16.020467 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:16.020467 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:16.020467 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:16.020467 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:16.020467 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:16.020467 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:16.020467 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:16.020467 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:16.020467 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:16.020467 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:16.020467 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:04:16.020467 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:04:16.020467 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:04:16.021432 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:04:16.021432 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:16.021432 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:16.021432 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:16.021432 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:16.021432 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:16.021432 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:16.021432 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:16.021432 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:16.021432 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:16.021432 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:16.021432 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:16.021432 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:16.021432 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:16.021432 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:16.021432 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:16.021432 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:16.022370 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:04:16.022370 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:04:16.022370 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:16.022370 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:16.025541 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 297/589] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:04:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:16.026576 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a3492-d7e8-4edc-8297-e0921d333898 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:16.040687 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f1487-51d7-4661-91cb-a1e49cb5186d None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:16.083035 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb030ca-b7ec-4e3a-b3b7-4a2f0394568e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:16.083698 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb030ca-b7ec-4e3a-b3b7-4a2f0394568e None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:16.083973 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb030ca-b7ec-4e3a-b3b7-4a2f0394568e None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:16.084298 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb030ca-b7ec-4e3a-b3b7-4a2f0394568e None admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:16.085008 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb030ca-b7ec-4e3a-b3b7-4a2f0394568e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:16.085357 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb030ca-b7ec-4e3a-b3b7-4a2f0394568e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:16.086794 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb030ca-b7ec-4e3a-b3b7-4a2f0394568e None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:16.098732 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 293/590] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:04:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:16.099618 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb030ca-b7ec-4e3a-b3b7-4a2f0394568e None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:16.137104 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a3492-d7e8-4edc-8297-e0921d333898 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:16.172378 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f3dbf-be5c-4e9f-be8c-479f05f4f251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:16.173405 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f3dbf-be5c-4e9f-be8c-479f05f4f251 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:16.173938 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f3dbf-be5c-4e9f-be8c-479f05f4f251 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:16.174407 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f3dbf-be5c-4e9f-be8c-479f05f4f251 None admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:16.175444 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f3dbf-be5c-4e9f-be8c-479f05f4f251 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:16.175961 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f3dbf-be5c-4e9f-be8c-479f05f4f251 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:16.177631 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539f3dbf-be5c-4e9f-be8c-479f05f4f251 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:16.196396 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 298/591] 10.222.0.65 () {56 vars in 1137 bytes} [Tue May 17 18:04:16 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:16.197575 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f3dbf-be5c-4e9f-be8c-479f05f4f251 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:16.205741 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb030ca-b7ec-4e3a-b3b7-4a2f0394568e None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:16.239550 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da90bcc-f087-4654-a00e-22f231bea202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:16.240233 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da90bcc-f087-4654-a00e-22f231bea202 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:16.240558 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da90bcc-f087-4654-a00e-22f231bea202 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:16.240832 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da90bcc-f087-4654-a00e-22f231bea202 None admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:16.241696 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da90bcc-f087-4654-a00e-22f231bea202 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:16.241879 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da90bcc-f087-4654-a00e-22f231bea202 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:16.243235 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da90bcc-f087-4654-a00e-22f231bea202 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:16.260325 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 294/592] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:04:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:16.261359 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da90bcc-f087-4654-a00e-22f231bea202 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:16.320143 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f3dbf-be5c-4e9f-be8c-479f05f4f251 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:16.363816 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9234be1c-d654-47fa-b9be-4c2b02a3cd06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:16.365081 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234be1c-d654-47fa-b9be-4c2b02a3cd06 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:16.365608 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234be1c-d654-47fa-b9be-4c2b02a3cd06 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:16.366098 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234be1c-d654-47fa-b9be-4c2b02a3cd06 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:16.366925 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da90bcc-f087-4654-a00e-22f231bea202 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:16.374555 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9234be1c-d654-47fa-b9be-4c2b02a3cd06 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:16.376310 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9234be1c-d654-47fa-b9be-4c2b02a3cd06 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:16.391786 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-9234be1c-d654-47fa-b9be-4c2b02a3cd06 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 17 18:04:16.391786 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:16.391786 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:16.391786 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:16.391786 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:16.391786 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:16.391786 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:16.391786 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:16.391786 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:16.391786 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:16.391786 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:16.391786 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:16.391786 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 18:04:16.391786 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 18:04:16.391786 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 18:04:16.391786 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 18:04:16.392787 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:16.392787 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:16.392787 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 18:04:16.392787 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:04:16.392787 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 18:04:16.392787 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:04:16.392787 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:16.392787 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:16.392787 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:16.392787 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:16.392787 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:16.392787 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:16.392787 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:16.392787 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:16.392787 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:16.392787 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:16.392787 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:16.392787 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:16.393824 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:16.393824 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:16.393824 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 18:04:16.393824 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 18:04:16.393824 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 18:04:16.393824 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 18:04:16.393824 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 18:04:16.393824 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 18:04:16.393824 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 17 18:04:16.393824 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:16.396522 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 299/593] 10.222.0.65 () {56 vars in 1102 bytes} [Tue May 17 18:04:16 2022] GET /identity/v3/users/neutron => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:16.397548 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9234be1c-d654-47fa-b9be-4c2b02a3cd06 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:16.402328 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cd95b3-be24-40d3-89c1-cde3a6b3968a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:16.403122 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd95b3-be24-40d3-89c1-cde3a6b3968a None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:16.403456 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd95b3-be24-40d3-89c1-cde3a6b3968a None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:16.403731 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd95b3-be24-40d3-89c1-cde3a6b3968a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:16.414490 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cd95b3-be24-40d3-89c1-cde3a6b3968a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:16.415997 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cd95b3-be24-40d3-89c1-cde3a6b3968a None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:16.433987 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-91cd95b3-be24-40d3-89c1-cde3a6b3968a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:16.433987 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:16.433987 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:16.433987 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:16.433987 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:16.433987 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:16.433987 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:16.433987 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:16.433987 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:16.433987 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:16.433987 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:16.433987 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:16.433987 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:04:16.433987 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:04:16.433987 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:04:16.434953 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:04:16.434953 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:16.434953 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:16.434953 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:16.434953 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:16.434953 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:16.434953 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:16.434953 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:16.434953 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:16.434953 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:16.434953 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:16.434953 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:16.434953 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:16.434953 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:16.434953 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:16.434953 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:16.434953 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:16.436370 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:04:16.436370 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:04:16.436370 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:16.436370 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:16.440152 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 295/594] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:04:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:16.440988 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cd95b3-be24-40d3-89c1-cde3a6b3968a None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:16.501066 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9234be1c-d654-47fa-b9be-4c2b02a3cd06 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:16.536288 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a9435-6e14-4abe-816a-79281eb087c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:16.537435 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a9435-6e14-4abe-816a-79281eb087c4 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:16.538020 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a9435-6e14-4abe-816a-79281eb087c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:16.538512 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a9435-6e14-4abe-816a-79281eb087c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:16.540293 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cd95b3-be24-40d3-89c1-cde3a6b3968a None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:16.546238 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a9435-6e14-4abe-816a-79281eb087c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:16.547939 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a9435-6e14-4abe-816a-79281eb087c4 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:16.562518 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-c16a9435-6e14-4abe-816a-79281eb087c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:04:16.562518 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:16.562518 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:16.562518 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:16.562518 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:16.562518 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:16.562518 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:16.562518 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:16.562518 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:16.562518 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:16.562518 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:16.562518 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:16.562518 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 18:04:16.562518 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 18:04:16.562518 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 18:04:16.563431 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 18:04:16.563431 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:16.563431 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:16.563431 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:16.563431 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:16.563431 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:16.563431 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:16.563431 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:16.563431 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:16.563431 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:16.563431 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:16.563431 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:16.563431 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:16.563431 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:16.563431 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:16.563431 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:16.563431 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:16.564328 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 18:04:16.564328 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 18:04:16.564328 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 18:04:16.564328 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 18:04:16.564328 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 18:04:16.564328 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 18:04:16.564328 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:04:16.564328 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:16.566767 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 300/595] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 17 18:04:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:16.568007 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a9435-6e14-4abe-816a-79281eb087c4 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:16.580637 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d318d-e3a9-49ff-b8f4-78eaaacd0171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:16.581432 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d318d-e3a9-49ff-b8f4-78eaaacd0171 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:16.581747 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d318d-e3a9-49ff-b8f4-78eaaacd0171 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:16.582030 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d318d-e3a9-49ff-b8f4-78eaaacd0171 None admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:16.582906 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582d318d-e3a9-49ff-b8f4-78eaaacd0171 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:16.583209 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582d318d-e3a9-49ff-b8f4-78eaaacd0171 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:16.584630 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582d318d-e3a9-49ff-b8f4-78eaaacd0171 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:16.602958 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 296/596] 10.222.0.65 () {56 vars in 1139 bytes} [Tue May 17 18:04:16 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:16.604034 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d318d-e3a9-49ff-b8f4-78eaaacd0171 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:16.692867 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a9435-6e14-4abe-816a-79281eb087c4 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:16.709915 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d318d-e3a9-49ff-b8f4-78eaaacd0171 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:16.726995 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73f48c-acd3-4c39-88d2-6a2e07a4a085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:16.727759 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73f48c-acd3-4c39-88d2-6a2e07a4a085 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:16.728099 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73f48c-acd3-4c39-88d2-6a2e07a4a085 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:16.728436 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73f48c-acd3-4c39-88d2-6a2e07a4a085 None admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:16.729219 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a73f48c-acd3-4c39-88d2-6a2e07a4a085 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:16.729614 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a73f48c-acd3-4c39-88d2-6a2e07a4a085 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:16.731135 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a73f48c-acd3-4c39-88d2-6a2e07a4a085 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:16.743413 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 301/597] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:04:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:16.746208 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73f48c-acd3-4c39-88d2-6a2e07a4a085 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:16.752077 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a22df-09a5-4077-94c7-f74c32425201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:16.752805 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a22df-09a5-4077-94c7-f74c32425201 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:16.753152 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a22df-09a5-4077-94c7-f74c32425201 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:16.753557 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494a22df-09a5-4077-94c7-f74c32425201 None admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:16.754408 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494a22df-09a5-4077-94c7-f74c32425201 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:16.754832 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494a22df-09a5-4077-94c7-f74c32425201 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:16.756303 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494a22df-09a5-4077-94c7-f74c32425201 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:16.768301 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 297/598] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 17 18:04:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:16.770446 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a22df-09a5-4077-94c7-f74c32425201 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:16.862063 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73f48c-acd3-4c39-88d2-6a2e07a4a085 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:16.885260 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494a22df-09a5-4077-94c7-f74c32425201 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:16.896285 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558bbaf6-2839-4d02-85ef-0bf4de03bf44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:16.897391 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558bbaf6-2839-4d02-85ef-0bf4de03bf44 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:16.897914 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558bbaf6-2839-4d02-85ef-0bf4de03bf44 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:16.898390 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558bbaf6-2839-4d02-85ef-0bf4de03bf44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:16.908664 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558bbaf6-2839-4d02-85ef-0bf4de03bf44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:16.910444 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558bbaf6-2839-4d02-85ef-0bf4de03bf44 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:16.924812 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a8150-db0d-47de-af0d-1a8c0f82ef8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:16.925642 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a8150-db0d-47de-af0d-1a8c0f82ef8b None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:16.925925 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a8150-db0d-47de-af0d-1a8c0f82ef8b None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:16.926216 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a8150-db0d-47de-af0d-1a8c0f82ef8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:16.930628 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-558bbaf6-2839-4d02-85ef-0bf4de03bf44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:16.930628 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:16.930628 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:16.930628 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:16.930628 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:16.930628 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:16.930628 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:16.930628 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:16.930628 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:16.930628 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:16.930628 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:16.930628 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:16.930628 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:04:16.930628 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:04:16.930628 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:04:16.931592 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:04:16.931592 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:16.931592 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:16.931592 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:16.931592 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:16.931592 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:16.931592 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:16.931592 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:16.931592 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:16.931592 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:16.931592 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:16.931592 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:16.931592 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:16.931592 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:16.931592 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:16.931592 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:16.931592 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:16.932464 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:04:16.932464 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:04:16.932464 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:16.932464 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:16.933489 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2a8150-db0d-47de-af0d-1a8c0f82ef8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:16.935128 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2a8150-db0d-47de-af0d-1a8c0f82ef8b None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:16.935465 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 302/599] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:04:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:16.937269 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558bbaf6-2839-4d02-85ef-0bf4de03bf44 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:16.957317 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-fb2a8150-db0d-47de-af0d-1a8c0f82ef8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:04:16.957317 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:16.957317 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:16.957317 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:16.957317 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:16.957317 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:16.957317 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:16.957317 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:16.957317 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:16.957317 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:16.957317 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:16.957317 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:16.957317 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 18:04:16.957317 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 18:04:16.957317 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 18:04:16.958317 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 18:04:16.958317 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:16.958317 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:16.958317 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:16.958317 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:16.958317 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:16.958317 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:16.958317 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:16.958317 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:16.958317 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:16.958317 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:16.958317 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:16.958317 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:16.958317 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:16.958317 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:16.958317 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:16.958317 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:16.959222 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 18:04:16.959222 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 18:04:16.959222 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 18:04:16.959222 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 18:04:16.959222 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 18:04:16.959222 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 18:04:16.959222 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:04:16.959222 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:16.961590 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 298/600] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 17 18:04:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:16.962657 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a8150-db0d-47de-af0d-1a8c0f82ef8b None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:17.059982 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558bbaf6-2839-4d02-85ef-0bf4de03bf44 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:17.077894 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a8150-db0d-47de-af0d-1a8c0f82ef8b None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:17.104430 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e0374a-2a9d-4b8e-aaba-f47fa2f91134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:17.105987 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0374a-2a9d-4b8e-aaba-f47fa2f91134 None admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:17.106586 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0374a-2a9d-4b8e-aaba-f47fa2f91134 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:17.107347 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0374a-2a9d-4b8e-aaba-f47fa2f91134 None admin] PATH_INFO: `/v3/projects/0cf165918c1f46cb96d4b54409862659/users/ce570634a66b45158d940151828f533a/roles/60e39e2185d346a192b8698767df6018` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:17.112694 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa100bf-b2b8-42c4-bb89-a167c8cbc72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:17.113425 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa100bf-b2b8-42c4-bb89-a167c8cbc72f None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:17.113871 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa100bf-b2b8-42c4-bb89-a167c8cbc72f None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:17.114287 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa100bf-b2b8-42c4-bb89-a167c8cbc72f None admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:17.115073 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa100bf-b2b8-42c4-bb89-a167c8cbc72f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:17.115464 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa100bf-b2b8-42c4-bb89-a167c8cbc72f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:17.116894 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa100bf-b2b8-42c4-bb89-a167c8cbc72f None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:17.126225 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e0374a-2a9d-4b8e-aaba-f47fa2f91134 None admin] RBAC: Authorizing `identity:create_grant(project_id=0cf165918c1f46cb96d4b54409862659, user_id=ce570634a66b45158d940151828f533a, role_id=60e39e2185d346a192b8698767df6018)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:17.128405 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e0374a-2a9d-4b8e-aaba-f47fa2f91134 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:17.130766 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 299/601] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:04:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:17.134151 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa100bf-b2b8-42c4-bb89-a167c8cbc72f None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:17.155134 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 303/602] 10.222.0.65 () {58 vars in 1439 bytes} [Tue May 17 18:04:16 2022] PUT /identity/v3/projects/0cf165918c1f46cb96d4b54409862659/users/ce570634a66b45158d940151828f533a/roles/60e39e2185d346a192b8698767df6018 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:04:17.161831 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e0374a-2a9d-4b8e-aaba-f47fa2f91134 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:17.311040 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa100bf-b2b8-42c4-bb89-a167c8cbc72f None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:17.350979 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe84907-4842-4934-a5a4-1cc30295ccf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:17.351645 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe84907-4842-4934-a5a4-1cc30295ccf0 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:17.351926 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe84907-4842-4934-a5a4-1cc30295ccf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:17.352202 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe84907-4842-4934-a5a4-1cc30295ccf0 None admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:17.352986 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe84907-4842-4934-a5a4-1cc30295ccf0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:17.353295 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe84907-4842-4934-a5a4-1cc30295ccf0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:17.354822 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe84907-4842-4934-a5a4-1cc30295ccf0 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:17.370114 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 300/603] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 17 18:04:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:17.376927 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe84907-4842-4934-a5a4-1cc30295ccf0 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:17.407977 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e0374a-2a9d-4b8e-aaba-f47fa2f91134 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:17.453005 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c575be9-7d64-4c62-8255-61746b25d81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:17.453856 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c575be9-7d64-4c62-8255-61746b25d81d None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:17.454133 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c575be9-7d64-4c62-8255-61746b25d81d None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:17.454404 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c575be9-7d64-4c62-8255-61746b25d81d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:17.463476 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c575be9-7d64-4c62-8255-61746b25d81d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:17.465208 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c575be9-7d64-4c62-8255-61746b25d81d None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:17.479950 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-6c575be9-7d64-4c62-8255-61746b25d81d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:04:17.479950 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:17.479950 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:17.479950 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:17.479950 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:17.479950 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:17.479950 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:17.479950 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:17.479950 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:17.479950 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:17.479950 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:17.479950 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:17.479950 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 18:04:17.479950 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 18:04:17.479950 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 18:04:17.480873 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 18:04:17.480873 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:17.480873 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:17.480873 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:17.480873 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:17.480873 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:17.480873 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:17.480873 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:17.480873 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:17.480873 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:17.480873 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:17.480873 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:17.480873 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:17.480873 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:17.480873 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:17.480873 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:17.480873 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:17.481815 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 18:04:17.481815 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 18:04:17.481815 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 18:04:17.481815 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 18:04:17.481815 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 18:04:17.481815 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 18:04:17.481815 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:04:17.481815 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:17.484298 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 304/604] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 17 18:04:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:17.485919 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a16c5-0cb7-433e-9842-f1be97dc4a61 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:17.486418 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a16c5-0cb7-433e-9842-f1be97dc4a61 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:17.486895 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a16c5-0cb7-433e-9842-f1be97dc4a61 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:17.488608 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 305/605] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:04:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:04:17.490245 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a16c5-0cb7-433e-9842-f1be97dc4a61 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:17.505155 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe84907-4842-4934-a5a4-1cc30295ccf0 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:17.548545 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbb2af4-eec0-475d-9e9c-d79f00df6358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:17.549438 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb2af4-eec0-475d-9e9c-d79f00df6358 None admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:17.549992 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb2af4-eec0-475d-9e9c-d79f00df6358 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:17.550275 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbb2af4-eec0-475d-9e9c-d79f00df6358 None admin] PATH_INFO: `/v3/projects/0cf165918c1f46cb96d4b54409862659/users/769f675c28e34902a079c70dab44dbf8/roles/60e39e2185d346a192b8698767df6018` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:17.569091 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbb2af4-eec0-475d-9e9c-d79f00df6358 None admin] RBAC: Authorizing `identity:create_grant(project_id=0cf165918c1f46cb96d4b54409862659, user_id=769f675c28e34902a079c70dab44dbf8, role_id=60e39e2185d346a192b8698767df6018)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:17.570501 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbb2af4-eec0-475d-9e9c-d79f00df6358 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:17.587429 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 301/606] 10.222.0.65 () {58 vars in 1439 bytes} [Tue May 17 18:04:17 2022] PUT /identity/v3/projects/0cf165918c1f46cb96d4b54409862659/users/769f675c28e34902a079c70dab44dbf8/roles/60e39e2185d346a192b8698767df6018 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:04:17.589294 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c355fa9-58c3-4781-92b1-c43dfb79edbe None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:17.589648 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c355fa9-58c3-4781-92b1-c43dfb79edbe None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:17.589932 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c355fa9-58c3-4781-92b1-c43dfb79edbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:17.603136 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7a16c5-0cb7-433e-9842-f1be97dc4a61 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:17.612147 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-9c355fa9-58c3-4781-92b1-c43dfb79edbe None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:17.613929 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-9c355fa9-58c3-4781-92b1-c43dfb79edbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:17.643027 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ba097-8aa7-449f-a608-d55a750f0312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:17.644168 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ba097-8aa7-449f-a608-d55a750f0312 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:17.644706 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ba097-8aa7-449f-a608-d55a750f0312 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:17.645190 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ba097-8aa7-449f-a608-d55a750f0312 None admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:17.646264 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74ba097-8aa7-449f-a608-d55a750f0312 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:17.646798 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74ba097-8aa7-449f-a608-d55a750f0312 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:17.648649 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74ba097-8aa7-449f-a608-d55a750f0312 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:17.663951 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 306/607] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 17 18:04:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:17.669275 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ba097-8aa7-449f-a608-d55a750f0312 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:17.732776 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 302/608] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:04:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:04:17.792116 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c355fa9-58c3-4781-92b1-c43dfb79edbe None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:17.821476 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ba097-8aa7-449f-a608-d55a750f0312 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:17.879736 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0463c-3aee-4e8e-93ff-c80f64cb048c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:17.880895 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0463c-3aee-4e8e-93ff-c80f64cb048c None admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:17.881325 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0463c-3aee-4e8e-93ff-c80f64cb048c None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:17.881952 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0463c-3aee-4e8e-93ff-c80f64cb048c None admin] PATH_INFO: `/v3/projects/0cf165918c1f46cb96d4b54409862659/users/83430939ae474ad6bab37dfb6fc8da78/roles/60e39e2185d346a192b8698767df6018` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:17.901211 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d0463c-3aee-4e8e-93ff-c80f64cb048c None admin] RBAC: Authorizing `identity:create_grant(project_id=0cf165918c1f46cb96d4b54409862659, user_id=83430939ae474ad6bab37dfb6fc8da78, role_id=60e39e2185d346a192b8698767df6018)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:17.902969 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d0463c-3aee-4e8e-93ff-c80f64cb048c None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:17.918587 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 307/609] 10.222.0.65 () {58 vars in 1439 bytes} [Tue May 17 18:04:17 2022] PUT /identity/v3/projects/0cf165918c1f46cb96d4b54409862659/users/83430939ae474ad6bab37dfb6fc8da78/roles/60e39e2185d346a192b8698767df6018 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:04:17.993451 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c355fa9-58c3-4781-92b1-c43dfb79edbe None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:18.058519 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10be71-ee4d-4941-a53f-636d2846ad20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:18.059510 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10be71-ee4d-4941-a53f-636d2846ad20 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:18.059884 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10be71-ee4d-4941-a53f-636d2846ad20 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:18.060253 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10be71-ee4d-4941-a53f-636d2846ad20 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:18.085915 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af10be71-ee4d-4941-a53f-636d2846ad20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:04:18.093765 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-af10be71-ee4d-4941-a53f-636d2846ad20 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 18:04:18.093765 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:18.093765 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:18.093765 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:18.093765 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:18.093765 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:18.093765 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:18.093765 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:18.093765 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:18.093765 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:18.093765 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:18.093765 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:18.093765 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:04:18.093765 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:04:18.093765 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:04:18.093765 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:04:18.094771 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:04:18.094771 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:04:18.094771 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:04:18.094771 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:04:18.094771 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:18.094771 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:18.094771 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:18.094771 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:18.094771 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:18.094771 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:18.094771 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:18.094771 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:18.094771 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:18.094771 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:18.094771 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:18.094771 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:18.096325 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:18.096325 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:18.096325 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:18.096325 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:18.096325 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:04:18.096325 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:04:18.096325 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:04:18.096325 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:04:18.096325 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:04:18.096325 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:04:18.096325 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 18:04:18.096325 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:18.096325 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 303/610] 10.222.0.65 () {56 vars in 1102 bytes} [Tue May 17 18:04:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:04:18.101946 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0463c-3aee-4e8e-93ff-c80f64cb048c None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:18.194095 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1cfbcc-e7b7-492a-bcd0-aaf6d6cf805e None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:18.194462 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1cfbcc-e7b7-492a-bcd0-aaf6d6cf805e None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:18.194677 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1cfbcc-e7b7-492a-bcd0-aaf6d6cf805e None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:18.196049 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 304/611] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:04:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:04:18.201793 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cf7be-66e5-4f00-ba14-1f0c6e4499a3 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:18.202085 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cf7be-66e5-4f00-ba14-1f0c6e4499a3 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:18.202359 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cf7be-66e5-4f00-ba14-1f0c6e4499a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:18.211620 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0463c-3aee-4e8e-93ff-c80f64cb048c None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:18.232940 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-f44cf7be-66e5-4f00-ba14-1f0c6e4499a3 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:18.235830 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-f44cf7be-66e5-4f00-ba14-1f0c6e4499a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:18.252867 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24889a26-e5d5-49aa-b4a5-13ca0e523aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:18.253621 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24889a26-e5d5-49aa-b4a5-13ca0e523aab None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:18.253901 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24889a26-e5d5-49aa-b4a5-13ca0e523aab None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:18.254169 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24889a26-e5d5-49aa-b4a5-13ca0e523aab None admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:18.255313 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24889a26-e5d5-49aa-b4a5-13ca0e523aab None admin] RBAC: Adding query filter params (name=service) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:18.255617 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24889a26-e5d5-49aa-b4a5-13ca0e523aab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:18.257249 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24889a26-e5d5-49aa-b4a5-13ca0e523aab None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:18.271930 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 308/612] 10.222.0.65 () {56 vars in 1103 bytes} [Tue May 17 18:04:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:18.277958 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24889a26-e5d5-49aa-b4a5-13ca0e523aab None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:18.350344 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 305/613] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:04:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 18:04:18.388381 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44cf7be-66e5-4f00-ba14-1f0c6e4499a3 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:18.451955 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24889a26-e5d5-49aa-b4a5-13ca0e523aab None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:18.521005 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5312f5-25bd-48d7-b31a-eef11900fee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:18.521815 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5312f5-25bd-48d7-b31a-eef11900fee4 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:18.522098 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5312f5-25bd-48d7-b31a-eef11900fee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:18.522373 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5312f5-25bd-48d7-b31a-eef11900fee4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:18.525679 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44cf7be-66e5-4f00-ba14-1f0c6e4499a3 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:18.541996 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5312f5-25bd-48d7-b31a-eef11900fee4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:18.543448 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5312f5-25bd-48d7-b31a-eef11900fee4 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:18.567040 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff9cedd-a7cf-4ee4-83d9-ca0de1bd6ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:18.568773 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9cedd-a7cf-4ee4-83d9-ca0de1bd6ed1 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:18.569286 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9cedd-a7cf-4ee4-83d9-ca0de1bd6ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:18.569394 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-dc5312f5-25bd-48d7-b31a-eef11900fee4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:18.569394 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:18.569394 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:18.569394 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:18.569394 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:18.569394 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:18.569394 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:18.569394 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:18.569394 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:18.569394 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:18.569394 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:18.569394 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:18.569394 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:04:18.569394 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:04:18.569394 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:04:18.570253 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:04:18.570253 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:18.570253 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:18.570253 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:18.570253 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:18.570253 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:18.570253 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:18.570253 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:18.570253 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:18.570253 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:18.570253 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:18.570253 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:18.570253 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:18.570253 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:18.570253 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:18.570253 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:18.570253 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:18.571240 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:04:18.571240 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:04:18.571240 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:18.571240 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:18.571240 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 309/614] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:04:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:18.571990 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9cedd-a7cf-4ee4-83d9-ca0de1bd6ed1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:18.575922 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5312f5-25bd-48d7-b31a-eef11900fee4 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:18.596200 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff9cedd-a7cf-4ee4-83d9-ca0de1bd6ed1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:04:18.611465 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-6ff9cedd-a7cf-4ee4-83d9-ca0de1bd6ed1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 18:04:18.611465 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:18.611465 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:18.611465 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:18.611465 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:18.611465 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:18.611465 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:18.611465 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:18.611465 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:18.611465 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:18.611465 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:18.611465 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:18.611465 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:04:18.611465 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:04:18.611465 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:04:18.611465 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:04:18.612450 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:04:18.612450 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:04:18.612450 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:04:18.612450 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:04:18.612450 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:18.612450 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:18.612450 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:18.612450 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:18.612450 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:18.612450 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:18.612450 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:18.612450 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:18.612450 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:18.612450 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:18.612450 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:18.612450 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:18.613299 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:18.613299 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:18.613299 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:18.613299 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:18.613299 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:04:18.613299 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:04:18.613299 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:04:18.613299 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:04:18.613299 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:04:18.613299 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:04:18.613299 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 18:04:18.613299 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:18.618574 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 306/615] 10.222.0.65 () {56 vars in 1102 bytes} [Tue May 17 18:04:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:04:18.624897 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff9cedd-a7cf-4ee4-83d9-ca0de1bd6ed1 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:18.703554 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5312f5-25bd-48d7-b31a-eef11900fee4 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:18.746310 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13349a6-82e8-49fe-890d-16d52c77954a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:18.747363 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13349a6-82e8-49fe-890d-16d52c77954a None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:18.748648 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13349a6-82e8-49fe-890d-16d52c77954a None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:18.749181 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13349a6-82e8-49fe-890d-16d52c77954a None admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:18.750178 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13349a6-82e8-49fe-890d-16d52c77954a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:18.750699 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13349a6-82e8-49fe-890d-16d52c77954a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:18.754480 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13349a6-82e8-49fe-890d-16d52c77954a None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:18.769231 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 310/616] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:04:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:18.781838 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13349a6-82e8-49fe-890d-16d52c77954a None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:18.871961 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff9cedd-a7cf-4ee4-83d9-ca0de1bd6ed1 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:18.942154 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d3ca7-1a4c-4591-8d12-d3568fece10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:18.943078 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d3ca7-1a4c-4591-8d12-d3568fece10b None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:18.943352 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d3ca7-1a4c-4591-8d12-d3568fece10b None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:18.943623 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d3ca7-1a4c-4591-8d12-d3568fece10b None admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:18.944369 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9d3ca7-1a4c-4591-8d12-d3568fece10b None admin] RBAC: Adding query filter params (name=service) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:18.944667 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9d3ca7-1a4c-4591-8d12-d3568fece10b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:18.944777 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13349a6-82e8-49fe-890d-16d52c77954a None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:18.946059 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9d3ca7-1a4c-4591-8d12-d3568fece10b None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:18.960510 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 307/617] 10.222.0.65 () {56 vars in 1103 bytes} [Tue May 17 18:04:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:18.965362 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d3ca7-1a4c-4591-8d12-d3568fece10b None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:19.007333 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe5f80-b9b1-4602-b069-62f6cb8e499d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:19.008205 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe5f80-b9b1-4602-b069-62f6cb8e499d None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:19.008547 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe5f80-b9b1-4602-b069-62f6cb8e499d None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:19.009039 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe5f80-b9b1-4602-b069-62f6cb8e499d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:19.020240 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebe5f80-b9b1-4602-b069-62f6cb8e499d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:19.021952 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebe5f80-b9b1-4602-b069-62f6cb8e499d None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:19.042647 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-8ebe5f80-b9b1-4602-b069-62f6cb8e499d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 17 18:04:19.042647 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:19.042647 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:19.042647 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:19.042647 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:19.042647 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:19.042647 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:19.042647 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:19.042647 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:19.042647 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:19.042647 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:19.042647 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:19.042647 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 18:04:19.042647 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 18:04:19.042647 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 18:04:19.042647 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 18:04:19.043614 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:19.043614 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:19.043614 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 18:04:19.043614 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:04:19.043614 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 18:04:19.043614 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:04:19.043614 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:19.043614 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:19.043614 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:19.043614 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:19.043614 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:19.043614 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:19.043614 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:19.043614 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:19.043614 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:19.043614 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:19.043614 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:19.043614 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:19.044563 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:19.044563 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:19.044563 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 18:04:19.044563 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 18:04:19.044563 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 18:04:19.044563 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 18:04:19.044563 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 18:04:19.044563 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 18:04:19.044563 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 17 18:04:19.044563 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:19.051187 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 311/618] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 17 18:04:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:19.056210 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe5f80-b9b1-4602-b069-62f6cb8e499d None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:19.101812 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d3ca7-1a4c-4591-8d12-d3568fece10b None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:19.141124 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b8cf2-03df-420d-9a31-9318ab60aff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:19.141946 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b8cf2-03df-420d-9a31-9318ab60aff3 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:19.142225 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b8cf2-03df-420d-9a31-9318ab60aff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:19.142497 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b8cf2-03df-420d-9a31-9318ab60aff3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:19.160578 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49b8cf2-03df-420d-9a31-9318ab60aff3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:19.162072 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49b8cf2-03df-420d-9a31-9318ab60aff3 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:19.182501 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-e49b8cf2-03df-420d-9a31-9318ab60aff3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:19.182501 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:19.182501 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:19.182501 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:19.182501 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:19.182501 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:19.182501 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:19.182501 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:19.182501 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:19.182501 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:19.182501 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:19.182501 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:19.182501 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:04:19.182501 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:04:19.182501 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:04:19.183477 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:04:19.183477 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:19.183477 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:19.183477 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:19.183477 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:19.183477 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:19.183477 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:19.183477 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:19.183477 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:19.183477 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:19.183477 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:19.183477 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:19.183477 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:19.183477 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:19.183477 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:19.183477 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:19.183477 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:19.184367 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:04:19.184367 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:04:19.184367 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:19.184367 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:19.184367 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 308/619] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:04:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:04:19.189555 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b8cf2-03df-420d-9a31-9318ab60aff3 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:19.263187 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe5f80-b9b1-4602-b069-62f6cb8e499d None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:19.326952 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4f7f0-3578-40ae-91cc-3f495b448556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:19.328030 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4f7f0-3578-40ae-91cc-3f495b448556 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:19.328522 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4f7f0-3578-40ae-91cc-3f495b448556 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:19.329026 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4f7f0-3578-40ae-91cc-3f495b448556 None admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:19.330114 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f4f7f0-3578-40ae-91cc-3f495b448556 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:19.330630 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f4f7f0-3578-40ae-91cc-3f495b448556 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:19.332283 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f4f7f0-3578-40ae-91cc-3f495b448556 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:19.336229 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b8cf2-03df-420d-9a31-9318ab60aff3 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:19.361621 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 312/620] 10.222.0.65 () {56 vars in 1135 bytes} [Tue May 17 18:04:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:19.366594 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4f7f0-3578-40ae-91cc-3f495b448556 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:19.379259 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9803292-f72d-4a8b-ab2d-e8e5e3be3e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:19.380249 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9803292-f72d-4a8b-ab2d-e8e5e3be3e81 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:19.380754 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9803292-f72d-4a8b-ab2d-e8e5e3be3e81 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:19.381252 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9803292-f72d-4a8b-ab2d-e8e5e3be3e81 None admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:19.382215 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9803292-f72d-4a8b-ab2d-e8e5e3be3e81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:19.382732 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9803292-f72d-4a8b-ab2d-e8e5e3be3e81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:19.384322 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9803292-f72d-4a8b-ab2d-e8e5e3be3e81 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:19.414328 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 309/621] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:04:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:19.419554 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9803292-f72d-4a8b-ab2d-e8e5e3be3e81 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:19.563916 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4f7f0-3578-40ae-91cc-3f495b448556 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:19.605143 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9803292-f72d-4a8b-ab2d-e8e5e3be3e81 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:19.631686 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cebc20-dfda-4c0c-98f2-c64af349265e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:19.633560 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cebc20-dfda-4c0c-98f2-c64af349265e None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:19.634205 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cebc20-dfda-4c0c-98f2-c64af349265e None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:19.635775 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cebc20-dfda-4c0c-98f2-c64af349265e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:19.652628 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cebc20-dfda-4c0c-98f2-c64af349265e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:19.655565 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cebc20-dfda-4c0c-98f2-c64af349265e None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:19.672057 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094084ff-eda8-468b-80b7-553f942737b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:19.673151 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094084ff-eda8-468b-80b7-553f942737b3 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:19.673683 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094084ff-eda8-468b-80b7-553f942737b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:19.674160 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094084ff-eda8-468b-80b7-553f942737b3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:19.687860 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-25cebc20-dfda-4c0c-98f2-c64af349265e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:19.687860 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:19.687860 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:19.687860 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:19.687860 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:19.687860 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:19.687860 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:19.687860 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:19.687860 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:19.687860 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:19.687860 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:19.687860 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:19.687860 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:04:19.687860 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:04:19.687860 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:04:19.688788 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:04:19.688788 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:19.688788 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:19.688788 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:19.688788 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:19.688788 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:19.688788 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:19.688788 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:19.688788 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:19.688788 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:19.688788 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:19.688788 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:19.688788 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:19.688788 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:19.688788 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:19.688788 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:19.688788 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:19.689779 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:04:19.689779 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:04:19.689779 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:19.689779 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:19.691992 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 313/622] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:04:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:04:19.697605 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094084ff-eda8-468b-80b7-553f942737b3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:19.697605 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094084ff-eda8-468b-80b7-553f942737b3 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:19.698712 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cebc20-dfda-4c0c-98f2-c64af349265e None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:19.725652 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-094084ff-eda8-468b-80b7-553f942737b3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 17 18:04:19.725652 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:19.725652 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:19.725652 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:19.725652 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:19.725652 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:19.725652 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:19.725652 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:19.725652 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:19.725652 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:19.725652 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:19.725652 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:19.725652 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 18:04:19.725652 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 18:04:19.725652 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 18:04:19.725652 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 18:04:19.726797 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:19.726797 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:19.726797 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 18:04:19.726797 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:04:19.726797 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 18:04:19.726797 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:04:19.726797 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:19.726797 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:19.726797 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:19.726797 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:19.726797 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:19.726797 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:19.726797 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:19.726797 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:19.726797 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:19.726797 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:19.726797 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:19.726797 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:19.727930 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:19.727930 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:19.727930 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 18:04:19.727930 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 18:04:19.727930 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 18:04:19.727930 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 18:04:19.727930 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 18:04:19.727930 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 18:04:19.727930 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 17 18:04:19.727930 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:19.729929 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 310/623] 10.222.0.65 () {56 vars in 1093 bytes} [Tue May 17 18:04:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:04:19.736365 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094084ff-eda8-468b-80b7-553f942737b3 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:19.825387 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cebc20-dfda-4c0c-98f2-c64af349265e None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:19.867372 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094084ff-eda8-468b-80b7-553f942737b3 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:19.873135 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc49f1-af18-429d-bb67-15be6edd7d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:19.874091 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc49f1-af18-429d-bb67-15be6edd7d6e None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:19.874576 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc49f1-af18-429d-bb67-15be6edd7d6e None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:19.875074 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc49f1-af18-429d-bb67-15be6edd7d6e None admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:19.876436 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc49f1-af18-429d-bb67-15be6edd7d6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:19.876967 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc49f1-af18-429d-bb67-15be6edd7d6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:19.879254 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc49f1-af18-429d-bb67-15be6edd7d6e None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:19.899785 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 314/624] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:04:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:19.899785 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bcf587-1558-4f99-828c-6b534b9c191d None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:19.899785 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bcf587-1558-4f99-828c-6b534b9c191d None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:19.899785 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bcf587-1558-4f99-828c-6b534b9c191d None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:19.900972 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 315/625] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:04:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:04:19.903113 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bcf587-1558-4f99-828c-6b534b9c191d None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:19.915657 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bc3e23-658f-4294-bad6-6ba9aba36d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:19.916661 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc3e23-658f-4294-bad6-6ba9aba36d1c None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:19.917568 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc3e23-658f-4294-bad6-6ba9aba36d1c None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:19.918054 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bc3e23-658f-4294-bad6-6ba9aba36d1c None admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:19.919694 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bc3e23-658f-4294-bad6-6ba9aba36d1c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:19.920753 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bc3e23-658f-4294-bad6-6ba9aba36d1c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:19.923234 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bc3e23-658f-4294-bad6-6ba9aba36d1c None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:19.948472 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 311/626] 10.222.0.65 () {56 vars in 1133 bytes} [Tue May 17 18:04:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:19.950442 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014b9bd-d53a-45e0-bec6-da7bdbd4e737 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:19.950883 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014b9bd-d53a-45e0-bec6-da7bdbd4e737 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:19.951895 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a014b9bd-d53a-45e0-bec6-da7bdbd4e737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:19.973388 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-a014b9bd-d53a-45e0-bec6-da7bdbd4e737 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:19.975022 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-a014b9bd-d53a-45e0-bec6-da7bdbd4e737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:20.009214 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bcf587-1558-4f99-828c-6b534b9c191d None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:20.045131 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506dc5b5-23b2-4774-9035-c6b5216d5c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:20.045764 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506dc5b5-23b2-4774-9035-c6b5216d5c92 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:20.046136 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506dc5b5-23b2-4774-9035-c6b5216d5c92 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:20.046503 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506dc5b5-23b2-4774-9035-c6b5216d5c92 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:20.053569 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506dc5b5-23b2-4774-9035-c6b5216d5c92 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:20.055112 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506dc5b5-23b2-4774-9035-c6b5216d5c92 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:20.065790 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 312/627] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:04:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:04:20.067918 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a014b9bd-d53a-45e0-bec6-da7bdbd4e737 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:20.081269 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-506dc5b5-23b2-4774-9035-c6b5216d5c92 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:04:20.081269 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:20.081269 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:20.081269 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:20.081269 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:20.081269 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:20.081269 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:20.081269 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:20.081269 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:20.081269 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:20.081269 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:20.081269 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:20.081269 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 18:04:20.081269 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 18:04:20.081269 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 18:04:20.082204 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 18:04:20.082204 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:20.082204 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:20.082204 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:20.082204 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:20.082204 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:20.082204 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:20.082204 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:20.082204 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:20.082204 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:20.082204 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:20.082204 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:20.082204 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:20.082204 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:20.082204 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:20.082204 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:20.082204 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:20.083077 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 18:04:20.083077 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 18:04:20.083077 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 18:04:20.083077 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 18:04:20.083077 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 18:04:20.083077 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 18:04:20.083077 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:04:20.083077 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:20.085724 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 316/628] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 17 18:04:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:20.093109 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506dc5b5-23b2-4774-9035-c6b5216d5c92 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:20.178698 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a014b9bd-d53a-45e0-bec6-da7bdbd4e737 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:20.212958 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506dc5b5-23b2-4774-9035-c6b5216d5c92 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:20.228902 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb6381-9eb7-422d-8976-531cc1230b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:20.229993 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb6381-9eb7-422d-8976-531cc1230b44 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:20.230625 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb6381-9eb7-422d-8976-531cc1230b44 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:20.231531 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb6381-9eb7-422d-8976-531cc1230b44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:20.251710 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b680b93-1165-4e2d-89c4-52dceed063f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:20.252392 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b680b93-1165-4e2d-89c4-52dceed063f1 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:20.252713 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b680b93-1165-4e2d-89c4-52dceed063f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:20.252984 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b680b93-1165-4e2d-89c4-52dceed063f1 None admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:20.253802 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b680b93-1165-4e2d-89c4-52dceed063f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:20.254103 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b680b93-1165-4e2d-89c4-52dceed063f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:20.255564 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b680b93-1165-4e2d-89c4-52dceed063f1 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:20.273552 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 317/629] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 17 18:04:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:04:20.273552 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b680b93-1165-4e2d-89c4-52dceed063f1 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:20.328339 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb6381-9eb7-422d-8976-531cc1230b44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:20.330912 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebb6381-9eb7-422d-8976-531cc1230b44 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:20.383982 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b680b93-1165-4e2d-89c4-52dceed063f1 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:20.423600 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278dfd69-767a-48e3-ad34-f342a382907c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:20.424395 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278dfd69-767a-48e3-ad34-f342a382907c None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:20.424671 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278dfd69-767a-48e3-ad34-f342a382907c None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:20.424944 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278dfd69-767a-48e3-ad34-f342a382907c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:20.435003 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 313/630] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 17 18:04:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 18:04:20.435915 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb6381-9eb7-422d-8976-531cc1230b44 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:20.440206 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278dfd69-767a-48e3-ad34-f342a382907c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:04:20.448130 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-278dfd69-767a-48e3-ad34-f342a382907c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 18:04:20.448130 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:20.448130 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:20.448130 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:20.448130 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:20.448130 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:20.448130 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:20.448130 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:20.448130 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:20.448130 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:20.448130 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:20.448130 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:20.448130 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:04:20.448130 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:04:20.448130 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:04:20.448130 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:04:20.449409 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:04:20.449409 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:04:20.449409 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:04:20.449409 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:04:20.449409 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:20.449409 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:20.449409 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:20.449409 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:20.449409 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:20.449409 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:20.449409 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:20.449409 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:20.449409 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:20.449409 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:20.449409 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:20.449409 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:20.450483 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:20.450483 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:20.450483 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:20.450483 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:20.450483 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:04:20.450483 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:04:20.450483 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:04:20.450483 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:04:20.450483 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:04:20.450483 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:04:20.450483 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 18:04:20.450483 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:20.450483 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 318/631] 10.222.0.65 () {56 vars in 1102 bytes} [Tue May 17 18:04:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:20.451861 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d4a6ba-26b4-4abb-9f87-20bd51e380e4 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:20.451861 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d4a6ba-26b4-4abb-9f87-20bd51e380e4 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:20.451861 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d4a6ba-26b4-4abb-9f87-20bd51e380e4 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:20.456878 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 319/632] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:04:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:04:20.456878 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d4a6ba-26b4-4abb-9f87-20bd51e380e4 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:20.537743 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb6381-9eb7-422d-8976-531cc1230b44 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:20.549748 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d4a6ba-26b4-4abb-9f87-20bd51e380e4 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:20.570009 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5a3b2-f6c5-4e50-af6e-c89b3786630e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:20.570871 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5a3b2-f6c5-4e50-af6e-c89b3786630e None admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:20.571145 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5a3b2-f6c5-4e50-af6e-c89b3786630e None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:20.571408 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5a3b2-f6c5-4e50-af6e-c89b3786630e None admin] PATH_INFO: `/v3/projects/0cf165918c1f46cb96d4b54409862659/users/1464e84a3a2d4321a98b98d398bc7be3/roles/60e39e2185d346a192b8698767df6018` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:20.581816 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce89ee4e-5477-43fb-b6dd-3c013b7a7f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:20.582590 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89ee4e-5477-43fb-b6dd-3c013b7a7f60 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:20.582879 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89ee4e-5477-43fb-b6dd-3c013b7a7f60 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:20.583151 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89ee4e-5477-43fb-b6dd-3c013b7a7f60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:20.584651 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f5a3b2-f6c5-4e50-af6e-c89b3786630e None admin] RBAC: Authorizing `identity:create_grant(project_id=0cf165918c1f46cb96d4b54409862659, user_id=1464e84a3a2d4321a98b98d398bc7be3, role_id=60e39e2185d346a192b8698767df6018)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:20.586104 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f5a3b2-f6c5-4e50-af6e-c89b3786630e None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:20.593661 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce89ee4e-5477-43fb-b6dd-3c013b7a7f60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:20.595110 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce89ee4e-5477-43fb-b6dd-3c013b7a7f60 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:20.599914 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 314/633] 10.222.0.65 () {58 vars in 1439 bytes} [Tue May 17 18:04:20 2022] PUT /identity/v3/projects/0cf165918c1f46cb96d4b54409862659/users/1464e84a3a2d4321a98b98d398bc7be3/roles/60e39e2185d346a192b8698767df6018 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:04:20.601180 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e7937-fc80-437c-977d-7c8824c02cc3 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:20.601483 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e7937-fc80-437c-977d-7c8824c02cc3 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:20.601773 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e7937-fc80-437c-977d-7c8824c02cc3 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:20.603040 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 315/634] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:04:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:04:20.603772 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e7937-fc80-437c-977d-7c8824c02cc3 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:20.616252 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-ce89ee4e-5477-43fb-b6dd-3c013b7a7f60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:20.616252 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:20.616252 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:20.616252 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:20.616252 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:20.616252 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:20.616252 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:20.616252 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:20.616252 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:20.616252 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:20.616252 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:20.616252 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:20.616252 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:04:20.616252 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:04:20.616252 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:04:20.617286 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:04:20.617286 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:20.617286 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:20.617286 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:20.617286 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:20.617286 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:20.617286 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:20.617286 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:20.617286 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:20.617286 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:20.617286 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:20.617286 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:20.617286 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:20.617286 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:20.617286 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:20.617286 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:20.617286 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:20.618573 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:04:20.618573 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:04:20.618573 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:20.618573 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:20.618573 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 320/635] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:04:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:20.619135 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc38b691-f197-4608-a53d-56d5b475e6e2 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:20.619404 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc38b691-f197-4608-a53d-56d5b475e6e2 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:20.619678 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc38b691-f197-4608-a53d-56d5b475e6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:20.637559 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-cc38b691-f197-4608-a53d-56d5b475e6e2 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:20.638891 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-cc38b691-f197-4608-a53d-56d5b475e6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:20.712022 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 321/636] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:04:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:04:20.713068 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51272cdb-bd9d-4e38-8839-f783b88efff5 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:20.713345 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51272cdb-bd9d-4e38-8839-f783b88efff5 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:20.713658 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51272cdb-bd9d-4e38-8839-f783b88efff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:20.730910 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-51272cdb-bd9d-4e38-8839-f783b88efff5 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:20.732113 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-51272cdb-bd9d-4e38-8839-f783b88efff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:20.737705 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e7937-fc80-437c-977d-7c8824c02cc3 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:20.773170 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d30fa42-9144-47da-aa91-63fea1d9d83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:20.773871 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30fa42-9144-47da-aa91-63fea1d9d83e None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:20.774146 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30fa42-9144-47da-aa91-63fea1d9d83e None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:20.774415 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30fa42-9144-47da-aa91-63fea1d9d83e None admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:20.775166 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d30fa42-9144-47da-aa91-63fea1d9d83e None admin] RBAC: Adding query filter params (name=service) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:20.775466 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d30fa42-9144-47da-aa91-63fea1d9d83e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:20.776844 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d30fa42-9144-47da-aa91-63fea1d9d83e None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:20.790757 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 316/637] 10.222.0.65 () {56 vars in 1103 bytes} [Tue May 17 18:04:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:20.790757 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d30fa42-9144-47da-aa91-63fea1d9d83e None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:20.808923 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 322/638] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:04:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:04:20.811702 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51272cdb-bd9d-4e38-8839-f783b88efff5 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:20.907207 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d30fa42-9144-47da-aa91-63fea1d9d83e None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:20.918057 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51272cdb-bd9d-4e38-8839-f783b88efff5 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:20.942705 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a625e1f-85de-4979-a14c-4245cda114d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:20.943403 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a625e1f-85de-4979-a14c-4245cda114d0 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:20.943810 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a625e1f-85de-4979-a14c-4245cda114d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:20.944091 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a625e1f-85de-4979-a14c-4245cda114d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:20.945399 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a625e1f-85de-4979-a14c-4245cda114d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:20.945742 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a625e1f-85de-4979-a14c-4245cda114d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:20.947594 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a625e1f-85de-4979-a14c-4245cda114d0 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:20.952896 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf364d19-8e31-464b-9f39-ee7f3187df09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:20.953711 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf364d19-8e31-464b-9f39-ee7f3187df09 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:20.953988 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf364d19-8e31-464b-9f39-ee7f3187df09 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:20.954250 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf364d19-8e31-464b-9f39-ee7f3187df09 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:20.960244 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 317/639] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:04:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:20.961068 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a625e1f-85de-4979-a14c-4245cda114d0 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:20.968755 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf364d19-8e31-464b-9f39-ee7f3187df09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:04:20.976322 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-bf364d19-8e31-464b-9f39-ee7f3187df09 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 18:04:20.976322 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:20.976322 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:20.976322 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:20.976322 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:20.976322 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:20.976322 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:20.976322 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:20.976322 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:20.976322 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:20.976322 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:20.976322 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:20.976322 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:04:20.976322 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:04:20.976322 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:04:20.976322 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:04:20.977280 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:04:20.977280 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:04:20.977280 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:04:20.977280 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:04:20.977280 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:20.977280 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:20.977280 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:20.977280 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:20.977280 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:20.977280 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:20.977280 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:20.977280 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:20.977280 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:20.977280 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:20.977280 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:20.977280 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:20.978181 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:20.978181 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:20.978181 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:20.978181 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:20.978181 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:04:20.978181 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:04:20.978181 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:04:20.978181 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:04:20.978181 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:04:20.978181 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:04:20.978181 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 18:04:20.978181 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:20.978181 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 323/640] 10.222.0.65 () {56 vars in 1102 bytes} [Tue May 17 18:04:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:20.978873 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf364d19-8e31-464b-9f39-ee7f3187df09 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:21.064819 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a625e1f-85de-4979-a14c-4245cda114d0 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:21.075253 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf364d19-8e31-464b-9f39-ee7f3187df09 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:21.101523 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e95c82-db5d-4673-9b9f-c501e1555bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:21.102336 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e95c82-db5d-4673-9b9f-c501e1555bfc None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:21.102615 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e95c82-db5d-4673-9b9f-c501e1555bfc None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:21.102891 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e95c82-db5d-4673-9b9f-c501e1555bfc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:21.107500 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62487429-888b-4682-bc35-3f34afe1efd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:21.108281 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62487429-888b-4682-bc35-3f34afe1efd4 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:21.108555 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62487429-888b-4682-bc35-3f34afe1efd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:21.108825 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62487429-888b-4682-bc35-3f34afe1efd4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:21.113809 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e95c82-db5d-4673-9b9f-c501e1555bfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:21.115332 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e95c82-db5d-4673-9b9f-c501e1555bfc None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:21.119223 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62487429-888b-4682-bc35-3f34afe1efd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:04:21.127988 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-62487429-888b-4682-bc35-3f34afe1efd4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 18:04:21.127988 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:21.127988 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:21.127988 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:21.127988 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:21.127988 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:21.127988 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:21.127988 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:21.127988 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:21.127988 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:21.127988 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:21.127988 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:21.127988 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:04:21.127988 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:04:21.127988 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:04:21.127988 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:04:21.128903 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:04:21.128903 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:04:21.128903 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:04:21.128903 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:04:21.128903 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:21.128903 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:21.128903 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:21.128903 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:21.128903 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:21.128903 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:21.128903 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:21.128903 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:21.128903 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:21.128903 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:21.128903 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:21.128903 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:21.129806 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:21.129806 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:21.129806 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:21.129806 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:21.129806 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:04:21.129806 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:04:21.129806 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:04:21.129806 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:04:21.129806 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:04:21.129806 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:04:21.129806 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 18:04:21.129806 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:21.133489 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-25e95c82-db5d-4673-9b9f-c501e1555bfc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:21.133489 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:21.133489 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:21.133489 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:21.133489 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:21.133489 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:21.133489 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:21.133489 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:21.133489 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:21.133489 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:21.133489 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:21.133489 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:21.133489 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:04:21.133489 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:04:21.133489 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:04:21.134388 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:04:21.134388 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:21.134388 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:21.134388 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:21.134388 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:21.134388 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:21.134388 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:21.134388 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:21.134388 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:21.134388 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:21.134388 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:21.134388 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:21.134388 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:21.134388 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:21.134388 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:21.134388 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:21.134388 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:21.136458 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:04:21.136458 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:04:21.136458 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:21.136458 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:21.136970 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 324/641] 10.222.0.65 () {56 vars in 1102 bytes} [Tue May 17 18:04:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:21.136970 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62487429-888b-4682-bc35-3f34afe1efd4 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:21.137255 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 318/642] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:04:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:21.137255 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e95c82-db5d-4673-9b9f-c501e1555bfc None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:21.233226 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e95c82-db5d-4673-9b9f-c501e1555bfc None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:21.235365 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62487429-888b-4682-bc35-3f34afe1efd4 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:21.266932 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b1894d-e69b-47f9-8437-214ce660f432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:21.267427 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14763e84-657f-49fb-9656-46e4d521d600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:21.267644 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1894d-e69b-47f9-8437-214ce660f432 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:21.267868 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1894d-e69b-47f9-8437-214ce660f432 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:21.268135 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1894d-e69b-47f9-8437-214ce660f432 None admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:21.268231 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14763e84-657f-49fb-9656-46e4d521d600 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:21.268480 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14763e84-657f-49fb-9656-46e4d521d600 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:21.268753 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14763e84-657f-49fb-9656-46e4d521d600 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:21.268858 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b1894d-e69b-47f9-8437-214ce660f432 None admin] RBAC: Adding query filter params (name=service) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:21.269153 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b1894d-e69b-47f9-8437-214ce660f432 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:21.270567 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b1894d-e69b-47f9-8437-214ce660f432 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:21.275574 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14763e84-657f-49fb-9656-46e4d521d600 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:21.277012 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14763e84-657f-49fb-9656-46e4d521d600 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:21.283274 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 319/643] 10.222.0.65 () {56 vars in 1103 bytes} [Tue May 17 18:04:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:21.283274 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b1894d-e69b-47f9-8437-214ce660f432 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:21.297962 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-14763e84-657f-49fb-9656-46e4d521d600 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:04:21.297962 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:21.297962 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:21.297962 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:21.297962 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:21.297962 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:21.297962 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:21.297962 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:21.297962 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:21.297962 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:21.297962 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:21.297962 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:21.297962 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 18:04:21.297962 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 18:04:21.297962 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 18:04:21.298887 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 18:04:21.298887 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:21.298887 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:21.298887 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:21.298887 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:21.298887 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:21.298887 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:21.298887 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:21.298887 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:21.298887 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:21.298887 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:21.298887 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:21.298887 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:21.298887 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:21.298887 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:21.298887 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:21.298887 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:21.299888 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 18:04:21.299888 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 18:04:21.299888 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 18:04:21.299888 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 18:04:21.299888 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 18:04:21.299888 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 18:04:21.299888 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:04:21.299888 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:21.301771 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 325/644] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 17 18:04:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:21.302794 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14763e84-657f-49fb-9656-46e4d521d600 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:21.383276 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b1894d-e69b-47f9-8437-214ce660f432 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:21.398531 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14763e84-657f-49fb-9656-46e4d521d600 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:21.414833 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e728f21-b66b-4ca6-b3cd-baeb42370831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:21.415495 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e728f21-b66b-4ca6-b3cd-baeb42370831 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:21.415773 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e728f21-b66b-4ca6-b3cd-baeb42370831 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:21.416041 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e728f21-b66b-4ca6-b3cd-baeb42370831 None admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:21.416780 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e728f21-b66b-4ca6-b3cd-baeb42370831 None admin] RBAC: Adding query filter params (name=service) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:21.417080 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e728f21-b66b-4ca6-b3cd-baeb42370831 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:21.418467 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e728f21-b66b-4ca6-b3cd-baeb42370831 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:21.431047 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 320/645] 10.222.0.65 () {56 vars in 1103 bytes} [Tue May 17 18:04:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:21.431047 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e728f21-b66b-4ca6-b3cd-baeb42370831 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:21.436592 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e091f1-7c37-433f-9218-e1d9af0e41de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:21.437256 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e091f1-7c37-433f-9218-e1d9af0e41de None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:21.437563 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e091f1-7c37-433f-9218-e1d9af0e41de None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:21.437841 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e091f1-7c37-433f-9218-e1d9af0e41de None admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:21.438562 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e091f1-7c37-433f-9218-e1d9af0e41de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:21.438871 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e091f1-7c37-433f-9218-e1d9af0e41de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:21.440242 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e091f1-7c37-433f-9218-e1d9af0e41de None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:21.452522 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 326/646] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:04:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:21.453438 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e091f1-7c37-433f-9218-e1d9af0e41de None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:21.530685 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e728f21-b66b-4ca6-b3cd-baeb42370831 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:21.558083 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e091f1-7c37-433f-9218-e1d9af0e41de None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:21.562477 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb70d23-3d3b-4d5f-be7f-8cdaa9a4b89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:21.563257 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb70d23-3d3b-4d5f-be7f-8cdaa9a4b89c None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:21.563536 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb70d23-3d3b-4d5f-be7f-8cdaa9a4b89c None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:21.563804 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb70d23-3d3b-4d5f-be7f-8cdaa9a4b89c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:21.574008 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb70d23-3d3b-4d5f-be7f-8cdaa9a4b89c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:21.575446 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb70d23-3d3b-4d5f-be7f-8cdaa9a4b89c None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:21.591102 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5020322-ed96-4689-8ff9-976445ec2d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:21.592366 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5020322-ed96-4689-8ff9-976445ec2d3b None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:21.592741 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5020322-ed96-4689-8ff9-976445ec2d3b None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:21.593025 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-3bb70d23-3d3b-4d5f-be7f-8cdaa9a4b89c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:21.593025 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:21.593025 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:21.593025 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:21.593025 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:21.593025 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:21.593025 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:21.593025 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:21.593025 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:21.593025 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:21.593025 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:21.593025 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:21.593025 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:04:21.593025 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:04:21.593025 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:04:21.593915 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:04:21.593915 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:21.593915 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:21.593915 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:21.593915 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:21.593915 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:21.593915 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:21.593915 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:21.593915 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:21.593915 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:21.593915 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:21.593915 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:21.593915 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:21.593915 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:21.593915 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:21.593915 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:21.593915 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:21.594802 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:04:21.594802 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:04:21.594802 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:21.594802 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:21.595031 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5020322-ed96-4689-8ff9-976445ec2d3b None admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:21.595031 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5020322-ed96-4689-8ff9-976445ec2d3b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:21.595031 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5020322-ed96-4689-8ff9-976445ec2d3b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:21.595226 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 321/647] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:04:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:21.595303 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb70d23-3d3b-4d5f-be7f-8cdaa9a4b89c None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:21.599981 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5020322-ed96-4689-8ff9-976445ec2d3b None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:21.611957 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 327/648] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 17 18:04:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:21.612757 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5020322-ed96-4689-8ff9-976445ec2d3b None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:21.695478 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb70d23-3d3b-4d5f-be7f-8cdaa9a4b89c None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:21.711208 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5020322-ed96-4689-8ff9-976445ec2d3b None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:21.733279 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a35957-459e-467c-9074-cb33a860db25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:21.734098 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a35957-459e-467c-9074-cb33a860db25 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:21.734374 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a35957-459e-467c-9074-cb33a860db25 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:21.734650 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a35957-459e-467c-9074-cb33a860db25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:21.745853 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a35957-459e-467c-9074-cb33a860db25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:21.747511 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a35957-459e-467c-9074-cb33a860db25 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:21.748488 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb2601-048b-4abe-b6de-c7fad0b5e1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:21.749245 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb2601-048b-4abe-b6de-c7fad0b5e1a7 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:21.749549 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb2601-048b-4abe-b6de-c7fad0b5e1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:21.749897 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb2601-048b-4abe-b6de-c7fad0b5e1a7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:21.756956 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cb2601-048b-4abe-b6de-c7fad0b5e1a7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:21.758412 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cb2601-048b-4abe-b6de-c7fad0b5e1a7 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:21.765550 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-95a35957-459e-467c-9074-cb33a860db25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:21.765550 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:21.765550 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:21.765550 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:21.765550 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:21.765550 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:21.765550 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:21.765550 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:21.765550 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:21.765550 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:21.765550 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:21.765550 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:21.765550 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:04:21.765550 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:04:21.765550 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:04:21.766507 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:04:21.766507 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:21.766507 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:21.766507 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:21.766507 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:21.766507 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:21.766507 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:21.766507 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:21.766507 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:21.766507 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:21.766507 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:21.766507 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:21.766507 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:21.766507 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:21.766507 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:21.766507 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:21.766507 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:21.767395 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:04:21.767395 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:04:21.767395 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:21.767395 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:21.769199 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 322/649] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:04:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:21.770298 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a35957-459e-467c-9074-cb33a860db25 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:21.773161 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-a5cb2601-048b-4abe-b6de-c7fad0b5e1a7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 17 18:04:21.773161 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:21.773161 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:21.773161 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:21.773161 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:21.773161 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:21.773161 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:21.773161 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:21.773161 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:21.773161 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:21.773161 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:21.773161 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:21.773161 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 18:04:21.773161 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 18:04:21.773161 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 18:04:21.773161 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 18:04:21.774267 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:21.774267 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:21.774267 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 18:04:21.774267 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:04:21.774267 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 18:04:21.774267 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:04:21.774267 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:21.774267 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:21.774267 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:21.774267 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:21.774267 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:21.774267 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:21.774267 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:21.774267 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:21.774267 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:21.774267 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:21.774267 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:21.774267 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:21.775409 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:21.775409 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:21.775409 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 18:04:21.775409 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 18:04:21.775409 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 18:04:21.775409 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 18:04:21.775409 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 18:04:21.775409 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 18:04:21.775409 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 17 18:04:21.775409 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:21.775409 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 328/650] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 17 18:04:21 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:21.775409 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb2601-048b-4abe-b6de-c7fad0b5e1a7 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:21.875916 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a35957-459e-467c-9074-cb33a860db25 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:21.879100 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb2601-048b-4abe-b6de-c7fad0b5e1a7 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:21.909978 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e8d95-c448-4fc9-bd13-ff2d4f7f4013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:21.910629 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e8d95-c448-4fc9-bd13-ff2d4f7f4013 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:21.910908 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e8d95-c448-4fc9-bd13-ff2d4f7f4013 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:21.911179 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e8d95-c448-4fc9-bd13-ff2d4f7f4013 None admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:21.911917 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5e8d95-c448-4fc9-bd13-ff2d4f7f4013 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:21.912221 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5e8d95-c448-4fc9-bd13-ff2d4f7f4013 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:21.912461 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d649a2-d4e2-45b0-b607-5929363e1dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:21.913105 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d649a2-d4e2-45b0-b607-5929363e1dc0 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:21.913380 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d649a2-d4e2-45b0-b607-5929363e1dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:21.913621 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5e8d95-c448-4fc9-bd13-ff2d4f7f4013 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:21.913733 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d649a2-d4e2-45b0-b607-5929363e1dc0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:21.914512 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d649a2-d4e2-45b0-b607-5929363e1dc0 None admin] RBAC: Adding query filter params (role.id=60e39e2185d346a192b8698767df6018, scope.project.id=0cf165918c1f46cb96d4b54409862659, user.id=5b430b739cb54fc7911bc89f8ea2df72) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:21.914888 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d649a2-d4e2-45b0-b607-5929363e1dc0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:21.916284 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d649a2-d4e2-45b0-b607-5929363e1dc0 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:21.929703 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 329/651] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 17 18:04:21 2022] GET /identity/v3/role_assignments?user.id=5b430b739cb54fc7911bc89f8ea2df72&scope.project.id=0cf165918c1f46cb96d4b54409862659&role.id=60e39e2185d346a192b8698767df6018 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:21.929703 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d649a2-d4e2-45b0-b607-5929363e1dc0 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:21.941078 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 323/652] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:04:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:21.942793 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e8d95-c448-4fc9-bd13-ff2d4f7f4013 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:22.040345 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d649a2-d4e2-45b0-b607-5929363e1dc0 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:22.066393 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e8d95-c448-4fc9-bd13-ff2d4f7f4013 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:22.087069 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb211095-d0eb-49d0-acab-1206b52a58b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:22.088283 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb211095-d0eb-49d0-acab-1206b52a58b4 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:22.088629 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb211095-d0eb-49d0-acab-1206b52a58b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:22.089230 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb211095-d0eb-49d0-acab-1206b52a58b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:22.090007 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb211095-d0eb-49d0-acab-1206b52a58b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:22.090471 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb211095-d0eb-49d0-acab-1206b52a58b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:22.092610 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb211095-d0eb-49d0-acab-1206b52a58b4 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:22.101734 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac6800-8b51-406b-887e-9c0564e5de1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:22.102558 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac6800-8b51-406b-887e-9c0564e5de1d None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:22.102931 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac6800-8b51-406b-887e-9c0564e5de1d None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:22.103298 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac6800-8b51-406b-887e-9c0564e5de1d None admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:22.104243 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac6800-8b51-406b-887e-9c0564e5de1d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:22.104646 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac6800-8b51-406b-887e-9c0564e5de1d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:22.106242 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac6800-8b51-406b-887e-9c0564e5de1d None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:22.106937 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 330/653] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:04:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:22.108319 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb211095-d0eb-49d0-acab-1206b52a58b4 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:22.132636 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 324/654] 10.222.0.65 () {56 vars in 1137 bytes} [Tue May 17 18:04:21 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:22.137812 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac6800-8b51-406b-887e-9c0564e5de1d None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:22.236925 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb211095-d0eb-49d0-acab-1206b52a58b4 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:22.260534 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac6800-8b51-406b-887e-9c0564e5de1d None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:22.279931 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b71e166-a6c5-4a07-8c60-1e28f9412df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:22.281118 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b71e166-a6c5-4a07-8c60-1e28f9412df2 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:22.281888 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b71e166-a6c5-4a07-8c60-1e28f9412df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:22.282325 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b71e166-a6c5-4a07-8c60-1e28f9412df2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:22.293698 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b71e166-a6c5-4a07-8c60-1e28f9412df2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:22.296037 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b71e166-a6c5-4a07-8c60-1e28f9412df2 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:22.298383 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6df447-2c9e-4ac3-ac3f-93f5fd2b9620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:22.299329 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6df447-2c9e-4ac3-ac3f-93f5fd2b9620 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:22.299677 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6df447-2c9e-4ac3-ac3f-93f5fd2b9620 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:22.300019 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6df447-2c9e-4ac3-ac3f-93f5fd2b9620 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:22.307326 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6df447-2c9e-4ac3-ac3f-93f5fd2b9620 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:22.308849 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6df447-2c9e-4ac3-ac3f-93f5fd2b9620 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:22.314005 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-2b71e166-a6c5-4a07-8c60-1e28f9412df2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 17 18:04:22.314005 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:22.314005 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:22.314005 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:22.314005 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:22.314005 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:22.314005 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:22.314005 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:22.314005 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:22.314005 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:22.314005 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:22.314005 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:22.314005 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 18:04:22.314005 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 18:04:22.314005 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 18:04:22.314005 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 18:04:22.314954 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:22.314954 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:22.314954 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 18:04:22.314954 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:04:22.314954 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 18:04:22.314954 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:04:22.314954 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:22.314954 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:22.314954 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:22.314954 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:22.314954 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:22.314954 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:22.314954 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:22.314954 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:22.314954 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:22.314954 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:22.314954 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:22.314954 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:22.315918 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:22.315918 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:22.315918 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 18:04:22.315918 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 18:04:22.315918 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 18:04:22.315918 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 18:04:22.315918 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 18:04:22.315918 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 18:04:22.315918 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 17 18:04:22.315918 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:22.318716 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 331/655] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 17 18:04:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:22.323896 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b71e166-a6c5-4a07-8c60-1e28f9412df2 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:22.326783 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-2f6df447-2c9e-4ac3-ac3f-93f5fd2b9620 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 17 18:04:22.326783 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:22.326783 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:22.326783 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:22.326783 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:22.326783 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:22.326783 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:22.326783 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:22.326783 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:22.326783 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:22.326783 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:22.326783 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:22.326783 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 18:04:22.326783 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 18:04:22.326783 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 18:04:22.326783 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 18:04:22.327776 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:22.327776 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:22.327776 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 18:04:22.327776 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:04:22.327776 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 18:04:22.327776 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:04:22.327776 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:22.327776 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:22.327776 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:22.327776 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:22.327776 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:22.327776 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:22.327776 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:22.327776 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:22.327776 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:22.327776 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:22.327776 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:22.327776 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:22.328733 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:22.328733 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:22.328733 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 18:04:22.328733 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 18:04:22.328733 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 18:04:22.328733 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 18:04:22.328733 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 18:04:22.328733 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 18:04:22.328733 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 17 18:04:22.328733 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:22.328733 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 325/656] 10.222.0.65 () {56 vars in 1102 bytes} [Tue May 17 18:04:22 2022] GET /identity/v3/users/neutron => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:22.329341 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6df447-2c9e-4ac3-ac3f-93f5fd2b9620 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:22.432344 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b71e166-a6c5-4a07-8c60-1e28f9412df2 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:22.448626 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6df447-2c9e-4ac3-ac3f-93f5fd2b9620 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:22.473029 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ba971-998f-457b-9ae1-d45dc060824d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:22.474467 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ba971-998f-457b-9ae1-d45dc060824d None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:22.474467 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ba971-998f-457b-9ae1-d45dc060824d None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:22.474754 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ba971-998f-457b-9ae1-d45dc060824d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:22.489446 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ebf79-c2c4-4add-b306-b3bb30902bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:22.490481 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ebf79-c2c4-4add-b306-b3bb30902bee None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:22.490976 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ebf79-c2c4-4add-b306-b3bb30902bee None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:22.491501 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ebf79-c2c4-4add-b306-b3bb30902bee None admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:22.492552 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ebf79-c2c4-4add-b306-b3bb30902bee None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:22.493177 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ebf79-c2c4-4add-b306-b3bb30902bee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:22.494856 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ebf79-c2c4-4add-b306-b3bb30902bee None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:22.517149 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 326/657] 10.222.0.65 () {56 vars in 1137 bytes} [Tue May 17 18:04:22 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:22.518378 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ebf79-c2c4-4add-b306-b3bb30902bee None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:22.549579 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ba971-998f-457b-9ae1-d45dc060824d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:22.550981 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ba971-998f-457b-9ae1-d45dc060824d None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:22.618775 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ebf79-c2c4-4add-b306-b3bb30902bee None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:22.657250 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a04b4e-40a9-4ba2-99a2-c9c97f4cd1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:22.658371 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a04b4e-40a9-4ba2-99a2-c9c97f4cd1b7 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:22.658894 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a04b4e-40a9-4ba2-99a2-c9c97f4cd1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:22.659392 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a04b4e-40a9-4ba2-99a2-c9c97f4cd1b7 None admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:22.660547 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a04b4e-40a9-4ba2-99a2-c9c97f4cd1b7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:22.661084 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a04b4e-40a9-4ba2-99a2-c9c97f4cd1b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:22.662829 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a04b4e-40a9-4ba2-99a2-c9c97f4cd1b7 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:22.671527 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 332/658] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 17 18:04:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 18:04:22.672674 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ba971-998f-457b-9ae1-d45dc060824d None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:22.691143 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 327/659] 10.222.0.65 () {56 vars in 1139 bytes} [Tue May 17 18:04:22 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:22.691956 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a04b4e-40a9-4ba2-99a2-c9c97f4cd1b7 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:22.793900 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a04b4e-40a9-4ba2-99a2-c9c97f4cd1b7 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:22.798489 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ba971-998f-457b-9ae1-d45dc060824d None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:22.832324 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a542ff-c2d0-4444-8729-6c10a2dd3213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:22.833295 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a542ff-c2d0-4444-8729-6c10a2dd3213 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:22.833620 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a542ff-c2d0-4444-8729-6c10a2dd3213 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:22.834437 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a542ff-c2d0-4444-8729-6c10a2dd3213 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:22.844418 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a542ff-c2d0-4444-8729-6c10a2dd3213 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:22.846000 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a542ff-c2d0-4444-8729-6c10a2dd3213 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:22.847968 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aedb8e5-6367-4a7e-b8a3-02ef9add8da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:22.849155 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aedb8e5-6367-4a7e-b8a3-02ef9add8da5 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:22.849668 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aedb8e5-6367-4a7e-b8a3-02ef9add8da5 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:22.850140 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aedb8e5-6367-4a7e-b8a3-02ef9add8da5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:22.863976 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-89a542ff-c2d0-4444-8729-6c10a2dd3213 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:22.863976 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:22.863976 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:22.863976 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:22.863976 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:22.863976 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:22.863976 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:22.863976 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:22.863976 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:22.863976 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:22.863976 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:22.863976 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:22.863976 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:04:22.863976 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:04:22.863976 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:04:22.865003 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:04:22.865003 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:22.865003 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:22.865003 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:22.865003 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:22.865003 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:22.865003 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:22.865003 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:22.865003 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:22.865003 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:22.865003 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:22.865003 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:22.865003 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:22.865003 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:22.865003 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:22.865003 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:22.865003 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:22.866015 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:04:22.866015 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:04:22.866015 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:22.866015 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:22.866015 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 328/660] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:04:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:22.866015 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a542ff-c2d0-4444-8729-6c10a2dd3213 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:22.927335 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aedb8e5-6367-4a7e-b8a3-02ef9add8da5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:22.928777 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aedb8e5-6367-4a7e-b8a3-02ef9add8da5 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:22.961805 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a542ff-c2d0-4444-8729-6c10a2dd3213 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:22.993943 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d0c26-63a5-4585-959b-aa40c0bb9ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:22.994578 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d0c26-63a5-4585-959b-aa40c0bb9ed8 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:22.994849 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d0c26-63a5-4585-959b-aa40c0bb9ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:22.995115 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d0c26-63a5-4585-959b-aa40c0bb9ed8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:23.025411 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 333/661] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 17 18:04:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 18:04:23.026852 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777f121-0e3d-4ac7-ab56-d7ca59d5388b None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:23.027212 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777f121-0e3d-4ac7-ab56-d7ca59d5388b None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:23.027563 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777f121-0e3d-4ac7-ab56-d7ca59d5388b None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:23.029051 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 334/662] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:04:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:04:23.029916 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0777f121-0e3d-4ac7-ab56-d7ca59d5388b None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:23.075217 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78d0c26-63a5-4585-959b-aa40c0bb9ed8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:23.077230 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78d0c26-63a5-4585-959b-aa40c0bb9ed8 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:23.134161 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0777f121-0e3d-4ac7-ab56-d7ca59d5388b None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:23.169649 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c52cf-351b-4123-8f5e-11a38fcb7a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:23.170856 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c52cf-351b-4123-8f5e-11a38fcb7a7d None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:23.171133 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c52cf-351b-4123-8f5e-11a38fcb7a7d None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:23.171419 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c52cf-351b-4123-8f5e-11a38fcb7a7d None admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:23.172117 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528c52cf-351b-4123-8f5e-11a38fcb7a7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:23.172420 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528c52cf-351b-4123-8f5e-11a38fcb7a7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:23.173858 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528c52cf-351b-4123-8f5e-11a38fcb7a7d None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:23.178897 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 329/663] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 17 18:04:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 18:04:23.178897 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d0c26-63a5-4585-959b-aa40c0bb9ed8 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:23.189564 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 335/664] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:04:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:23.190906 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ac389-bc3a-423b-b0ae-dc549323db2c None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:23.191292 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ac389-bc3a-423b-b0ae-dc549323db2c None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:23.191480 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ac389-bc3a-423b-b0ae-dc549323db2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:23.209435 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-e56ac389-bc3a-423b-b0ae-dc549323db2c None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:23.210648 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-e56ac389-bc3a-423b-b0ae-dc549323db2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:23.285563 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 336/665] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:04:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:04:23.285753 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d0c26-63a5-4585-959b-aa40c0bb9ed8 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:23.285852 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56ac389-bc3a-423b-b0ae-dc549323db2c None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:23.318709 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400576c5-002a-40a9-9905-87b14dac452d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:23.319491 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400576c5-002a-40a9-9905-87b14dac452d None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:23.319771 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400576c5-002a-40a9-9905-87b14dac452d None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:23.320047 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400576c5-002a-40a9-9905-87b14dac452d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:23.331535 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400576c5-002a-40a9-9905-87b14dac452d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:23.333029 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400576c5-002a-40a9-9905-87b14dac452d None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:23.350403 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-400576c5-002a-40a9-9905-87b14dac452d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:23.350403 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:23.350403 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:23.350403 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:23.350403 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:23.350403 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:23.350403 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:23.350403 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:23.350403 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:23.350403 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:23.350403 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:23.350403 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:23.350403 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:04:23.350403 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:04:23.350403 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:04:23.351359 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:04:23.351359 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:23.351359 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:23.351359 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:23.351359 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:23.351359 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:23.351359 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:23.351359 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:23.351359 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:23.351359 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:23.351359 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:23.351359 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:23.351359 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:23.351359 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:23.351359 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:23.351359 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:23.351359 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:23.352254 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:04:23.352254 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:04:23.352254 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:23.352254 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:23.356130 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 330/666] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:04:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:23.356959 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400576c5-002a-40a9-9905-87b14dac452d None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:23.386477 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56ac389-bc3a-423b-b0ae-dc549323db2c None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:23.419763 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94d818-4052-40c5-9819-2a0a24e95b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:23.421083 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94d818-4052-40c5-9819-2a0a24e95b2f None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:23.421367 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94d818-4052-40c5-9819-2a0a24e95b2f None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:23.421673 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94d818-4052-40c5-9819-2a0a24e95b2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:23.432845 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff94d818-4052-40c5-9819-2a0a24e95b2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:23.434376 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff94d818-4052-40c5-9819-2a0a24e95b2f None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:23.452479 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-ff94d818-4052-40c5-9819-2a0a24e95b2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:23.452479 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:23.452479 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:23.452479 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:23.452479 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:23.452479 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:23.452479 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:23.452479 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:23.452479 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:23.452479 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:23.452479 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:23.452479 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:23.452479 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:04:23.452479 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:04:23.452479 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:04:23.453370 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:04:23.453370 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:23.453370 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:23.453370 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:23.453370 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:23.453370 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:23.453370 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:23.453370 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:23.453370 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:23.453370 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:23.453370 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:23.453370 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:23.453370 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:23.453370 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:23.453370 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:23.453370 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:23.453370 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:23.454280 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:04:23.454280 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:04:23.454280 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:23.454280 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:23.454280 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 337/667] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:04:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:23.454566 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94d818-4052-40c5-9819-2a0a24e95b2f None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:23.462869 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400576c5-002a-40a9-9905-87b14dac452d None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:23.496074 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29db819-ed79-4528-bbdb-0bff1698bb11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:23.497136 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29db819-ed79-4528-bbdb-0bff1698bb11 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:23.497641 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29db819-ed79-4528-bbdb-0bff1698bb11 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:23.498136 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29db819-ed79-4528-bbdb-0bff1698bb11 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:23.504707 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29db819-ed79-4528-bbdb-0bff1698bb11 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:23.506171 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29db819-ed79-4528-bbdb-0bff1698bb11 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:23.520201 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-b29db819-ed79-4528-bbdb-0bff1698bb11 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:04:23.520201 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:23.520201 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:23.520201 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:23.520201 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:23.520201 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:23.520201 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:23.520201 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:23.520201 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:23.520201 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:23.520201 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:23.520201 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:23.520201 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 18:04:23.520201 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 18:04:23.520201 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 18:04:23.521091 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 18:04:23.521091 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:23.521091 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:23.521091 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:23.521091 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:23.521091 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:23.521091 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:23.521091 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:23.521091 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:23.521091 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:23.521091 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:23.521091 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:23.521091 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:23.521091 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:23.521091 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:23.521091 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:23.521091 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:23.522099 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 18:04:23.522099 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 18:04:23.522099 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 18:04:23.522099 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 18:04:23.522099 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 18:04:23.522099 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 18:04:23.522099 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:04:23.522099 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:23.522099 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 331/668] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 17 18:04:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:23.523167 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29db819-ed79-4528-bbdb-0bff1698bb11 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:23.552718 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94d818-4052-40c5-9819-2a0a24e95b2f None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:23.586196 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17788a49-6c6e-4e8c-869a-0a9603d8a9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:23.586971 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17788a49-6c6e-4e8c-869a-0a9603d8a9be None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:23.587252 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17788a49-6c6e-4e8c-869a-0a9603d8a9be None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:23.587538 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17788a49-6c6e-4e8c-869a-0a9603d8a9be None admin] PATH_INFO: `/v3/roles/service` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:23.598016 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17788a49-6c6e-4e8c-869a-0a9603d8a9be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:04:23.605734 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-17788a49-6c6e-4e8c-869a-0a9603d8a9be None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 18:04:23.605734 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:23.605734 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:23.605734 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:23.605734 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:23.605734 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:23.605734 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:23.605734 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:23.605734 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:23.605734 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:23.605734 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:23.605734 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:23.605734 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:04:23.605734 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:04:23.605734 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:04:23.605734 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:04:23.606690 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:04:23.606690 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:04:23.606690 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:04:23.606690 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:04:23.606690 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:23.606690 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:23.606690 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:23.606690 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:23.606690 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:23.606690 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:23.606690 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:23.606690 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:23.606690 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:23.606690 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:23.606690 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:23.606690 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:23.607636 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:23.607636 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:23.607636 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:23.607636 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:23.607636 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:04:23.607636 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:04:23.607636 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:04:23.607636 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:04:23.607636 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:04:23.607636 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:04:23.607636 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 18:04:23.607636 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:23.607636 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 338/669] 10.222.0.65 () {56 vars in 1102 bytes} [Tue May 17 18:04:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:23.608366 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17788a49-6c6e-4e8c-869a-0a9603d8a9be None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:23.630604 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29db819-ed79-4528-bbdb-0bff1698bb11 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:23.662771 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb69ca-6162-494f-8e3b-e97c8e1a5859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:23.663768 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb69ca-6162-494f-8e3b-e97c8e1a5859 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:23.664217 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb69ca-6162-494f-8e3b-e97c8e1a5859 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:23.664650 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb69ca-6162-494f-8e3b-e97c8e1a5859 None admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:23.665553 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb69ca-6162-494f-8e3b-e97c8e1a5859 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:23.666003 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb69ca-6162-494f-8e3b-e97c8e1a5859 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:23.667520 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bb69ca-6162-494f-8e3b-e97c8e1a5859 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:23.680029 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 332/670] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:04:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:23.681024 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb69ca-6162-494f-8e3b-e97c8e1a5859 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:23.708419 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17788a49-6c6e-4e8c-869a-0a9603d8a9be None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:23.741543 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01867ed-38b8-40b7-a086-e2230ed6eff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:23.742203 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01867ed-38b8-40b7-a086-e2230ed6eff7 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:23.742478 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01867ed-38b8-40b7-a086-e2230ed6eff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:23.742746 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01867ed-38b8-40b7-a086-e2230ed6eff7 None admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:23.743457 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01867ed-38b8-40b7-a086-e2230ed6eff7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:23.743752 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01867ed-38b8-40b7-a086-e2230ed6eff7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:23.745115 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01867ed-38b8-40b7-a086-e2230ed6eff7 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:23.757315 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 339/671] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:04:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:23.758158 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01867ed-38b8-40b7-a086-e2230ed6eff7 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:23.786320 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bb69ca-6162-494f-8e3b-e97c8e1a5859 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:23.819493 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba293116-858b-453d-a55b-3899253bf36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:23.820124 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba293116-858b-453d-a55b-3899253bf36e None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:23.820332 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba293116-858b-453d-a55b-3899253bf36e None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:23.820601 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba293116-858b-453d-a55b-3899253bf36e None admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:23.821375 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba293116-858b-453d-a55b-3899253bf36e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:23.821707 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba293116-858b-453d-a55b-3899253bf36e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:23.823134 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba293116-858b-453d-a55b-3899253bf36e None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:23.834894 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 333/672] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 17 18:04:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:23.835506 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba293116-858b-453d-a55b-3899253bf36e None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:23.863943 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01867ed-38b8-40b7-a086-e2230ed6eff7 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:23.898145 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31344f7c-6909-4f97-8dd0-43f9a814293b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:23.899183 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31344f7c-6909-4f97-8dd0-43f9a814293b None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:23.899669 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31344f7c-6909-4f97-8dd0-43f9a814293b None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:23.900162 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31344f7c-6909-4f97-8dd0-43f9a814293b None admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:23.901095 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31344f7c-6909-4f97-8dd0-43f9a814293b None admin] RBAC: Adding query filter params (name=service) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:23.901628 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31344f7c-6909-4f97-8dd0-43f9a814293b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:23.903184 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31344f7c-6909-4f97-8dd0-43f9a814293b None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:23.911936 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 340/673] 10.222.0.65 () {56 vars in 1103 bytes} [Tue May 17 18:04:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:23.912987 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31344f7c-6909-4f97-8dd0-43f9a814293b None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:23.937001 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba293116-858b-453d-a55b-3899253bf36e None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:23.972051 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192281ee-f2b2-4d41-bfa6-54f451dd4bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:23.972834 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192281ee-f2b2-4d41-bfa6-54f451dd4bed None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:23.973108 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192281ee-f2b2-4d41-bfa6-54f451dd4bed None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:23.973378 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192281ee-f2b2-4d41-bfa6-54f451dd4bed None admin] PATH_INFO: `/v3/projects/service` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:23.979865 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192281ee-f2b2-4d41-bfa6-54f451dd4bed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:23.981303 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192281ee-f2b2-4d41-bfa6-54f451dd4bed None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:23.995482 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-192281ee-f2b2-4d41-bfa6-54f451dd4bed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:04:23.995482 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:23.995482 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:23.995482 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:23.995482 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:23.995482 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:23.995482 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:23.995482 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:23.995482 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:23.995482 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:23.995482 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:23.995482 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:23.995482 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 18:04:23.995482 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 18:04:23.995482 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 18:04:23.996373 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 18:04:23.996373 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:23.996373 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:23.996373 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:23.996373 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:23.996373 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:23.996373 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:23.996373 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:23.996373 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:23.996373 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:23.996373 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:23.996373 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:23.996373 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:23.996373 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:23.996373 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:23.996373 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:23.996373 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:23.997261 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 18:04:23.997261 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 18:04:23.997261 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 18:04:23.997261 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 18:04:23.997261 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 18:04:23.997261 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 18:04:23.997261 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:04:23.997261 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:23.997261 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 334/674] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 17 18:04:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:23.997812 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192281ee-f2b2-4d41-bfa6-54f451dd4bed None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:24.016000 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31344f7c-6909-4f97-8dd0-43f9a814293b None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:24.050529 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee29d9a2-124d-44c5-87f6-b874d67aeaf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:24.051427 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29d9a2-124d-44c5-87f6-b874d67aeaf7 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:24.051776 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29d9a2-124d-44c5-87f6-b874d67aeaf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:24.052061 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29d9a2-124d-44c5-87f6-b874d67aeaf7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:24.058537 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee29d9a2-124d-44c5-87f6-b874d67aeaf7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:24.060084 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee29d9a2-124d-44c5-87f6-b874d67aeaf7 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:24.074229 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-ee29d9a2-124d-44c5-87f6-b874d67aeaf7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:04:24.074229 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:24.074229 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:24.074229 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:24.074229 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:24.074229 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:24.074229 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:24.074229 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:24.074229 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:24.074229 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:24.074229 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:24.074229 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:24.074229 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 18:04:24.074229 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 18:04:24.074229 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 18:04:24.075289 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 18:04:24.075289 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:24.075289 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:24.075289 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:24.075289 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:24.075289 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:24.075289 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:24.075289 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:24.075289 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:24.075289 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:24.075289 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:24.075289 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:24.075289 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:24.075289 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:24.075289 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:24.075289 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:24.075289 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:24.076402 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 18:04:24.076402 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 18:04:24.076402 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 18:04:24.076402 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 18:04:24.076402 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 18:04:24.076402 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 18:04:24.076402 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:04:24.076402 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:24.080054 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 341/675] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 17 18:04:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:24.080876 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee29d9a2-124d-44c5-87f6-b874d67aeaf7 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:24.095886 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192281ee-f2b2-4d41-bfa6-54f451dd4bed None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:24.130783 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16caa0fa-04f7-49fb-be89-477af98d22f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:24.131450 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16caa0fa-04f7-49fb-be89-477af98d22f2 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:24.131723 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16caa0fa-04f7-49fb-be89-477af98d22f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:24.131993 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16caa0fa-04f7-49fb-be89-477af98d22f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:24.133023 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16caa0fa-04f7-49fb-be89-477af98d22f2 None admin] RBAC: Adding query filter params (role.id=60e39e2185d346a192b8698767df6018, scope.project.id=0cf165918c1f46cb96d4b54409862659, user.id=ce570634a66b45158d940151828f533a) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:24.133142 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16caa0fa-04f7-49fb-be89-477af98d22f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:24.134653 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16caa0fa-04f7-49fb-be89-477af98d22f2 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:24.149780 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 335/676] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 17 18:04:23 2022] GET /identity/v3/role_assignments?user.id=ce570634a66b45158d940151828f533a&scope.project.id=0cf165918c1f46cb96d4b54409862659&role.id=60e39e2185d346a192b8698767df6018 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:24.149780 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16caa0fa-04f7-49fb-be89-477af98d22f2 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:24.195758 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee29d9a2-124d-44c5-87f6-b874d67aeaf7 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:24.235342 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3165f26-bfc7-4c87-8d77-7c00bf37aefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:24.236571 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3165f26-bfc7-4c87-8d77-7c00bf37aefa None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:24.237085 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3165f26-bfc7-4c87-8d77-7c00bf37aefa None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:24.237717 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3165f26-bfc7-4c87-8d77-7c00bf37aefa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:24.250302 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3165f26-bfc7-4c87-8d77-7c00bf37aefa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:24.251941 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3165f26-bfc7-4c87-8d77-7c00bf37aefa None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:24.274267 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-e3165f26-bfc7-4c87-8d77-7c00bf37aefa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:24.274267 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:24.274267 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:24.274267 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:24.274267 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:24.274267 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:24.274267 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:24.274267 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:24.274267 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:24.274267 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:24.274267 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:24.274267 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:24.274267 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:04:24.274267 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:04:24.274267 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:04:24.275552 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:04:24.275552 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:24.275552 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:24.275552 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:24.275552 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:24.275552 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:24.275552 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:24.275552 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:24.275552 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:24.275552 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:24.275552 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:24.275552 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:24.275552 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:24.275552 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:24.275552 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:24.275552 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:24.275552 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:24.276434 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:04:24.276434 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:04:24.276434 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:24.276434 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:24.276434 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 342/677] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:04:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:24.277344 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3165f26-bfc7-4c87-8d77-7c00bf37aefa None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:24.285978 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16caa0fa-04f7-49fb-be89-477af98d22f2 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:24.330115 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22532ccd-b282-49c1-95b7-89052466a28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:24.331574 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22532ccd-b282-49c1-95b7-89052466a28b None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:24.331853 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22532ccd-b282-49c1-95b7-89052466a28b None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:24.332128 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22532ccd-b282-49c1-95b7-89052466a28b None admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:24.332923 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22532ccd-b282-49c1-95b7-89052466a28b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:24.333232 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22532ccd-b282-49c1-95b7-89052466a28b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:24.334708 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22532ccd-b282-49c1-95b7-89052466a28b None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:24.350836 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 336/678] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 17 18:04:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:24.351723 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22532ccd-b282-49c1-95b7-89052466a28b None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:24.399850 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3165f26-bfc7-4c87-8d77-7c00bf37aefa None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:24.435795 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e30ce21-34bf-4bb6-9374-d5604ddc41f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:24.436453 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e30ce21-34bf-4bb6-9374-d5604ddc41f9 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:24.436762 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e30ce21-34bf-4bb6-9374-d5604ddc41f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:24.437054 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e30ce21-34bf-4bb6-9374-d5604ddc41f9 None admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:24.437938 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e30ce21-34bf-4bb6-9374-d5604ddc41f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:24.438323 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e30ce21-34bf-4bb6-9374-d5604ddc41f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:24.439758 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e30ce21-34bf-4bb6-9374-d5604ddc41f9 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:24.453434 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 343/679] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 17 18:04:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:24.455054 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfabf871-fc01-432c-b701-715c95052702 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:24.455349 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfabf871-fc01-432c-b701-715c95052702 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:24.455629 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfabf871-fc01-432c-b701-715c95052702 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:24.457067 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 344/680] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:04:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:04:24.461607 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfabf871-fc01-432c-b701-715c95052702 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:24.466161 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22532ccd-b282-49c1-95b7-89052466a28b None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:24.499215 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2626661-51ae-4204-a3f9-1313982cdc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:24.499865 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2626661-51ae-4204-a3f9-1313982cdc14 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:24.500140 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2626661-51ae-4204-a3f9-1313982cdc14 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:24.500410 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2626661-51ae-4204-a3f9-1313982cdc14 None admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:24.501125 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2626661-51ae-4204-a3f9-1313982cdc14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:24.501420 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2626661-51ae-4204-a3f9-1313982cdc14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:24.502803 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2626661-51ae-4204-a3f9-1313982cdc14 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:24.514673 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 337/681] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:04:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:24.515373 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2626661-51ae-4204-a3f9-1313982cdc14 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:24.568799 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfabf871-fc01-432c-b701-715c95052702 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:24.601985 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e20102-6ac4-41df-bf7c-dcf4606a489f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:24.602952 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e20102-6ac4-41df-bf7c-dcf4606a489f None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:24.603450 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e20102-6ac4-41df-bf7c-dcf4606a489f None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:24.603791 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e20102-6ac4-41df-bf7c-dcf4606a489f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:24.604679 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e20102-6ac4-41df-bf7c-dcf4606a489f None admin] RBAC: Adding query filter params (role.id=60e39e2185d346a192b8698767df6018, scope.project.id=0cf165918c1f46cb96d4b54409862659, user.id=769f675c28e34902a079c70dab44dbf8) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:24.604995 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e20102-6ac4-41df-bf7c-dcf4606a489f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:24.606438 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e20102-6ac4-41df-bf7c-dcf4606a489f None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:24.611990 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2626661-51ae-4204-a3f9-1313982cdc14 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:24.613791 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 345/682] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 17 18:04:24 2022] GET /identity/v3/role_assignments?user.id=769f675c28e34902a079c70dab44dbf8&scope.project.id=0cf165918c1f46cb96d4b54409862659&role.id=60e39e2185d346a192b8698767df6018 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:24.616144 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb5ebe-4273-4cdb-8e23-638534ad9833 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:24.616684 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb5ebe-4273-4cdb-8e23-638534ad9833 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:24.617165 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb5ebe-4273-4cdb-8e23-638534ad9833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:24.642488 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-06fb5ebe-4273-4cdb-8e23-638534ad9833 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:24.644756 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-06fb5ebe-4273-4cdb-8e23-638534ad9833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:24.655274 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e7d381-f023-434d-8559-1e503e6f4de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:24.656328 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7d381-f023-434d-8559-1e503e6f4de3 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:24.656783 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7d381-f023-434d-8559-1e503e6f4de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:24.657680 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7d381-f023-434d-8559-1e503e6f4de3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:24.659080 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e7d381-f023-434d-8559-1e503e6f4de3 None admin] RBAC: Adding query filter params (role.id=60e39e2185d346a192b8698767df6018, scope.project.id=0cf165918c1f46cb96d4b54409862659, user.id=83430939ae474ad6bab37dfb6fc8da78) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:24.659902 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e7d381-f023-434d-8559-1e503e6f4de3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:24.661760 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e7d381-f023-434d-8559-1e503e6f4de3 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:24.677502 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 338/683] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 17 18:04:24 2022] GET /identity/v3/role_assignments?user.id=83430939ae474ad6bab37dfb6fc8da78&scope.project.id=0cf165918c1f46cb96d4b54409862659&role.id=60e39e2185d346a192b8698767df6018 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:24.677502 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e7d381-f023-434d-8559-1e503e6f4de3 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:24.783271 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 346/684] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:04:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:04:24.822316 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb5ebe-4273-4cdb-8e23-638534ad9833 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:24.861554 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e7d381-f023-434d-8559-1e503e6f4de3 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:24.908716 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dffc1d7-1992-47fe-a7ce-063637c33534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:24.909543 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dffc1d7-1992-47fe-a7ce-063637c33534 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:24.909819 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dffc1d7-1992-47fe-a7ce-063637c33534 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:24.910087 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dffc1d7-1992-47fe-a7ce-063637c33534 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:24.921934 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dffc1d7-1992-47fe-a7ce-063637c33534 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:24.923393 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dffc1d7-1992-47fe-a7ce-063637c33534 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:24.940514 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-4dffc1d7-1992-47fe-a7ce-063637c33534 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 17 18:04:24.940514 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:24.940514 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:24.940514 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:24.940514 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:24.940514 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:24.940514 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:24.940514 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:24.940514 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:24.940514 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:24.940514 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:24.940514 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:24.940514 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 18:04:24.940514 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 18:04:24.940514 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 18:04:24.940514 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 18:04:24.941528 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:24.941528 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:24.941528 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 18:04:24.941528 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:04:24.941528 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 18:04:24.941528 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:04:24.941528 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:24.941528 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:24.941528 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:24.941528 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:24.941528 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:24.941528 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:24.941528 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:24.941528 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:24.941528 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:24.941528 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:24.941528 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:24.941528 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:24.942760 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:24.942760 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:24.942760 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 18:04:24.942760 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 18:04:24.942760 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 18:04:24.942760 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 18:04:24.942760 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 18:04:24.942760 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 18:04:24.942760 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 17 18:04:24.942760 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:24.942760 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 339/685] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 17 18:04:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:24.948263 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb5ebe-4273-4cdb-8e23-638534ad9833 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:24.949812 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dffc1d7-1992-47fe-a7ce-063637c33534 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:25.000921 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c167543b-97d0-4538-9b28-314259614b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:25.002142 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167543b-97d0-4538-9b28-314259614b71 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:25.002773 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167543b-97d0-4538-9b28-314259614b71 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:25.003001 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167543b-97d0-4538-9b28-314259614b71 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:25.018818 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c167543b-97d0-4538-9b28-314259614b71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:04:25.027241 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-c167543b-97d0-4538-9b28-314259614b71 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:04:25.027241 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:25.027241 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:25.027241 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:25.027241 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:25.027241 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:25.027241 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:25.027241 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:25.027241 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:25.027241 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:25.027241 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:25.027241 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:25.027241 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:04:25.027241 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:04:25.027241 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:04:25.027241 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:04:25.028149 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:04:25.028149 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:04:25.028149 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:04:25.028149 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:04:25.028149 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:25.028149 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:25.028149 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:25.028149 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:25.028149 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:25.028149 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:25.028149 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:25.028149 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:25.028149 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:25.028149 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:25.028149 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:25.028149 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:25.028984 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:25.028984 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:25.028984 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:25.028984 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:25.028984 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:04:25.028984 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:04:25.028984 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:04:25.028984 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:04:25.028984 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:04:25.028984 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:04:25.028984 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:04:25.028984 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:25.028984 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 347/686] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 17 18:04:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:04:25.034545 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c167543b-97d0-4538-9b28-314259614b71 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:25.090621 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dffc1d7-1992-47fe-a7ce-063637c33534 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:25.155919 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65096e83-7c52-46f5-929b-65cf612a6936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:25.156590 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65096e83-7c52-46f5-929b-65cf612a6936 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:25.156865 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65096e83-7c52-46f5-929b-65cf612a6936 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:25.157141 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65096e83-7c52-46f5-929b-65cf612a6936 None admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:25.160321 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65096e83-7c52-46f5-929b-65cf612a6936 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:25.160639 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65096e83-7c52-46f5-929b-65cf612a6936 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:25.162106 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65096e83-7c52-46f5-929b-65cf612a6936 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:25.199600 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 340/687] 10.222.0.65 () {56 vars in 1135 bytes} [Tue May 17 18:04:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:25.203283 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65096e83-7c52-46f5-929b-65cf612a6936 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:25.228047 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c167543b-97d0-4538-9b28-314259614b71 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:25.311372 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65096e83-7c52-46f5-929b-65cf612a6936 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:25.315474 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966fb4b-4a20-400f-b24f-58f1008d7b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:25.316156 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966fb4b-4a20-400f-b24f-58f1008d7b6f None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:25.316439 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966fb4b-4a20-400f-b24f-58f1008d7b6f None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:25.316714 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966fb4b-4a20-400f-b24f-58f1008d7b6f None admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:25.317755 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8966fb4b-4a20-400f-b24f-58f1008d7b6f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:25.318062 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8966fb4b-4a20-400f-b24f-58f1008d7b6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:25.319439 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8966fb4b-4a20-400f-b24f-58f1008d7b6f None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:25.339959 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 348/688] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 17 18:04:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:04:25.345524 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966fb4b-4a20-400f-b24f-58f1008d7b6f None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:25.347678 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36559049-1e41-4eca-9958-f0c2c3be25d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:25.348333 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36559049-1e41-4eca-9958-f0c2c3be25d2 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:25.348606 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36559049-1e41-4eca-9958-f0c2c3be25d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:25.348873 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36559049-1e41-4eca-9958-f0c2c3be25d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:25.450512 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36559049-1e41-4eca-9958-f0c2c3be25d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:25.451985 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36559049-1e41-4eca-9958-f0c2c3be25d2 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:25.555628 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966fb4b-4a20-400f-b24f-58f1008d7b6f None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:25.564194 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 341/689] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 17 18:04:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 18:04:25.574604 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36559049-1e41-4eca-9958-f0c2c3be25d2 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:25.595733 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a9b44-dafe-47af-a565-32f887f5d120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:25.596578 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a9b44-dafe-47af-a565-32f887f5d120 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:25.596857 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a9b44-dafe-47af-a565-32f887f5d120 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:25.597130 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a9b44-dafe-47af-a565-32f887f5d120 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:25.608543 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37a9b44-dafe-47af-a565-32f887f5d120 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:25.610438 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37a9b44-dafe-47af-a565-32f887f5d120 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:25.630488 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-d37a9b44-dafe-47af-a565-32f887f5d120 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:25.630488 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:25.630488 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:25.630488 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:25.630488 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:25.630488 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:25.630488 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:25.630488 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:25.630488 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:25.630488 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:25.630488 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:25.630488 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:25.630488 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:04:25.630488 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:04:25.630488 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:04:25.631416 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:04:25.631416 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:25.631416 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:25.631416 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:25.631416 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:25.631416 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:25.631416 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:25.631416 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:25.631416 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:25.631416 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:25.631416 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:25.631416 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:25.631416 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:25.631416 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:25.631416 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:25.631416 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:25.631416 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:25.632304 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:04:25.632304 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:04:25.632304 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:25.632304 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:25.632942 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 349/690] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:04:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:04:25.637692 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a9b44-dafe-47af-a565-32f887f5d120 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:25.771203 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36559049-1e41-4eca-9958-f0c2c3be25d2 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:25.801782 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a9b44-dafe-47af-a565-32f887f5d120 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:25.838486 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc62ae-f43c-4469-aead-986c337dbbbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:25.839225 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc62ae-f43c-4469-aead-986c337dbbbe None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:25.839553 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc62ae-f43c-4469-aead-986c337dbbbe None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:25.839831 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc62ae-f43c-4469-aead-986c337dbbbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:25.859074 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbc62ae-f43c-4469-aead-986c337dbbbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:25.860518 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbc62ae-f43c-4469-aead-986c337dbbbe None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:25.883018 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793de86-2758-4941-a592-cbdf78cdcca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:25.884007 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793de86-2758-4941-a592-cbdf78cdcca1 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:25.884499 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793de86-2758-4941-a592-cbdf78cdcca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:25.884974 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793de86-2758-4941-a592-cbdf78cdcca1 None admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:25.885934 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f793de86-2758-4941-a592-cbdf78cdcca1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:25.886460 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f793de86-2758-4941-a592-cbdf78cdcca1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:25.888022 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f793de86-2758-4941-a592-cbdf78cdcca1 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:25.891989 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-3dbc62ae-f43c-4469-aead-986c337dbbbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:25.891989 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:25.891989 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:25.891989 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:25.891989 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:25.891989 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:25.891989 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:25.891989 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:25.891989 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:25.891989 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:25.891989 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:25.891989 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:25.891989 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:04:25.891989 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:04:25.891989 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:04:25.893188 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:04:25.893188 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:25.893188 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:25.893188 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:25.893188 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:25.893188 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:25.893188 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:25.893188 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:25.893188 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:25.893188 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:25.893188 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:25.893188 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:25.893188 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:25.893188 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:25.893188 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:25.893188 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:25.893188 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:25.894108 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:04:25.894108 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:04:25.894108 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:25.894108 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:25.897201 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 342/691] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:04:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:25.903057 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc62ae-f43c-4469-aead-986c337dbbbe None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:25.919273 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 350/692] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:04:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:25.925021 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793de86-2758-4941-a592-cbdf78cdcca1 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:26.013478 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc62ae-f43c-4469-aead-986c337dbbbe None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:26.052440 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3696cd1-1f23-46f7-a9cf-0d86bf4442f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:26.053497 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3696cd1-1f23-46f7-a9cf-0d86bf4442f1 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:26.053985 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3696cd1-1f23-46f7-a9cf-0d86bf4442f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:26.054459 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3696cd1-1f23-46f7-a9cf-0d86bf4442f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:26.055406 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3696cd1-1f23-46f7-a9cf-0d86bf4442f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:26.055953 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3696cd1-1f23-46f7-a9cf-0d86bf4442f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:26.057619 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3696cd1-1f23-46f7-a9cf-0d86bf4442f1 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:26.072550 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 343/693] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:04:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:26.077841 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3696cd1-1f23-46f7-a9cf-0d86bf4442f1 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:26.183703 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793de86-2758-4941-a592-cbdf78cdcca1 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:26.196938 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3696cd1-1f23-46f7-a9cf-0d86bf4442f1 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:26.253473 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd656ac-d80e-4e32-ab1a-6a6c0b1bfe1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:26.254273 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd656ac-d80e-4e32-ab1a-6a6c0b1bfe1b None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:26.254556 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd656ac-d80e-4e32-ab1a-6a6c0b1bfe1b None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:26.254832 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd656ac-d80e-4e32-ab1a-6a6c0b1bfe1b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:26.259120 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece98981-be25-4bb6-ac3d-71382f089de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:26.259908 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece98981-be25-4bb6-ac3d-71382f089de5 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:26.260187 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece98981-be25-4bb6-ac3d-71382f089de5 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:26.260459 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece98981-be25-4bb6-ac3d-71382f089de5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:26.271490 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd656ac-d80e-4e32-ab1a-6a6c0b1bfe1b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:26.272972 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd656ac-d80e-4e32-ab1a-6a6c0b1bfe1b None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:26.274574 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece98981-be25-4bb6-ac3d-71382f089de5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:26.275993 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece98981-be25-4bb6-ac3d-71382f089de5 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:26.297090 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-cbd656ac-d80e-4e32-ab1a-6a6c0b1bfe1b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 17 18:04:26.297090 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:26.297090 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:26.297090 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:26.297090 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:26.297090 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:26.297090 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:26.297090 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:26.297090 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:26.297090 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:26.297090 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:26.297090 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:26.297090 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 18:04:26.297090 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 18:04:26.297090 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 18:04:26.297090 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 18:04:26.298148 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:26.298148 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:26.298148 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 18:04:26.298148 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:04:26.298148 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 18:04:26.298148 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:04:26.298148 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:26.298148 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:26.298148 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:26.298148 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:26.298148 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:26.298148 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:26.298148 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:26.298148 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:26.298148 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:26.298148 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:26.298148 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:26.298148 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:26.299082 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:26.299082 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:26.299082 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 18:04:26.299082 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 18:04:26.299082 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 18:04:26.299082 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 18:04:26.299082 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 18:04:26.299082 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 18:04:26.299082 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 17 18:04:26.299082 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:26.299082 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 351/694] 10.222.0.65 () {56 vars in 1093 bytes} [Tue May 17 18:04:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:04:26.311675 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-ece98981-be25-4bb6-ac3d-71382f089de5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:04:26.311675 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:26.311675 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:26.311675 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:26.311675 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:26.311675 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:26.311675 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:26.311675 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:26.311675 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:26.311675 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:26.311675 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:26.311675 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:26.311675 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 18:04:26.311675 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 18:04:26.311675 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 18:04:26.313915 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 18:04:26.313915 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:26.313915 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:26.313915 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:26.313915 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:26.313915 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:26.313915 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:26.313915 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:26.313915 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:26.313915 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:26.313915 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:26.313915 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:26.313915 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:26.313915 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:26.313915 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:26.313915 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:26.313915 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:26.316119 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 18:04:26.316119 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 18:04:26.316119 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 18:04:26.316119 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 18:04:26.316119 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 18:04:26.316119 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 18:04:26.316119 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:04:26.316119 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:26.316119 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 344/695] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 17 18:04:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:26.318632 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd656ac-d80e-4e32-ab1a-6a6c0b1bfe1b None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:26.319834 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece98981-be25-4bb6-ac3d-71382f089de5 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:26.462048 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd656ac-d80e-4e32-ab1a-6a6c0b1bfe1b None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:26.492530 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece98981-be25-4bb6-ac3d-71382f089de5 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:26.524244 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cda930-c68e-48b0-b379-26304ca57b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:26.526287 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cda930-c68e-48b0-b379-26304ca57b04 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:26.529090 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cda930-c68e-48b0-b379-26304ca57b04 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:26.530167 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cda930-c68e-48b0-b379-26304ca57b04 None admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:26.531252 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cda930-c68e-48b0-b379-26304ca57b04 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:26.532529 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cda930-c68e-48b0-b379-26304ca57b04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:26.534213 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cda930-c68e-48b0-b379-26304ca57b04 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:26.559424 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce56203-e4e2-443a-976a-23188f83096d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:26.560463 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce56203-e4e2-443a-976a-23188f83096d None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:26.560963 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce56203-e4e2-443a-976a-23188f83096d None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:26.561438 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce56203-e4e2-443a-976a-23188f83096d None admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:26.562482 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce56203-e4e2-443a-976a-23188f83096d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:26.562982 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce56203-e4e2-443a-976a-23188f83096d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:26.564617 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce56203-e4e2-443a-976a-23188f83096d None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:26.564824 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 352/696] 10.222.0.65 () {56 vars in 1133 bytes} [Tue May 17 18:04:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:26.571027 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cda930-c68e-48b0-b379-26304ca57b04 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:26.585659 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 345/697] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 17 18:04:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:26.587862 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce56203-e4e2-443a-976a-23188f83096d None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:26.721870 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cda930-c68e-48b0-b379-26304ca57b04 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:26.753112 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce56203-e4e2-443a-976a-23188f83096d None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:26.755762 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d065ec-25b5-4463-b350-051781e7d8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:26.756654 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d065ec-25b5-4463-b350-051781e7d8c1 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:26.757131 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d065ec-25b5-4463-b350-051781e7d8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:26.757635 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d065ec-25b5-4463-b350-051781e7d8c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:26.794508 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f377344-9293-49fc-87cb-4ec81519be26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:26.795200 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f377344-9293-49fc-87cb-4ec81519be26 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:26.795518 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f377344-9293-49fc-87cb-4ec81519be26 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:26.795792 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f377344-9293-49fc-87cb-4ec81519be26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:26.796642 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f377344-9293-49fc-87cb-4ec81519be26 None admin] RBAC: Adding query filter params (role.id=60e39e2185d346a192b8698767df6018, scope.project.id=0cf165918c1f46cb96d4b54409862659, user.id=1464e84a3a2d4321a98b98d398bc7be3) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:26.796950 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f377344-9293-49fc-87cb-4ec81519be26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:26.798437 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f377344-9293-49fc-87cb-4ec81519be26 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:26.810342 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 346/698] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 17 18:04:26 2022] GET /identity/v3/role_assignments?user.id=1464e84a3a2d4321a98b98d398bc7be3&scope.project.id=0cf165918c1f46cb96d4b54409862659&role.id=60e39e2185d346a192b8698767df6018 => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:26.810342 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5fd4f6-85fe-4870-9411-dfaef9e3afc7 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:26.810342 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5fd4f6-85fe-4870-9411-dfaef9e3afc7 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:26.810342 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5fd4f6-85fe-4870-9411-dfaef9e3afc7 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:26.810342 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 347/699] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:04:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:04:26.819273 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd59ca-dad6-41a0-ada2-b4276d311a7f None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:26.819453 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd59ca-dad6-41a0-ada2-b4276d311a7f None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:26.819736 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd59ca-dad6-41a0-ada2-b4276d311a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:26.837701 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-29bd59ca-dad6-41a0-ada2-b4276d311a7f None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:26.838916 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-29bd59ca-dad6-41a0-ada2-b4276d311a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:26.881586 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d065ec-25b5-4463-b350-051781e7d8c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:26.883082 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d065ec-25b5-4463-b350-051781e7d8c1 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:26.961594 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 348/700] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:04:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:04:27.008292 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 353/701] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 17 18:04:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 17 18:04:27.014028 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd59ca-dad6-41a0-ada2-b4276d311a7f None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:27.023438 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d065ec-25b5-4463-b350-051781e7d8c1 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:27.123215 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd59ca-dad6-41a0-ada2-b4276d311a7f None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:27.129077 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d065ec-25b5-4463-b350-051781e7d8c1 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:27.162807 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb2833-941c-4670-b2a8-99fe65db47b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:27.163603 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb2833-941c-4670-b2a8-99fe65db47b2 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:27.163878 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb2833-941c-4670-b2a8-99fe65db47b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:27.163983 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b3711d-e2cb-4a2b-9b43-3ea3a1338e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:27.164194 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adb2833-941c-4670-b2a8-99fe65db47b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:27.164803 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3711d-e2cb-4a2b-9b43-3ea3a1338e6f None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:27.165086 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3711d-e2cb-4a2b-9b43-3ea3a1338e6f None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:27.165357 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b3711d-e2cb-4a2b-9b43-3ea3a1338e6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:27.175232 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adb2833-941c-4670-b2a8-99fe65db47b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:27.176624 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b3711d-e2cb-4a2b-9b43-3ea3a1338e6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:27.176738 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adb2833-941c-4670-b2a8-99fe65db47b2 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:27.178906 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b3711d-e2cb-4a2b-9b43-3ea3a1338e6f None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:27.195443 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-7adb2833-941c-4670-b2a8-99fe65db47b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:27.195443 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:27.195443 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:27.195443 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:27.195443 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:27.195443 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:27.195443 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:27.195443 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:27.195443 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:27.195443 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:27.195443 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:27.195443 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:27.195443 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:04:27.195443 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:04:27.195443 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:04:27.196389 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:04:27.196389 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:27.196389 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:27.196389 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:27.196389 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:27.196389 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:27.196389 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:27.196389 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:27.196389 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:27.196389 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:27.196389 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:27.196389 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:27.196389 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:27.196389 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:27.196389 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:27.196389 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:27.196389 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:27.197276 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:04:27.197276 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:04:27.197276 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:27.197276 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:27.198846 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-78b3711d-e2cb-4a2b-9b43-3ea3a1338e6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:27.198846 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:27.198846 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:27.198846 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:27.198846 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:27.198846 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:27.198846 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:27.198846 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:27.198846 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:27.198846 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:27.198846 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:27.198846 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:27.198846 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:04:27.198846 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:04:27.198846 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:04:27.201941 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:04:27.201941 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:27.201941 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:27.201941 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:27.201941 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:27.201941 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:27.201941 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:27.201941 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:27.201941 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:27.201941 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:27.201941 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:27.201941 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:27.201941 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:27.201941 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:27.201941 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:27.201941 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:27.201941 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:27.204048 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:04:27.204048 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:04:27.204048 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:27.204048 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:27.204048 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 354/702] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:04:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:04:27.204699 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 349/703] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:04:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:27.209611 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b3711d-e2cb-4a2b-9b43-3ea3a1338e6f None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:27.209821 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb2833-941c-4670-b2a8-99fe65db47b2 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:27.319425 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adb2833-941c-4670-b2a8-99fe65db47b2 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:27.320485 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b3711d-e2cb-4a2b-9b43-3ea3a1338e6f None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:27.361322 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeafc5ec-be48-43c9-b71c-d521f0638adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:27.362017 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafc5ec-be48-43c9-b71c-d521f0638adb None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:27.362297 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafc5ec-be48-43c9-b71c-d521f0638adb None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:27.362569 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafc5ec-be48-43c9-b71c-d521f0638adb None admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:27.363287 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeafc5ec-be48-43c9-b71c-d521f0638adb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:27.363594 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeafc5ec-be48-43c9-b71c-d521f0638adb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:27.364360 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fc8eff-63d7-4527-9d65-437f929f5b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:27.364967 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeafc5ec-be48-43c9-b71c-d521f0638adb None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:27.365141 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc8eff-63d7-4527-9d65-437f929f5b7f None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:27.365309 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc8eff-63d7-4527-9d65-437f929f5b7f None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:27.365561 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fc8eff-63d7-4527-9d65-437f929f5b7f None admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:27.366282 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fc8eff-63d7-4527-9d65-437f929f5b7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:27.366584 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fc8eff-63d7-4527-9d65-437f929f5b7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:27.367943 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fc8eff-63d7-4527-9d65-437f929f5b7f None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:27.377630 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 350/704] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:04:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:27.378948 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e6fc2c-6ed3-466b-82c2-cf35dea88645 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:27.379232 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e6fc2c-6ed3-466b-82c2-cf35dea88645 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:27.379508 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e6fc2c-6ed3-466b-82c2-cf35dea88645 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:27.380599 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 355/705] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:04:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:27.380991 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 351/706] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:04:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:04:27.385785 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fc8eff-63d7-4527-9d65-437f929f5b7f None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:27.386272 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e111b3f-ae5f-42d7-8d7a-144f5e7e26a4 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:27.386622 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e111b3f-ae5f-42d7-8d7a-144f5e7e26a4 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:27.386830 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e111b3f-ae5f-42d7-8d7a-144f5e7e26a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:27.404083 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-0e111b3f-ae5f-42d7-8d7a-144f5e7e26a4 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:27.405273 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-0e111b3f-ae5f-42d7-8d7a-144f5e7e26a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:27.481487 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 352/707] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:04:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 18:04:27.481487 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e111b3f-ae5f-42d7-8d7a-144f5e7e26a4 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:27.500924 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fc8eff-63d7-4527-9d65-437f929f5b7f None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:27.533316 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95932ceb-a829-4a06-b167-59211de642fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:27.534011 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95932ceb-a829-4a06-b167-59211de642fe None admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:27.534294 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95932ceb-a829-4a06-b167-59211de642fe None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:27.534570 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95932ceb-a829-4a06-b167-59211de642fe None admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:27.535268 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95932ceb-a829-4a06-b167-59211de642fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:27.536699 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95932ceb-a829-4a06-b167-59211de642fe None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:27.556612 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 356/708] 10.222.0.65 () {60 vars in 1132 bytes} [Tue May 17 18:04:27 2022] POST /identity/v3/users => generated 254 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:04:27.557915 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba55d14-45cc-455c-8293-f7e87048dbc4 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:27.558200 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba55d14-45cc-455c-8293-f7e87048dbc4 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:27.558474 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba55d14-45cc-455c-8293-f7e87048dbc4 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:27.561552 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 357/709] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:04:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:04:27.561552 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba55d14-45cc-455c-8293-f7e87048dbc4 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:27.592305 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e111b3f-ae5f-42d7-8d7a-144f5e7e26a4 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:27.640856 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4efe276-9087-49ab-8884-d810cc29c3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:27.641632 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4efe276-9087-49ab-8884-d810cc29c3dc None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:27.642140 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4efe276-9087-49ab-8884-d810cc29c3dc None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:27.642140 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4efe276-9087-49ab-8884-d810cc29c3dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:27.649619 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4efe276-9087-49ab-8884-d810cc29c3dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:27.651077 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4efe276-9087-49ab-8884-d810cc29c3dc None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:27.671641 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-e4efe276-9087-49ab-8884-d810cc29c3dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:04:27.671641 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:27.671641 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:27.671641 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:27.671641 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:27.671641 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:27.671641 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:27.671641 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:27.671641 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:27.671641 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:27.671641 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:27.671641 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:27.671641 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 18:04:27.671641 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 18:04:27.671641 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 18:04:27.672627 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 18:04:27.672627 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:27.672627 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:27.672627 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:27.672627 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:27.672627 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:27.672627 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:27.672627 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:27.672627 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:27.672627 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:27.672627 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:27.672627 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:27.672627 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:27.672627 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:27.672627 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:27.672627 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:27.672627 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:27.673691 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 18:04:27.673691 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 18:04:27.673691 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 18:04:27.673691 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 18:04:27.673691 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 18:04:27.673691 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 18:04:27.673691 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:04:27.673691 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:27.675189 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 353/710] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 17 18:04:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:27.676494 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189b3f3-8e74-4a15-b7e6-922675ab7b14 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:27.676779 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189b3f3-8e74-4a15-b7e6-922675ab7b14 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:27.677055 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189b3f3-8e74-4a15-b7e6-922675ab7b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:27.696250 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-9189b3f3-8e74-4a15-b7e6-922675ab7b14 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:27.697567 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-9189b3f3-8e74-4a15-b7e6-922675ab7b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:27.698678 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba55d14-45cc-455c-8293-f7e87048dbc4 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:27.743182 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64564d-5d3e-4923-955e-026cdb7db6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:27.744917 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64564d-5d3e-4923-955e-026cdb7db6d3 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:27.745401 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64564d-5d3e-4923-955e-026cdb7db6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:27.745917 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64564d-5d3e-4923-955e-026cdb7db6d3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:27.747179 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd64564d-5d3e-4923-955e-026cdb7db6d3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:27.749477 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd64564d-5d3e-4923-955e-026cdb7db6d3 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:27.766872 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-bd64564d-5d3e-4923-955e-026cdb7db6d3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 17 18:04:27.766872 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:27.766872 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 18:04:27.766872 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 18:04:27.766872 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 18:04:27.766872 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 18:04:27.766872 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 18:04:27.766872 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:04:27.766872 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 17 18:04:27.766872 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:27.766872 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 18:04:27.766872 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:27.766872 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:27.766872 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:27.766872 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:27.766872 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:27.767877 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:27.767877 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:27.767877 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:27.767877 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:27.767877 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:27.767877 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:27.767877 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:27.767877 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 18:04:27.767877 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 18:04:27.767877 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 18:04:27.767877 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 18:04:27.767877 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:27.767877 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:27.767877 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:27.767877 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:27.767877 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:27.768724 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:27.768724 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:27.768724 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:27.768724 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:27.768724 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:27.768724 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:27.768724 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:27.768724 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:27.768724 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:27.768724 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:27.768724 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:27.768724 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 18:04:27.768724 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:04:27.768724 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 17 18:04:27.768724 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:27.771509 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 358/711] 10.222.0.65 () {56 vars in 1129 bytes} [Tue May 17 18:04:27 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:27.772084 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 354/712] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:04:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:04:27.772678 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64564d-5d3e-4923-955e-026cdb7db6d3 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:27.777306 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189b3f3-8e74-4a15-b7e6-922675ab7b14 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:27.893400 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64564d-5d3e-4923-955e-026cdb7db6d3 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:27.898140 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189b3f3-8e74-4a15-b7e6-922675ab7b14 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:27.938390 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f2df0-f54d-4b9f-af6e-a251392a4f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:27.939045 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f2df0-f54d-4b9f-af6e-a251392a4f94 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:27.939399 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f2df0-f54d-4b9f-af6e-a251392a4f94 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:27.939681 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f2df0-f54d-4b9f-af6e-a251392a4f94 None admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:27.940655 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f2df0-f54d-4b9f-af6e-a251392a4f94 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:27.940959 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f2df0-f54d-4b9f-af6e-a251392a4f94 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:27.942288 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c27627-edf1-4a9e-8e43-543d06013a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:27.942764 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f2df0-f54d-4b9f-af6e-a251392a4f94 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:27.943200 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c27627-edf1-4a9e-8e43-543d06013a2d None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:27.943479 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c27627-edf1-4a9e-8e43-543d06013a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:27.943752 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c27627-edf1-4a9e-8e43-543d06013a2d None admin] PATH_INFO: `/v3/services` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:27.944718 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c27627-edf1-4a9e-8e43-543d06013a2d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:27.945421 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c27627-edf1-4a9e-8e43-543d06013a2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:27.946835 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c27627-edf1-4a9e-8e43-543d06013a2d None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:27.952610 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 355/713] 10.222.0.65 () {56 vars in 1124 bytes} [Tue May 17 18:04:27 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:04:27.953818 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c27627-edf1-4a9e-8e43-543d06013a2d None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:27.955516 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 359/714] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 17 18:04:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:27.958331 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f2df0-f54d-4b9f-af6e-a251392a4f94 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:28.070744 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c27627-edf1-4a9e-8e43-543d06013a2d None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:28.074771 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f2df0-f54d-4b9f-af6e-a251392a4f94 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:28.108874 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a813bcf5-44df-4129-b1d5-198a9a39f819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:28.109667 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813bcf5-44df-4129-b1d5-198a9a39f819 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:28.109944 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813bcf5-44df-4129-b1d5-198a9a39f819 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:28.110214 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813bcf5-44df-4129-b1d5-198a9a39f819 None admin] PATH_INFO: `/v3/services` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:28.110903 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a813bcf5-44df-4129-b1d5-198a9a39f819 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:28.111201 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a813bcf5-44df-4129-b1d5-198a9a39f819 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:28.112739 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a813bcf5-44df-4129-b1d5-198a9a39f819 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:28.115195 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0bd3c8-0229-4207-9291-277cc1c6f232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:28.116381 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0bd3c8-0229-4207-9291-277cc1c6f232 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:28.117024 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0bd3c8-0229-4207-9291-277cc1c6f232 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:28.117408 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0bd3c8-0229-4207-9291-277cc1c6f232 None admin] PATH_INFO: `/v3/services/network` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:28.118179 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0bd3c8-0229-4207-9291-277cc1c6f232 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:28.118950 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 360/715] 10.222.0.65 () {56 vars in 1124 bytes} [Tue May 17 18:04:27 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:28.119817 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0bd3c8-0229-4207-9291-277cc1c6f232 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:28.120007 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a813bcf5-44df-4129-b1d5-198a9a39f819 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:28.137526 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-3a0bd3c8-0229-4207-9291-277cc1c6f232 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 17 18:04:28.137526 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:28.137526 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 18:04:28.137526 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 18:04:28.137526 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 18:04:28.137526 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 18:04:28.137526 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 18:04:28.137526 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:04:28.137526 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 17 18:04:28.137526 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:28.137526 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 18:04:28.137526 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:28.137526 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:28.137526 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:28.137526 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:28.137526 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:28.137526 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:28.139336 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:28.139336 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:28.139336 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:28.139336 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:28.139336 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:28.139336 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:28.139336 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 18:04:28.139336 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 18:04:28.139336 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 18:04:28.139336 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 18:04:28.139336 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:28.139336 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:28.139336 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:28.139336 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:28.139336 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:28.139336 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:28.140387 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:28.140387 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:28.140387 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:28.140387 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:28.140387 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:28.140387 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:28.140387 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:28.140387 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:28.140387 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:28.140387 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:28.140387 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 18:04:28.140387 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:04:28.140387 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 17 18:04:28.140387 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:28.141436 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 356/716] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 17 18:04:27 2022] GET /identity/v3/services/network => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:28.146353 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0bd3c8-0229-4207-9291-277cc1c6f232 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:28.232939 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a813bcf5-44df-4129-b1d5-198a9a39f819 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:28.268425 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819d07d-9051-4753-a123-20d9f17a7421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:28.269281 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819d07d-9051-4753-a123-20d9f17a7421 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:28.269715 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819d07d-9051-4753-a123-20d9f17a7421 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:28.270086 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819d07d-9051-4753-a123-20d9f17a7421 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:28.271067 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a819d07d-9051-4753-a123-20d9f17a7421 None admin] RBAC: Adding query filter params (role.id=332c8d70fd0f41e2beea20aaead5daa5, scope.project.id=0cf165918c1f46cb96d4b54409862659, user.id=5b430b739cb54fc7911bc89f8ea2df72) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:28.271494 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a819d07d-9051-4753-a123-20d9f17a7421 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:28.273086 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a819d07d-9051-4753-a123-20d9f17a7421 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:28.279914 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 361/717] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 17 18:04:28 2022] GET /identity/v3/role_assignments?user.id=5b430b739cb54fc7911bc89f8ea2df72&scope.project.id=0cf165918c1f46cb96d4b54409862659&role.id=332c8d70fd0f41e2beea20aaead5daa5 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:28.281686 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0bd3c8-0229-4207-9291-277cc1c6f232 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:28.334441 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdac3b5a-b84d-4b9f-af36-ad822b19f051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:28.335145 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac3b5a-b84d-4b9f-af36-ad822b19f051 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:28.335429 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac3b5a-b84d-4b9f-af36-ad822b19f051 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:28.335706 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdac3b5a-b84d-4b9f-af36-ad822b19f051 None admin] PATH_INFO: `/v3/services` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:28.336436 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdac3b5a-b84d-4b9f-af36-ad822b19f051 None admin] RBAC: Adding query filter params (name=network) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:28.336742 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdac3b5a-b84d-4b9f-af36-ad822b19f051 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:28.338202 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdac3b5a-b84d-4b9f-af36-ad822b19f051 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:28.344315 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 357/718] 10.222.0.65 () {56 vars in 1112 bytes} [Tue May 17 18:04:28 2022] GET /identity/v3/services?name=network => generated 124 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:04:28.349791 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819d07d-9051-4753-a123-20d9f17a7421 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:28.485013 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819d07d-9051-4753-a123-20d9f17a7421 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:28.527397 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aff47a9-4f46-499a-a58a-03826f247ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:28.528311 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff47a9-4f46-499a-a58a-03826f247ce8 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:28.528738 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff47a9-4f46-499a-a58a-03826f247ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:28.529791 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff47a9-4f46-499a-a58a-03826f247ce8 None admin] PATH_INFO: `/v3/services` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:28.530645 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aff47a9-4f46-499a-a58a-03826f247ce8 None admin] RBAC: Adding query filter params (type=network) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:28.531109 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aff47a9-4f46-499a-a58a-03826f247ce8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:28.532675 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aff47a9-4f46-499a-a58a-03826f247ce8 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:28.544646 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 362/719] 10.222.0.65 () {56 vars in 1112 bytes} [Tue May 17 18:04:28 2022] GET /identity/v3/services?type=network => generated 124 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:29.548028 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b08f1-d6df-4c12-852b-809a20c94f13 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:29.549050 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b08f1-d6df-4c12-852b-809a20c94f13 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:29.549566 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14b08f1-d6df-4c12-852b-809a20c94f13 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:29.551375 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 358/720] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:04:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:04:29.557219 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b72dab-1907-40fd-8c61-0f44afc59cfc None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:29.557662 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b72dab-1907-40fd-8c61-0f44afc59cfc None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:29.557854 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b72dab-1907-40fd-8c61-0f44afc59cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:29.578582 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-04b72dab-1907-40fd-8c61-0f44afc59cfc None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:29.579790 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-04b72dab-1907-40fd-8c61-0f44afc59cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:29.658672 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 363/721] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:04:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:04:29.698801 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b08f1-d6df-4c12-852b-809a20c94f13 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:29.834292 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14b08f1-d6df-4c12-852b-809a20c94f13 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:29.868970 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728dd92c-1b21-4d57-9e68-f1d122647254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:29.869804 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728dd92c-1b21-4d57-9e68-f1d122647254 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:29.870087 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728dd92c-1b21-4d57-9e68-f1d122647254 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:29.870359 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728dd92c-1b21-4d57-9e68-f1d122647254 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:29.880976 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728dd92c-1b21-4d57-9e68-f1d122647254 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:04:29.888606 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-728dd92c-1b21-4d57-9e68-f1d122647254 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:04:29.888606 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:29.888606 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:29.888606 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:29.888606 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:29.888606 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:29.888606 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:29.888606 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:29.888606 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:29.888606 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:29.888606 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:29.888606 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:29.888606 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:04:29.888606 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:04:29.888606 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:04:29.888606 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:04:29.889635 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:04:29.889635 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:04:29.889635 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:04:29.889635 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:04:29.889635 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:29.889635 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:29.889635 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:29.889635 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:29.889635 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:29.889635 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:29.889635 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:29.889635 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:29.889635 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:29.889635 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:29.889635 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:29.889635 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:29.890846 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:29.890846 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:29.890846 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:29.890846 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:29.890846 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:04:29.890846 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:04:29.890846 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:04:29.890846 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:04:29.890846 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:04:29.890846 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:04:29.890846 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:04:29.890846 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:29.890846 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 359/722] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 17 18:04:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:29.897700 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b72dab-1907-40fd-8c61-0f44afc59cfc None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:30.035810 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b72dab-1907-40fd-8c61-0f44afc59cfc None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:30.091110 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f32fd-992c-4fd6-a354-32745e306f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:30.091727 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f32fd-992c-4fd6-a354-32745e306f81 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:30.092004 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f32fd-992c-4fd6-a354-32745e306f81 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:30.092279 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f32fd-992c-4fd6-a354-32745e306f81 None admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:30.093024 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55f32fd-992c-4fd6-a354-32745e306f81 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:30.093325 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55f32fd-992c-4fd6-a354-32745e306f81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:30.094713 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55f32fd-992c-4fd6-a354-32745e306f81 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:30.103165 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 364/723] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 17 18:04:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:30.108618 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728dd92c-1b21-4d57-9e68-f1d122647254 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:30.272412 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728dd92c-1b21-4d57-9e68-f1d122647254 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:30.306612 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff38eacd-87f7-4db2-b2d5-72d4d35a6b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:30.307411 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38eacd-87f7-4db2-b2d5-72d4d35a6b2b None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:30.307694 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38eacd-87f7-4db2-b2d5-72d4d35a6b2b None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:30.307969 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38eacd-87f7-4db2-b2d5-72d4d35a6b2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:30.320821 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff38eacd-87f7-4db2-b2d5-72d4d35a6b2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:30.322325 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff38eacd-87f7-4db2-b2d5-72d4d35a6b2b None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:30.340391 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-ff38eacd-87f7-4db2-b2d5-72d4d35a6b2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:30.340391 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:30.340391 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:30.340391 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:30.340391 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:30.340391 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:30.340391 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:30.340391 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:30.340391 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:30.340391 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:30.340391 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:30.340391 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:30.340391 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:04:30.340391 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:04:30.340391 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:04:30.342774 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:04:30.342774 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:30.342774 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:30.342774 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:30.342774 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:30.342774 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:30.342774 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:30.342774 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:30.342774 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:30.342774 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:30.342774 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:30.342774 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:30.342774 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:30.342774 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:30.342774 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:30.342774 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:30.342774 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:30.344949 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:04:30.344949 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:04:30.344949 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:30.344949 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:30.344949 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 360/724] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:04:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:30.351661 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f32fd-992c-4fd6-a354-32745e306f81 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:30.502301 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f32fd-992c-4fd6-a354-32745e306f81 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:30.543055 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c96649-402a-4bf5-9ac4-b4b606c27d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:30.543712 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c96649-402a-4bf5-9ac4-b4b606c27d34 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:30.543991 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c96649-402a-4bf5-9ac4-b4b606c27d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:30.544257 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c96649-402a-4bf5-9ac4-b4b606c27d34 None admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:30.545585 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c96649-402a-4bf5-9ac4-b4b606c27d34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:30.545886 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c96649-402a-4bf5-9ac4-b4b606c27d34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:30.547240 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c96649-402a-4bf5-9ac4-b4b606c27d34 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:30.567906 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 365/725] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:04:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:30.574185 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff38eacd-87f7-4db2-b2d5-72d4d35a6b2b None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:30.613676 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf5ea6-f724-478e-9956-ccde3b176927 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:30.613972 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf5ea6-f724-478e-9956-ccde3b176927 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:30.614138 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf5ea6-f724-478e-9956-ccde3b176927 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:30.615713 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 366/726] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:04:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:04:30.620605 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea10b631-2af8-46eb-92d4-96d2da9f6037 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:30.620886 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea10b631-2af8-46eb-92d4-96d2da9f6037 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:30.621159 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea10b631-2af8-46eb-92d4-96d2da9f6037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:30.637850 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-ea10b631-2af8-46eb-92d4-96d2da9f6037 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:30.639048 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-ea10b631-2af8-46eb-92d4-96d2da9f6037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:30.717554 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff38eacd-87f7-4db2-b2d5-72d4d35a6b2b None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:30.756799 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 367/727] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:04:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 18:04:30.780556 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea10b631-2af8-46eb-92d4-96d2da9f6037 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:30.809123 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ae51cd-b598-464a-a676-ce94882d2669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:30.809955 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae51cd-b598-464a-a676-ce94882d2669 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:30.810771 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae51cd-b598-464a-a676-ce94882d2669 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:30.811047 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae51cd-b598-464a-a676-ce94882d2669 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:30.831509 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ae51cd-b598-464a-a676-ce94882d2669 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:30.833187 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ae51cd-b598-464a-a676-ce94882d2669 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:30.861156 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-b9ae51cd-b598-464a-a676-ce94882d2669 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 17 18:04:30.861156 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:30.861156 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:30.861156 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:30.861156 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:30.861156 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:30.861156 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:30.861156 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:30.861156 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:30.861156 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:30.861156 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:30.861156 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:30.861156 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 18:04:30.861156 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 18:04:30.861156 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 18:04:30.861156 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 18:04:30.862236 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:30.862236 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:30.862236 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 18:04:30.862236 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:04:30.862236 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 18:04:30.862236 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:04:30.862236 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:30.862236 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:30.862236 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:30.862236 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:30.862236 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:30.862236 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:30.862236 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:30.862236 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:30.862236 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:30.862236 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:30.862236 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:30.862236 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:30.863180 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:30.863180 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:30.863180 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 18:04:30.863180 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 18:04:30.863180 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 18:04:30.863180 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 18:04:30.863180 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 18:04:30.863180 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 18:04:30.863180 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 17 18:04:30.863180 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:30.867153 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 361/728] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 17 18:04:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:30.868294 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ae51cd-b598-464a-a676-ce94882d2669 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:30.946061 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea10b631-2af8-46eb-92d4-96d2da9f6037 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:30.980272 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead24b3-5fa6-472c-9cfe-c21ae5b60b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:30.981075 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead24b3-5fa6-472c-9cfe-c21ae5b60b8a None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:30.981356 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead24b3-5fa6-472c-9cfe-c21ae5b60b8a None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:30.981653 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead24b3-5fa6-472c-9cfe-c21ae5b60b8a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:30.992528 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fead24b3-5fa6-472c-9cfe-c21ae5b60b8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:04:30.995232 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ae51cd-b598-464a-a676-ce94882d2669 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:31.000365 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-fead24b3-5fa6-472c-9cfe-c21ae5b60b8a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 18:04:31.000365 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:31.000365 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:31.000365 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:31.000365 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:31.000365 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:31.000365 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:31.000365 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:31.000365 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:31.000365 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:31.000365 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:31.000365 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:31.000365 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:04:31.000365 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:04:31.000365 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:04:31.000365 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:04:31.001364 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:04:31.001364 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:04:31.001364 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:04:31.001364 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:04:31.001364 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:31.001364 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:31.001364 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:31.001364 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:31.001364 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:31.001364 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:31.001364 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:31.001364 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:31.001364 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:31.001364 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:31.001364 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:31.001364 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:31.002341 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:31.002341 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:31.002341 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:31.002341 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:31.002341 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:04:31.002341 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:04:31.002341 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:04:31.002341 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:04:31.002341 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:04:31.002341 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:04:31.002341 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 18:04:31.002341 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:31.002341 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 368/729] 10.222.0.65 () {56 vars in 1102 bytes} [Tue May 17 18:04:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:04:31.003064 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601b615-2829-4a1a-b164-affa8d354944 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:31.008700 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601b615-2829-4a1a-b164-affa8d354944 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:31.008700 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601b615-2829-4a1a-b164-affa8d354944 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:31.008700 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 369/730] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:04:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:04:31.008700 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a08508-9d1b-435a-a733-af584fce4e2f None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:31.008700 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a08508-9d1b-435a-a733-af584fce4e2f None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:31.008700 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a08508-9d1b-435a-a733-af584fce4e2f None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:31.008700 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 370/731] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:04:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:04:31.011139 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a08508-9d1b-435a-a733-af584fce4e2f None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:31.039610 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6223b2a8-b3e9-4316-93a1-9278ca789bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:31.040276 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223b2a8-b3e9-4316-93a1-9278ca789bfe None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:31.040555 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223b2a8-b3e9-4316-93a1-9278ca789bfe None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:31.040831 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223b2a8-b3e9-4316-93a1-9278ca789bfe None admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:31.041696 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6223b2a8-b3e9-4316-93a1-9278ca789bfe None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:31.042007 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6223b2a8-b3e9-4316-93a1-9278ca789bfe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:31.043435 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6223b2a8-b3e9-4316-93a1-9278ca789bfe None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:31.060224 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 362/732] 10.222.0.65 () {56 vars in 1135 bytes} [Tue May 17 18:04:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:31.061553 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb7cc0-e1aa-40ed-8751-208f716583da None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:31.061834 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb7cc0-e1aa-40ed-8751-208f716583da None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:31.062077 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb7cc0-e1aa-40ed-8751-208f716583da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:31.078699 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-e7eb7cc0-e1aa-40ed-8751-208f716583da None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:31.079881 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-e7eb7cc0-e1aa-40ed-8751-208f716583da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:31.117269 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a08508-9d1b-435a-a733-af584fce4e2f None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:31.147435 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 363/733] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:04:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:04:31.148729 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c1300-052e-472f-9c63-ec533d4ce8f6 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:31.149017 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c1300-052e-472f-9c63-ec533d4ce8f6 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:31.149284 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c1300-052e-472f-9c63-ec533d4ce8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:31.162537 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c364a0a-bc63-4fa4-a507-7746acb3fcee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:31.163201 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c364a0a-bc63-4fa4-a507-7746acb3fcee None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:31.163476 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c364a0a-bc63-4fa4-a507-7746acb3fcee None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:31.163742 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c364a0a-bc63-4fa4-a507-7746acb3fcee None admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:31.164482 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c364a0a-bc63-4fa4-a507-7746acb3fcee None admin] RBAC: Adding query filter params (name=service) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:31.164781 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c364a0a-bc63-4fa4-a507-7746acb3fcee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:31.166170 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c364a0a-bc63-4fa4-a507-7746acb3fcee None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:31.174833 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-b25c1300-052e-472f-9c63-ec533d4ce8f6 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:31.176021 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-b25c1300-052e-472f-9c63-ec533d4ce8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:31.176548 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 371/734] 10.222.0.65 () {56 vars in 1103 bytes} [Tue May 17 18:04:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:31.177367 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c364a0a-bc63-4fa4-a507-7746acb3fcee None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:31.241187 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 364/735] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:04:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:04:31.242060 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c1300-052e-472f-9c63-ec533d4ce8f6 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:31.295389 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c364a0a-bc63-4fa4-a507-7746acb3fcee None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:31.329396 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f144c02-d090-42f7-b102-4b874987b505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:31.330092 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f144c02-d090-42f7-b102-4b874987b505 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:31.330375 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f144c02-d090-42f7-b102-4b874987b505 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:31.330668 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f144c02-d090-42f7-b102-4b874987b505 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:31.345006 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c1300-052e-472f-9c63-ec533d4ce8f6 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:31.383718 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad0ab6-5d7d-414e-874e-a41c5c46f6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:31.384509 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad0ab6-5d7d-414e-874e-a41c5c46f6db None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:31.384785 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad0ab6-5d7d-414e-874e-a41c5c46f6db None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:31.385058 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad0ab6-5d7d-414e-874e-a41c5c46f6db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:31.394975 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ad0ab6-5d7d-414e-874e-a41c5c46f6db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:04:31.401630 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f144c02-d090-42f7-b102-4b874987b505 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:31.402531 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-22ad0ab6-5d7d-414e-874e-a41c5c46f6db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:04:31.402531 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:31.402531 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:31.402531 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:31.402531 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:31.402531 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:31.402531 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:31.402531 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:31.402531 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:31.402531 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:31.402531 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:31.402531 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:31.402531 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:04:31.402531 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:04:31.402531 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:04:31.402531 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:04:31.403437 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:04:31.403437 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:04:31.403437 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:04:31.403437 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:04:31.403437 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:31.403437 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:31.403437 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:31.403437 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:31.403437 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:31.403437 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:31.403437 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:31.403437 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:31.403437 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:31.403437 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:31.403437 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:31.403437 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:31.404830 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:31.404830 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:31.404830 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:31.404830 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:31.404830 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:04:31.404830 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:04:31.404830 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:04:31.404830 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:04:31.404830 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:04:31.404830 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:04:31.404830 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:04:31.404830 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:31.404830 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 365/736] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 17 18:04:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:31.405542 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad0ab6-5d7d-414e-874e-a41c5c46f6db None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:31.406424 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f144c02-d090-42f7-b102-4b874987b505 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:31.503769 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 372/737] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 17 18:04:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 18:04:31.504598 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f144c02-d090-42f7-b102-4b874987b505 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:31.512097 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ad0ab6-5d7d-414e-874e-a41c5c46f6db None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:31.544221 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8a621-8d45-4bd6-9dd4-ed2762432c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:31.545630 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8a621-8d45-4bd6-9dd4-ed2762432c9a None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:31.545916 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8a621-8d45-4bd6-9dd4-ed2762432c9a None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:31.546184 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a8a621-8d45-4bd6-9dd4-ed2762432c9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:31.556247 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a8a621-8d45-4bd6-9dd4-ed2762432c9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:31.557728 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a8a621-8d45-4bd6-9dd4-ed2762432c9a None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:31.574777 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-97a8a621-8d45-4bd6-9dd4-ed2762432c9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:31.574777 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:31.574777 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:31.574777 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:31.574777 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:31.574777 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:31.574777 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:31.574777 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:31.574777 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:31.574777 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:31.574777 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:31.574777 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:31.574777 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:04:31.574777 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:04:31.574777 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:04:31.576822 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:04:31.576822 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:31.576822 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:31.576822 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:31.576822 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:31.576822 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:31.576822 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:31.576822 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:31.576822 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:31.576822 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:31.576822 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:31.576822 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:31.576822 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:31.576822 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:31.576822 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:31.576822 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:31.576822 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:31.578143 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:04:31.578143 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:04:31.578143 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:31.578143 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:31.578143 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 366/738] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:04:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:31.578143 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8a621-8d45-4bd6-9dd4-ed2762432c9a None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:31.600274 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f144c02-d090-42f7-b102-4b874987b505 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:31.632210 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588deec-ef43-441e-9dc1-9705c2f93322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:31.632861 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588deec-ef43-441e-9dc1-9705c2f93322 None admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:31.633140 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588deec-ef43-441e-9dc1-9705c2f93322 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:31.633409 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6588deec-ef43-441e-9dc1-9705c2f93322 None admin] PATH_INFO: `/v3/services` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:31.634185 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6588deec-ef43-441e-9dc1-9705c2f93322 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:31.635514 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6588deec-ef43-441e-9dc1-9705c2f93322 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:31.649793 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 373/739] 10.222.0.65 () {60 vars in 1141 bytes} [Tue May 17 18:04:31 2022] POST /identity/v3/services => generated 251 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:04:31.650793 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588deec-ef43-441e-9dc1-9705c2f93322 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:31.679422 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a8a621-8d45-4bd6-9dd4-ed2762432c9a None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:31.728924 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d38761a-a273-44a3-a7ba-e044c0bcd6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:31.729638 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38761a-a273-44a3-a7ba-e044c0bcd6d6 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:31.729922 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38761a-a273-44a3-a7ba-e044c0bcd6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:31.730194 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38761a-a273-44a3-a7ba-e044c0bcd6d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:31.730964 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d38761a-a273-44a3-a7ba-e044c0bcd6d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:31.731270 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d38761a-a273-44a3-a7ba-e044c0bcd6d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:31.733220 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d38761a-a273-44a3-a7ba-e044c0bcd6d6 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:31.746762 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 367/740] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 17 18:04:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:31.746762 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324ab08-c172-4169-8924-5b16690859fd None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:31.746762 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324ab08-c172-4169-8924-5b16690859fd None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:31.746762 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324ab08-c172-4169-8924-5b16690859fd None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:31.746762 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 368/741] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:04:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:04:31.746762 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b324ab08-c172-4169-8924-5b16690859fd None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:31.762483 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6588deec-ef43-441e-9dc1-9705c2f93322 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:31.798425 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5699458b-8646-455c-9031-0679a172b060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:31.799254 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699458b-8646-455c-9031-0679a172b060 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:31.799527 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699458b-8646-455c-9031-0679a172b060 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:31.799804 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5699458b-8646-455c-9031-0679a172b060 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:31.811327 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5699458b-8646-455c-9031-0679a172b060 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:31.812817 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5699458b-8646-455c-9031-0679a172b060 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:31.831327 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-5699458b-8646-455c-9031-0679a172b060 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:31.831327 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:31.831327 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:31.831327 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:31.831327 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:31.831327 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:31.831327 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:31.831327 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:31.831327 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:31.831327 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:31.831327 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:31.831327 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:31.831327 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:04:31.831327 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:04:31.831327 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:04:31.832272 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:04:31.832272 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:31.832272 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:31.832272 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:31.832272 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:31.832272 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:31.832272 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:31.832272 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:31.832272 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:31.832272 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:31.832272 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:31.832272 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:31.832272 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:31.832272 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:31.832272 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:31.832272 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:31.832272 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:31.833154 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:04:31.833154 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:04:31.833154 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:31.833154 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:31.833656 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 374/742] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:04:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:31.834466 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5699458b-8646-455c-9031-0679a172b060 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:31.866248 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b324ab08-c172-4169-8924-5b16690859fd None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:31.901146 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508cd81-978b-451f-9399-4cfdd3b22676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:31.901765 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508cd81-978b-451f-9399-4cfdd3b22676 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:31.902043 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508cd81-978b-451f-9399-4cfdd3b22676 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:31.902312 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508cd81-978b-451f-9399-4cfdd3b22676 None admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:31.903030 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3508cd81-978b-451f-9399-4cfdd3b22676 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:31.903335 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3508cd81-978b-451f-9399-4cfdd3b22676 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:31.905262 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3508cd81-978b-451f-9399-4cfdd3b22676 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:31.916647 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 369/743] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:04:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:31.921792 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa672b1-d69c-49e7-a79c-74e060a7962c None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:31.922391 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa672b1-d69c-49e7-a79c-74e060a7962c None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:31.922391 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa672b1-d69c-49e7-a79c-74e060a7962c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:31.938243 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-efa672b1-d69c-49e7-a79c-74e060a7962c None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:31.938978 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5699458b-8646-455c-9031-0679a172b060 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:31.939408 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-efa672b1-d69c-49e7-a79c-74e060a7962c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:31.972459 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afebc0a-b8a1-43a4-894d-13cf493454e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:31.973246 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afebc0a-b8a1-43a4-894d-13cf493454e8 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:31.974230 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afebc0a-b8a1-43a4-894d-13cf493454e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:31.974230 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afebc0a-b8a1-43a4-894d-13cf493454e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:31.984446 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afebc0a-b8a1-43a4-894d-13cf493454e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:31.985916 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afebc0a-b8a1-43a4-894d-13cf493454e8 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:32.002571 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-6afebc0a-b8a1-43a4-894d-13cf493454e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:32.002571 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:32.002571 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:32.002571 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:32.002571 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:32.002571 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:32.002571 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:32.002571 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:32.002571 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:32.002571 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:32.002571 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:32.002571 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:32.002571 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:04:32.002571 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:04:32.002571 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:04:32.003456 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:04:32.003456 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:32.003456 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:32.003456 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:32.003456 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:32.003456 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:32.003456 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:32.003456 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:32.003456 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:32.003456 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:32.003456 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:32.003456 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:32.003456 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:32.003456 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:32.003456 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:32.003456 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:32.003456 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:32.004855 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:04:32.004855 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:04:32.004855 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:32.004855 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:32.008333 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 375/744] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:04:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:32.008947 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afebc0a-b8a1-43a4-894d-13cf493454e8 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:32.009751 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 370/745] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:04:31 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 18:04:32.010965 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa672b1-d69c-49e7-a79c-74e060a7962c None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:32.105616 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afebc0a-b8a1-43a4-894d-13cf493454e8 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:32.108028 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa672b1-d69c-49e7-a79c-74e060a7962c None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:32.139771 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c3794-ccb9-4d5c-9146-ce26f72a5328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:32.140410 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c3794-ccb9-4d5c-9146-ce26f72a5328 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:32.140689 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c3794-ccb9-4d5c-9146-ce26f72a5328 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:32.140958 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c3794-ccb9-4d5c-9146-ce26f72a5328 None admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:32.141714 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c3794-ccb9-4d5c-9146-ce26f72a5328 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:32.141992 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c3794-ccb9-4d5c-9146-ce26f72a5328 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:32.142328 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d847c25b-8f97-4abf-825b-d1f04f2bfec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:32.143129 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d847c25b-8f97-4abf-825b-d1f04f2bfec3 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:32.143350 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c3794-ccb9-4d5c-9146-ce26f72a5328 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:32.143445 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d847c25b-8f97-4abf-825b-d1f04f2bfec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:32.143658 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d847c25b-8f97-4abf-825b-d1f04f2bfec3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:32.151410 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d847c25b-8f97-4abf-825b-d1f04f2bfec3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:32.152776 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d847c25b-8f97-4abf-825b-d1f04f2bfec3 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:32.155096 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 376/746] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:04:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:32.155886 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c3794-ccb9-4d5c-9146-ce26f72a5328 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:32.172340 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-d847c25b-8f97-4abf-825b-d1f04f2bfec3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 18:04:32.172340 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:32.172340 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:32.172340 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:32.172340 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:32.172340 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:32.172340 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:32.172340 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:32.172340 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:32.172340 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:32.172340 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:32.172340 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:32.172340 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 18:04:32.172340 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 18:04:32.172340 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 18:04:32.172340 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 18:04:32.173330 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:32.173330 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:32.173330 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 18:04:32.173330 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:04:32.173330 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 18:04:32.173330 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:04:32.173330 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:32.173330 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:32.173330 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:32.173330 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:32.173330 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:32.173330 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:32.173330 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:32.173330 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:32.173330 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:32.173330 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:32.173330 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:32.173330 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:32.174305 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:32.174305 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:32.174305 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 18:04:32.174305 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 18:04:32.174305 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 18:04:32.174305 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 18:04:32.174305 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 18:04:32.174305 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 18:04:32.174305 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 18:04:32.174305 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:32.178235 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 371/747] 10.222.0.65 () {56 vars in 1117 bytes} [Tue May 17 18:04:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:32.178934 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d847c25b-8f97-4abf-825b-d1f04f2bfec3 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:32.253039 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c3794-ccb9-4d5c-9146-ce26f72a5328 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:32.281486 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d847c25b-8f97-4abf-825b-d1f04f2bfec3 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:32.286297 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12c7262-7a51-42ef-9423-082d2fc1e42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:32.287183 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c7262-7a51-42ef-9423-082d2fc1e42d None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:32.287666 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c7262-7a51-42ef-9423-082d2fc1e42d None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:32.288128 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c7262-7a51-42ef-9423-082d2fc1e42d None admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:32.289046 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12c7262-7a51-42ef-9423-082d2fc1e42d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:32.289593 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12c7262-7a51-42ef-9423-082d2fc1e42d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:32.291172 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12c7262-7a51-42ef-9423-082d2fc1e42d None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:32.306471 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 377/748] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:04:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:32.306471 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12c7262-7a51-42ef-9423-082d2fc1e42d None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:32.320291 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac98976-3ad9-4231-a93b-3f84408c1d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:32.320940 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac98976-3ad9-4231-a93b-3f84408c1d6f None admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:32.321216 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac98976-3ad9-4231-a93b-3f84408c1d6f None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:32.321511 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac98976-3ad9-4231-a93b-3f84408c1d6f None admin] PATH_INFO: `/v3/services` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:32.322216 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac98976-3ad9-4231-a93b-3f84408c1d6f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:32.323557 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac98976-3ad9-4231-a93b-3f84408c1d6f None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:32.345510 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 372/749] 10.222.0.65 () {60 vars in 1141 bytes} [Tue May 17 18:04:32 2022] POST /identity/v3/services => generated 240 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:04:32.345510 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac98976-3ad9-4231-a93b-3f84408c1d6f None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:32.435958 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12c7262-7a51-42ef-9423-082d2fc1e42d None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:32.461475 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac98976-3ad9-4231-a93b-3f84408c1d6f None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:32.473298 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b0229-d448-40ec-ad2f-776343d5d31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:32.474279 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b0229-d448-40ec-ad2f-776343d5d31d None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:32.474660 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b0229-d448-40ec-ad2f-776343d5d31d None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:32.475033 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b0229-d448-40ec-ad2f-776343d5d31d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:32.483269 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5b0229-d448-40ec-ad2f-776343d5d31d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:32.485048 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5b0229-d448-40ec-ad2f-776343d5d31d None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:32.497512 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a6091-c53d-45d6-8655-83ab3ebf09d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:32.498284 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a6091-c53d-45d6-8655-83ab3ebf09d0 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:32.498568 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a6091-c53d-45d6-8655-83ab3ebf09d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:32.498840 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a6091-c53d-45d6-8655-83ab3ebf09d0 None admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:32.499694 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a6091-c53d-45d6-8655-83ab3ebf09d0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:32.499999 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a6091-c53d-45d6-8655-83ab3ebf09d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:32.501442 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a6091-c53d-45d6-8655-83ab3ebf09d0 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:32.501993 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-fc5b0229-d448-40ec-ad2f-776343d5d31d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:04:32.501993 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:32.501993 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:32.501993 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:32.501993 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:32.501993 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:32.501993 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:32.501993 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:32.501993 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:32.501993 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:32.501993 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:32.501993 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:32.501993 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 18:04:32.501993 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 18:04:32.501993 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 18:04:32.503034 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 18:04:32.503034 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:32.503034 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:32.503034 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:32.503034 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:32.503034 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:32.503034 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:32.503034 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:32.503034 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:32.503034 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:32.503034 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:32.503034 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:32.503034 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:32.503034 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:32.503034 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:32.503034 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:32.503034 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:32.504648 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 18:04:32.504648 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 18:04:32.504648 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 18:04:32.504648 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 18:04:32.504648 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 18:04:32.504648 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 18:04:32.504648 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:04:32.504648 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:32.509799 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 378/750] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 17 18:04:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:32.509799 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b0229-d448-40ec-ad2f-776343d5d31d None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:32.521976 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 373/751] 10.222.0.65 () {56 vars in 1149 bytes} [Tue May 17 18:04:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:32.522995 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a6091-c53d-45d6-8655-83ab3ebf09d0 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:32.614646 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b0229-d448-40ec-ad2f-776343d5d31d None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:32.628108 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a6091-c53d-45d6-8655-83ab3ebf09d0 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:32.648125 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3556073-4de7-40d6-8ac8-e3bdecb5514b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:32.649140 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3556073-4de7-40d6-8ac8-e3bdecb5514b None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:32.649253 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3556073-4de7-40d6-8ac8-e3bdecb5514b None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:32.649509 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3556073-4de7-40d6-8ac8-e3bdecb5514b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:32.656775 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3556073-4de7-40d6-8ac8-e3bdecb5514b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:32.658232 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3556073-4de7-40d6-8ac8-e3bdecb5514b None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:32.663268 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034cdc7e-dbe5-4e73-b1f1-59dc9d600a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:32.664088 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034cdc7e-dbe5-4e73-b1f1-59dc9d600a8c None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:32.664529 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034cdc7e-dbe5-4e73-b1f1-59dc9d600a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:32.664943 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034cdc7e-dbe5-4e73-b1f1-59dc9d600a8c None admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:32.665888 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034cdc7e-dbe5-4e73-b1f1-59dc9d600a8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:32.666360 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034cdc7e-dbe5-4e73-b1f1-59dc9d600a8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:32.667908 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034cdc7e-dbe5-4e73-b1f1-59dc9d600a8c None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:32.672787 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-d3556073-4de7-40d6-8ac8-e3bdecb5514b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 17 18:04:32.672787 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:32.672787 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:32.672787 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:32.672787 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:32.672787 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:32.672787 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:32.672787 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:32.672787 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:32.672787 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:32.672787 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:32.672787 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:32.672787 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 18:04:32.672787 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 18:04:32.672787 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 18:04:32.672787 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 18:04:32.673937 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:32.673937 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:32.673937 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 18:04:32.673937 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:04:32.673937 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 18:04:32.673937 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:04:32.673937 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:32.673937 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:32.673937 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:32.673937 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:32.673937 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:32.673937 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:32.673937 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:32.673937 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:32.673937 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:32.673937 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:32.673937 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:32.673937 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:32.675014 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:32.675014 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:32.675014 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 18:04:32.675014 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 18:04:32.675014 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 18:04:32.675014 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 18:04:32.675014 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 18:04:32.675014 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 18:04:32.675014 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 17 18:04:32.675014 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:32.675014 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 379/752] 10.222.0.65 () {56 vars in 1093 bytes} [Tue May 17 18:04:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:32.675014 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3556073-4de7-40d6-8ac8-e3bdecb5514b None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:32.693063 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 374/753] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 17 18:04:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:32.694209 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034cdc7e-dbe5-4e73-b1f1-59dc9d600a8c None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:32.772361 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3556073-4de7-40d6-8ac8-e3bdecb5514b None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:32.792601 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034cdc7e-dbe5-4e73-b1f1-59dc9d600a8c None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:32.806299 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d867cab-09e9-46dc-9c1f-2e5bba72d0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:32.807294 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d867cab-09e9-46dc-9c1f-2e5bba72d0ad None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:32.807294 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d867cab-09e9-46dc-9c1f-2e5bba72d0ad None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:32.807487 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d867cab-09e9-46dc-9c1f-2e5bba72d0ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:32.829425 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ade776-b542-4447-bb70-1dbcf40b03fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:32.833422 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ade776-b542-4447-bb70-1dbcf40b03fb None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:32.833916 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ade776-b542-4447-bb70-1dbcf40b03fb None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:32.834364 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ade776-b542-4447-bb70-1dbcf40b03fb None admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:32.835382 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ade776-b542-4447-bb70-1dbcf40b03fb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:32.836391 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ade776-b542-4447-bb70-1dbcf40b03fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:32.838121 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ade776-b542-4447-bb70-1dbcf40b03fb None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:32.863905 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 375/754] 10.222.0.65 () {56 vars in 1133 bytes} [Tue May 17 18:04:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:32.865133 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ade776-b542-4447-bb70-1dbcf40b03fb None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:32.879375 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d867cab-09e9-46dc-9c1f-2e5bba72d0ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:32.880833 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d867cab-09e9-46dc-9c1f-2e5bba72d0ad None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:32.971091 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ade776-b542-4447-bb70-1dbcf40b03fb None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:33.003279 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 380/755] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 17 18:04:32 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 18:04:33.004399 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d867cab-09e9-46dc-9c1f-2e5bba72d0ad None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:33.005572 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d7025f-2835-4cc2-8357-ad5598587f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:33.006489 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7025f-2835-4cc2-8357-ad5598587f5a None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:33.006963 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7025f-2835-4cc2-8357-ad5598587f5a None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:33.007676 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d7025f-2835-4cc2-8357-ad5598587f5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:33.008699 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d7025f-2835-4cc2-8357-ad5598587f5a None admin] RBAC: Adding query filter params (role.id=332c8d70fd0f41e2beea20aaead5daa5, scope.project.id=0cf165918c1f46cb96d4b54409862659, user.id=1464e84a3a2d4321a98b98d398bc7be3) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:33.009208 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d7025f-2835-4cc2-8357-ad5598587f5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:33.010889 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d7025f-2835-4cc2-8357-ad5598587f5a None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:33.025858 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 376/756] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 17 18:04:32 2022] GET /identity/v3/role_assignments?user.id=1464e84a3a2d4321a98b98d398bc7be3&scope.project.id=0cf165918c1f46cb96d4b54409862659&role.id=332c8d70fd0f41e2beea20aaead5daa5 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:33.027183 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d7025f-2835-4cc2-8357-ad5598587f5a None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:33.119084 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d867cab-09e9-46dc-9c1f-2e5bba72d0ad None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:33.159509 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9aa539-45f6-48e8-839f-ab49250039fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:33.160317 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9aa539-45f6-48e8-839f-ab49250039fc None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:33.160597 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9aa539-45f6-48e8-839f-ab49250039fc None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:33.160872 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9aa539-45f6-48e8-839f-ab49250039fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:33.174392 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9aa539-45f6-48e8-839f-ab49250039fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:33.176394 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9aa539-45f6-48e8-839f-ab49250039fc None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:33.198042 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-fb9aa539-45f6-48e8-839f-ab49250039fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:33.198042 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:33.198042 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:33.198042 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:33.198042 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:33.198042 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:33.198042 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:33.198042 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:33.198042 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:33.198042 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:33.198042 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:33.198042 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:33.198042 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:04:33.198042 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:04:33.198042 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:04:33.199004 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:04:33.199004 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:33.199004 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:33.199004 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:33.199004 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:33.199004 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:33.199004 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:33.199004 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:33.199004 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:33.199004 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:33.199004 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:33.199004 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:33.199004 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:33.199004 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:33.199004 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:33.199004 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:33.199004 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:33.199898 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:04:33.199898 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:04:33.199898 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:33.199898 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:33.199898 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 381/757] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:04:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:33.206527 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9aa539-45f6-48e8-839f-ab49250039fc None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:33.259417 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d7025f-2835-4cc2-8357-ad5598587f5a None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:33.323552 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9aa539-45f6-48e8-839f-ab49250039fc None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:33.331664 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3807ee8b-e722-4054-9411-4fa36012719a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:33.332814 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807ee8b-e722-4054-9411-4fa36012719a None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:33.333295 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807ee8b-e722-4054-9411-4fa36012719a None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:33.333808 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807ee8b-e722-4054-9411-4fa36012719a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:33.359315 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3807ee8b-e722-4054-9411-4fa36012719a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:33.361188 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3807ee8b-e722-4054-9411-4fa36012719a None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:33.362919 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852fa17-575b-4b60-a086-2cff8e614eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:33.363591 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852fa17-575b-4b60-a086-2cff8e614eed None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:33.363873 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852fa17-575b-4b60-a086-2cff8e614eed None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:33.364151 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852fa17-575b-4b60-a086-2cff8e614eed None admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:33.365095 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4852fa17-575b-4b60-a086-2cff8e614eed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:33.365401 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4852fa17-575b-4b60-a086-2cff8e614eed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:33.367135 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4852fa17-575b-4b60-a086-2cff8e614eed None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:33.382569 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-3807ee8b-e722-4054-9411-4fa36012719a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:33.382569 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:33.382569 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:33.382569 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:33.382569 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:33.382569 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:33.382569 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:33.382569 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:33.382569 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:33.382569 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:33.382569 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:33.382569 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:33.382569 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:04:33.382569 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:04:33.382569 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:04:33.383485 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:04:33.383485 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:33.383485 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:33.383485 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:33.383485 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:33.383485 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:33.383485 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:33.383485 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:33.383485 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:33.383485 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:33.383485 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:33.383485 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:33.383485 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:33.383485 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:33.383485 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:33.383485 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:33.383485 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:33.384403 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:04:33.384403 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:04:33.384403 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:33.384403 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:33.385042 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 382/758] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:04:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:33.385687 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852fa17-575b-4b60-a086-2cff8e614eed None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:33.386997 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 377/759] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:04:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:33.393030 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3807ee8b-e722-4054-9411-4fa36012719a None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:33.500218 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852fa17-575b-4b60-a086-2cff8e614eed None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:33.538277 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e7419-39ac-4aa2-bbba-270f9c9a7345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:33.538994 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e7419-39ac-4aa2-bbba-270f9c9a7345 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:33.539275 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e7419-39ac-4aa2-bbba-270f9c9a7345 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:33.539553 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e7419-39ac-4aa2-bbba-270f9c9a7345 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:33.547881 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0e7419-39ac-4aa2-bbba-270f9c9a7345 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:33.549342 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0e7419-39ac-4aa2-bbba-270f9c9a7345 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:33.565940 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-4d0e7419-39ac-4aa2-bbba-270f9c9a7345 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:04:33.565940 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:33.565940 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:33.565940 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:33.565940 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:33.565940 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:33.565940 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:33.565940 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:33.565940 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:33.565940 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:33.565940 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:33.565940 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:33.565940 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 18:04:33.565940 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 18:04:33.565940 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 18:04:33.566905 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 18:04:33.566905 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:33.566905 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:33.566905 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:33.566905 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:33.566905 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:33.566905 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:33.566905 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:33.566905 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:33.566905 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:33.566905 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:33.566905 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:33.566905 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:33.566905 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:33.566905 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:33.566905 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:33.566905 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:33.568052 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 18:04:33.568052 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 18:04:33.568052 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 18:04:33.568052 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 18:04:33.568052 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 18:04:33.568052 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 18:04:33.568052 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:04:33.568052 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:33.568052 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 383/760] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 17 18:04:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:33.577015 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e7419-39ac-4aa2-bbba-270f9c9a7345 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:33.596340 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3807ee8b-e722-4054-9411-4fa36012719a None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:33.666237 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef226fa4-aa96-4a96-b739-2f6a4ac662ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:33.667025 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef226fa4-aa96-4a96-b739-2f6a4ac662ef None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:33.667202 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef226fa4-aa96-4a96-b739-2f6a4ac662ef None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:33.667393 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef226fa4-aa96-4a96-b739-2f6a4ac662ef None admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:33.668116 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef226fa4-aa96-4a96-b739-2f6a4ac662ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:33.668420 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef226fa4-aa96-4a96-b739-2f6a4ac662ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:33.670492 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef226fa4-aa96-4a96-b739-2f6a4ac662ef None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:33.684142 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e7419-39ac-4aa2-bbba-270f9c9a7345 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:33.688599 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 378/761] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:04:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:33.698702 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef226fa4-aa96-4a96-b739-2f6a4ac662ef None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:33.724989 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8416c3c7-e651-451a-be5f-d85040875814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:33.725673 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416c3c7-e651-451a-be5f-d85040875814 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:33.725961 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416c3c7-e651-451a-be5f-d85040875814 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:33.726236 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416c3c7-e651-451a-be5f-d85040875814 None admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:33.727021 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8416c3c7-e651-451a-be5f-d85040875814 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:33.727326 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8416c3c7-e651-451a-be5f-d85040875814 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:33.728749 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8416c3c7-e651-451a-be5f-d85040875814 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:33.751906 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 384/762] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 17 18:04:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:33.758923 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8416c3c7-e651-451a-be5f-d85040875814 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:33.916254 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef226fa4-aa96-4a96-b739-2f6a4ac662ef None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:33.942778 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8416c3c7-e651-451a-be5f-d85040875814 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:33.977587 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f13b502-7760-4560-a4ff-b5f35d361e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:33.978907 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13b502-7760-4560-a4ff-b5f35d361e60 None admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:33.979423 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13b502-7760-4560-a4ff-b5f35d361e60 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:33.979897 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13b502-7760-4560-a4ff-b5f35d361e60 None admin] PATH_INFO: `/v3/projects/0cf165918c1f46cb96d4b54409862659/users/5b430b739cb54fc7911bc89f8ea2df72/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:33.982632 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f13b502-7760-4560-a4ff-b5f35d361e60 None admin] RBAC: Authorizing `identity:create_grant(project_id=0cf165918c1f46cb96d4b54409862659, user_id=5b430b739cb54fc7911bc89f8ea2df72, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:33.984311 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f13b502-7760-4560-a4ff-b5f35d361e60 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:33.994312 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea4f56-9f13-43c3-841b-c8d53226e429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:34.001846 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea4f56-9f13-43c3-841b-c8d53226e429 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:34.003782 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea4f56-9f13-43c3-841b-c8d53226e429 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:34.004342 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea4f56-9f13-43c3-841b-c8d53226e429 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:34.005495 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 385/763] 10.222.0.65 () {58 vars in 1439 bytes} [Tue May 17 18:04:33 2022] PUT /identity/v3/projects/0cf165918c1f46cb96d4b54409862659/users/5b430b739cb54fc7911bc89f8ea2df72/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:04:34.007230 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79266e-52e0-4cf7-a228-910f97898fb6 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:34.009108 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79266e-52e0-4cf7-a228-910f97898fb6 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:34.010692 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79266e-52e0-4cf7-a228-910f97898fb6 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:34.012526 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 386/764] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:04:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:04:34.016090 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dea4f56-9f13-43c3-841b-c8d53226e429 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:34.017934 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dea4f56-9f13-43c3-841b-c8d53226e429 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:34.018846 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804bb21f-445b-4b5d-bbb5-315e38945556 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:34.019206 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804bb21f-445b-4b5d-bbb5-315e38945556 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:34.019484 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804bb21f-445b-4b5d-bbb5-315e38945556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:34.055700 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-3dea4f56-9f13-43c3-841b-c8d53226e429 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:04:34.055700 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:34.055700 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:34.055700 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:34.055700 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:34.055700 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:34.055700 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:34.055700 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:34.055700 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:34.055700 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:34.055700 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:34.055700 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:34.055700 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 18:04:34.055700 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 18:04:34.055700 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 18:04:34.056724 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 18:04:34.056724 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:34.056724 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:34.056724 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:34.056724 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:34.056724 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:34.056724 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:34.056724 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:34.056724 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:34.056724 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:34.056724 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:34.056724 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:34.056724 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:34.056724 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:34.056724 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:34.056724 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:34.056724 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:34.057671 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 18:04:34.057671 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 18:04:34.057671 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 18:04:34.057671 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 18:04:34.057671 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 18:04:34.057671 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 18:04:34.057671 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:04:34.057671 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:34.062249 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 379/765] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 17 18:04:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:34.063566 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-804bb21f-445b-4b5d-bbb5-315e38945556 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:34.064993 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-804bb21f-445b-4b5d-bbb5-315e38945556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:34.067978 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea4f56-9f13-43c3-841b-c8d53226e429 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:34.143197 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 387/766] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:04:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 18:04:34.186628 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804bb21f-445b-4b5d-bbb5-315e38945556 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:34.257193 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea4f56-9f13-43c3-841b-c8d53226e429 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:34.293227 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89aa2bf-1013-477d-a944-f997535ddcd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:34.293922 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89aa2bf-1013-477d-a944-f997535ddcd6 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:34.294196 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89aa2bf-1013-477d-a944-f997535ddcd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:34.294496 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89aa2bf-1013-477d-a944-f997535ddcd6 None admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:34.295333 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89aa2bf-1013-477d-a944-f997535ddcd6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:34.295641 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89aa2bf-1013-477d-a944-f997535ddcd6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:34.297083 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89aa2bf-1013-477d-a944-f997535ddcd6 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:34.304933 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804bb21f-445b-4b5d-bbb5-315e38945556 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:34.310367 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 380/767] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 17 18:04:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:04:34.316309 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89aa2bf-1013-477d-a944-f997535ddcd6 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:34.470302 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ffc9b6-f284-4201-a03d-b398c4835e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:34.471499 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ffc9b6-f284-4201-a03d-b398c4835e41 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:34.471986 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ffc9b6-f284-4201-a03d-b398c4835e41 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:34.472479 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ffc9b6-f284-4201-a03d-b398c4835e41 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:34.473356 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ffc9b6-f284-4201-a03d-b398c4835e41 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:34.474983 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ffc9b6-f284-4201-a03d-b398c4835e41 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:34.488907 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-28ffc9b6-f284-4201-a03d-b398c4835e41 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 17 18:04:34.488907 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:34.488907 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 18:04:34.488907 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 18:04:34.488907 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 18:04:34.488907 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 18:04:34.488907 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 18:04:34.488907 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:04:34.488907 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 17 18:04:34.488907 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:34.488907 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 18:04:34.488907 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:34.488907 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:34.488907 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:34.488907 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:34.488907 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:34.489964 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:34.489964 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:34.489964 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:34.489964 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:34.489964 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:34.489964 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:34.489964 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:34.489964 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 18:04:34.489964 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 18:04:34.489964 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 18:04:34.489964 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 18:04:34.489964 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:34.489964 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:34.489964 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:34.489964 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:34.489964 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:34.490798 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:34.490798 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:34.490798 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:34.490798 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:34.490798 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:34.490798 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:34.490798 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:34.490798 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:34.490798 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:34.490798 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:34.490798 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:34.490798 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 18:04:34.490798 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:04:34.490798 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 17 18:04:34.490798 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:34.493839 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 388/768] 10.222.0.65 () {56 vars in 1129 bytes} [Tue May 17 18:04:34 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:04:34.501856 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ffc9b6-f284-4201-a03d-b398c4835e41 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:34.597230 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89aa2bf-1013-477d-a944-f997535ddcd6 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:34.665858 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638eac00-ff31-4550-bd39-c19f7820f8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:34.666823 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638eac00-ff31-4550-bd39-c19f7820f8cb None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:34.667686 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638eac00-ff31-4550-bd39-c19f7820f8cb None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:34.668100 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638eac00-ff31-4550-bd39-c19f7820f8cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:34.669087 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638eac00-ff31-4550-bd39-c19f7820f8cb None admin] RBAC: Adding query filter params (role.id=60e39e2185d346a192b8698767df6018, scope.project.id=0cf165918c1f46cb96d4b54409862659, user.id=f370e353067848b5843c5650183be347) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:34.670150 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638eac00-ff31-4550-bd39-c19f7820f8cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:34.671774 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638eac00-ff31-4550-bd39-c19f7820f8cb None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:34.678258 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 381/769] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 17 18:04:34 2022] GET /identity/v3/role_assignments?user.id=f370e353067848b5843c5650183be347&scope.project.id=0cf165918c1f46cb96d4b54409862659&role.id=60e39e2185d346a192b8698767df6018 => generated 259 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:04:34.713883 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ffc9b6-f284-4201-a03d-b398c4835e41 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:34.757242 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0556d47a-522f-4dd3-a982-6372c1c6af06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:34.757877 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556d47a-522f-4dd3-a982-6372c1c6af06 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:34.758156 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556d47a-522f-4dd3-a982-6372c1c6af06 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:34.758426 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556d47a-522f-4dd3-a982-6372c1c6af06 None admin] PATH_INFO: `/v3/services` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:34.759143 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0556d47a-522f-4dd3-a982-6372c1c6af06 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:34.759444 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0556d47a-522f-4dd3-a982-6372c1c6af06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:34.760839 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0556d47a-522f-4dd3-a982-6372c1c6af06 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:34.766997 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 389/770] 10.222.0.65 () {56 vars in 1124 bytes} [Tue May 17 18:04:34 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:34.772499 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638eac00-ff31-4550-bd39-c19f7820f8cb None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:34.901398 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99496850-a75f-438f-9193-46633fdc536b None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:34.901695 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99496850-a75f-438f-9193-46633fdc536b None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:34.901978 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99496850-a75f-438f-9193-46633fdc536b None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:34.903586 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 390/771] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:04:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:04:34.909733 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca237f-dec2-49ec-b027-dbe0ce9badd8 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:34.910017 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca237f-dec2-49ec-b027-dbe0ce9badd8 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:34.910287 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca237f-dec2-49ec-b027-dbe0ce9badd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:34.917006 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638eac00-ff31-4550-bd39-c19f7820f8cb None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:34.927637 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-d5ca237f-dec2-49ec-b027-dbe0ce9badd8 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:34.928430 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-d5ca237f-dec2-49ec-b027-dbe0ce9badd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:34.959104 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fac12a-bddc-4e1e-8ba1-a32b220c19e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:34.960136 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fac12a-bddc-4e1e-8ba1-a32b220c19e4 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:34.960618 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fac12a-bddc-4e1e-8ba1-a32b220c19e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:34.961089 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fac12a-bddc-4e1e-8ba1-a32b220c19e4 None admin] PATH_INFO: `/v3/services` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:34.962034 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fac12a-bddc-4e1e-8ba1-a32b220c19e4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:34.962813 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fac12a-bddc-4e1e-8ba1-a32b220c19e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:34.964363 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fac12a-bddc-4e1e-8ba1-a32b220c19e4 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:34.972271 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 382/772] 10.222.0.65 () {56 vars in 1124 bytes} [Tue May 17 18:04:34 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:34.979943 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fac12a-bddc-4e1e-8ba1-a32b220c19e4 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:35.072148 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 391/773] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:04:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 18:04:35.095862 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fac12a-bddc-4e1e-8ba1-a32b220c19e4 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:35.111095 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca237f-dec2-49ec-b027-dbe0ce9badd8 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:35.137213 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee772f01-ae87-4cb0-83a7-65aa8b28eced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:35.138206 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee772f01-ae87-4cb0-83a7-65aa8b28eced None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:35.139016 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee772f01-ae87-4cb0-83a7-65aa8b28eced None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:35.139435 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee772f01-ae87-4cb0-83a7-65aa8b28eced None admin] PATH_INFO: `/v3/endpoints` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:35.140362 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee772f01-ae87-4cb0-83a7-65aa8b28eced None admin] RBAC: Adding query filter params (interface=public, service_id=98c9f8255e1745d2bb6cfbe8746afa42, region_id=RegionOne) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:35.140840 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee772f01-ae87-4cb0-83a7-65aa8b28eced None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:35.142615 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee772f01-ae87-4cb0-83a7-65aa8b28eced None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:35.151629 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 383/774] 10.222.0.65 () {56 vars in 1251 bytes} [Tue May 17 18:04:34 2022] GET /identity/v3/endpoints?service_id=98c9f8255e1745d2bb6cfbe8746afa42&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:35.158567 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee772f01-ae87-4cb0-83a7-65aa8b28eced None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:35.265013 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee772f01-ae87-4cb0-83a7-65aa8b28eced None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:35.303232 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac570e6-edaa-4f67-81b0-604c2356ccb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:35.304136 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac570e6-edaa-4f67-81b0-604c2356ccb8 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:35.304559 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac570e6-edaa-4f67-81b0-604c2356ccb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:35.304993 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac570e6-edaa-4f67-81b0-604c2356ccb8 None admin] PATH_INFO: `/v3/services` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:35.305988 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac570e6-edaa-4f67-81b0-604c2356ccb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:35.307676 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac570e6-edaa-4f67-81b0-604c2356ccb8 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:35.313865 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 384/775] 10.222.0.65 () {56 vars in 1087 bytes} [Tue May 17 18:04:35 2022] GET /identity/v3/services => generated 772 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:04:35.361876 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca237f-dec2-49ec-b027-dbe0ce9badd8 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:35.419186 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f67c97-76e0-4338-8de2-afb35ba2e4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:35.420938 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f67c97-76e0-4338-8de2-afb35ba2e4c4 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:35.421411 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f67c97-76e0-4338-8de2-afb35ba2e4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:35.421914 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f67c97-76e0-4338-8de2-afb35ba2e4c4 None admin] PATH_INFO: `/v3/services/network` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:35.422756 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f67c97-76e0-4338-8de2-afb35ba2e4c4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:35.424308 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f67c97-76e0-4338-8de2-afb35ba2e4c4 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:35.441581 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-82f67c97-76e0-4338-8de2-afb35ba2e4c4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 17 18:04:35.441581 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:35.441581 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 18:04:35.441581 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 18:04:35.441581 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 18:04:35.441581 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 18:04:35.441581 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 18:04:35.441581 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:04:35.441581 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 17 18:04:35.441581 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:35.441581 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 18:04:35.441581 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:35.441581 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:35.441581 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:35.441581 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:35.441581 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:35.441581 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:35.442877 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:35.442877 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:35.442877 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:35.442877 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:35.442877 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:35.442877 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:35.442877 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 18:04:35.442877 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 18:04:35.442877 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 18:04:35.442877 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 18:04:35.442877 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:35.442877 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:35.442877 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:35.442877 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:35.442877 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:35.442877 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:35.443806 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:35.443806 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:35.443806 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:35.443806 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:35.443806 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:35.443806 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:35.443806 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:35.443806 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:35.443806 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:35.443806 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:35.443806 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 18:04:35.443806 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:04:35.443806 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 17 18:04:35.443806 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:35.451229 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 392/776] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 17 18:04:35 2022] GET /identity/v3/services/network => generated 88 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:04:35.456998 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac570e6-edaa-4f67-81b0-604c2356ccb8 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:35.565255 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac570e6-edaa-4f67-81b0-604c2356ccb8 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:35.601695 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc43464-3f09-4052-aad5-bc0d4ff7eb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:35.602763 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc43464-3f09-4052-aad5-bc0d4ff7eb1d None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:35.603252 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc43464-3f09-4052-aad5-bc0d4ff7eb1d None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:35.603723 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc43464-3f09-4052-aad5-bc0d4ff7eb1d None admin] PATH_INFO: `/v3/services` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:35.604677 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc43464-3f09-4052-aad5-bc0d4ff7eb1d None admin] RBAC: Adding query filter params (name=network) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:35.605198 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc43464-3f09-4052-aad5-bc0d4ff7eb1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:35.607430 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc43464-3f09-4052-aad5-bc0d4ff7eb1d None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:35.613312 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 385/777] 10.222.0.65 () {56 vars in 1112 bytes} [Tue May 17 18:04:35 2022] GET /identity/v3/services?name=network => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:35.619463 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f67c97-76e0-4338-8de2-afb35ba2e4c4 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:35.724066 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f67c97-76e0-4338-8de2-afb35ba2e4c4 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:35.759010 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9533f514-fb71-4f81-9435-1c922904f737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:35.760053 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533f514-fb71-4f81-9435-1c922904f737 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:35.760528 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533f514-fb71-4f81-9435-1c922904f737 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:35.760995 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533f514-fb71-4f81-9435-1c922904f737 None admin] PATH_INFO: `/v3/services` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:35.761952 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9533f514-fb71-4f81-9435-1c922904f737 None admin] RBAC: Adding query filter params (type=network) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:35.762452 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9533f514-fb71-4f81-9435-1c922904f737 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:35.764042 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9533f514-fb71-4f81-9435-1c922904f737 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:35.769583 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 393/778] 10.222.0.65 () {56 vars in 1112 bytes} [Tue May 17 18:04:35 2022] GET /identity/v3/services?type=network => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:35.777500 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc43464-3f09-4052-aad5-bc0d4ff7eb1d None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:35.812283 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d946a0-e57e-4412-b100-852cb411463f None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:35.812608 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d946a0-e57e-4412-b100-852cb411463f None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:35.812838 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d946a0-e57e-4412-b100-852cb411463f None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:35.814233 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 394/779] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:04:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 18:04:35.822758 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b403a-bc70-4b2b-b901-361ba0fe8ac8 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:35.823042 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b403a-bc70-4b2b-b901-361ba0fe8ac8 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:35.823319 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224b403a-bc70-4b2b-b901-361ba0fe8ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:35.858467 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-224b403a-bc70-4b2b-b901-361ba0fe8ac8 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:35.859651 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-224b403a-bc70-4b2b-b901-361ba0fe8ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:35.897165 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc43464-3f09-4052-aad5-bc0d4ff7eb1d None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:35.934823 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed03f55-f684-483a-9cc9-fe6a60755a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:35.937497 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed03f55-f684-483a-9cc9-fe6a60755a0b None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:35.938248 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed03f55-f684-483a-9cc9-fe6a60755a0b None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:35.938728 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed03f55-f684-483a-9cc9-fe6a60755a0b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:35.939792 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed03f55-f684-483a-9cc9-fe6a60755a0b None admin] RBAC: Adding query filter params (interface=public, service_id=73411675eee3405aae79b927dac0a719, region_id=RegionOne) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:35.940309 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed03f55-f684-483a-9cc9-fe6a60755a0b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:35.941965 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed03f55-f684-483a-9cc9-fe6a60755a0b None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:35.949287 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 386/780] 10.222.0.65 () {56 vars in 1251 bytes} [Tue May 17 18:04:35 2022] GET /identity/v3/endpoints?service_id=73411675eee3405aae79b927dac0a719&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:35.963076 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed03f55-f684-483a-9cc9-fe6a60755a0b None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:36.011938 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 395/781] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:04:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:04:36.054824 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224b403a-bc70-4b2b-b901-361ba0fe8ac8 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:36.073934 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed03f55-f684-483a-9cc9-fe6a60755a0b None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:36.115319 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b0dee-6e09-4fc4-88ab-e21cde71b635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:36.115985 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b0dee-6e09-4fc4-88ab-e21cde71b635 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:36.116265 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b0dee-6e09-4fc4-88ab-e21cde71b635 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:36.116537 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3b0dee-6e09-4fc4-88ab-e21cde71b635 None admin] PATH_INFO: `/v3/services` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:36.117214 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3b0dee-6e09-4fc4-88ab-e21cde71b635 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:36.118611 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3b0dee-6e09-4fc4-88ab-e21cde71b635 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:36.138849 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 387/782] 10.222.0.65 () {56 vars in 1087 bytes} [Tue May 17 18:04:35 2022] GET /identity/v3/services => generated 772 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:36.224071 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224b403a-bc70-4b2b-b901-361ba0fe8ac8 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:36.265322 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e365151-6b23-416d-82cd-aa85939cb872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:36.266506 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e365151-6b23-416d-82cd-aa85939cb872 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:36.266983 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e365151-6b23-416d-82cd-aa85939cb872 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:36.267468 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e365151-6b23-416d-82cd-aa85939cb872 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:36.283690 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e365151-6b23-416d-82cd-aa85939cb872 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:04:36.291764 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-9e365151-6b23-416d-82cd-aa85939cb872 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:04:36.291764 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:36.291764 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:36.291764 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:36.291764 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:36.291764 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:36.291764 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:36.291764 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:36.291764 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:36.291764 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:36.291764 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:36.291764 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:36.291764 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:04:36.291764 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:04:36.291764 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:04:36.291764 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:04:36.292784 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:04:36.292784 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:04:36.292784 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:04:36.292784 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:04:36.292784 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:36.292784 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:36.292784 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:36.292784 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:36.292784 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:36.292784 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:36.292784 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:36.292784 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:36.292784 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:36.292784 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:36.292784 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:36.292784 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:36.293662 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:36.293662 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:36.293662 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:36.293662 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:36.293662 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:04:36.293662 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:04:36.293662 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:04:36.293662 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:04:36.293662 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:04:36.293662 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:04:36.293662 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:04:36.293662 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:36.296509 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 396/783] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 17 18:04:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:36.305159 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b0dee-6e09-4fc4-88ab-e21cde71b635 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:36.431533 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3b0dee-6e09-4fc4-88ab-e21cde71b635 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:36.471864 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda657d-d755-4128-917f-32ff7d328216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:36.472540 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda657d-d755-4128-917f-32ff7d328216 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:36.472820 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda657d-d755-4128-917f-32ff7d328216 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:36.473090 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda657d-d755-4128-917f-32ff7d328216 None admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:36.473870 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dda657d-d755-4128-917f-32ff7d328216 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:36.474225 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dda657d-d755-4128-917f-32ff7d328216 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:36.475544 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dda657d-d755-4128-917f-32ff7d328216 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:36.485031 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 388/784] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 17 18:04:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:36.490478 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e365151-6b23-416d-82cd-aa85939cb872 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:36.648504 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e365151-6b23-416d-82cd-aa85939cb872 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:36.694800 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9283b1-1e2c-4a0d-b7e1-3c4ae95be2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:36.695593 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9283b1-1e2c-4a0d-b7e1-3c4ae95be2e6 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:36.695873 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9283b1-1e2c-4a0d-b7e1-3c4ae95be2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:36.696149 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9283b1-1e2c-4a0d-b7e1-3c4ae95be2e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:36.713904 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9283b1-1e2c-4a0d-b7e1-3c4ae95be2e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:36.715413 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9283b1-1e2c-4a0d-b7e1-3c4ae95be2e6 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:36.738876 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-6e9283b1-1e2c-4a0d-b7e1-3c4ae95be2e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:36.738876 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:36.738876 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:36.738876 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:36.738876 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:36.738876 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:36.738876 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:36.738876 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:36.738876 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:36.738876 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:36.738876 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:36.738876 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:36.738876 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:04:36.738876 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:04:36.738876 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:04:36.740245 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:04:36.740245 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:36.740245 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:36.740245 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:36.740245 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:36.740245 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:36.740245 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:36.740245 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:36.740245 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:36.740245 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:36.740245 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:36.740245 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:36.740245 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:36.740245 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:36.740245 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:36.740245 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:36.740245 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:36.741121 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:04:36.741121 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:04:36.741121 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:36.741121 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:36.741121 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 397/785] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:04:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:36.745905 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda657d-d755-4128-917f-32ff7d328216 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:36.899614 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dda657d-d755-4128-917f-32ff7d328216 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:36.946233 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e2c12-e7a3-4bcb-9788-6fbd4ffa7ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:36.947108 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e2c12-e7a3-4bcb-9788-6fbd4ffa7ed9 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:36.947405 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e2c12-e7a3-4bcb-9788-6fbd4ffa7ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:36.947684 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e2c12-e7a3-4bcb-9788-6fbd4ffa7ed9 None admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:36.948423 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e2c12-e7a3-4bcb-9788-6fbd4ffa7ed9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:36.948732 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e2c12-e7a3-4bcb-9788-6fbd4ffa7ed9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:36.950141 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e2c12-e7a3-4bcb-9788-6fbd4ffa7ed9 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:36.968030 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 389/786] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:04:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:36.973512 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9283b1-1e2c-4a0d-b7e1-3c4ae95be2e6 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:36.988838 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb647bc-2449-432e-93c8-919af221a573 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:36.989170 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb647bc-2449-432e-93c8-919af221a573 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:36.989394 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb647bc-2449-432e-93c8-919af221a573 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:36.990894 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 390/787] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:04:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 18:04:37.001114 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac47955-b2e1-4543-adc3-e3577f740ec8 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:37.001402 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac47955-b2e1-4543-adc3-e3577f740ec8 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:37.001704 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac47955-b2e1-4543-adc3-e3577f740ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:37.033290 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-dac47955-b2e1-4543-adc3-e3577f740ec8 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:37.034522 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-dac47955-b2e1-4543-adc3-e3577f740ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:37.150664 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9283b1-1e2c-4a0d-b7e1-3c4ae95be2e6 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:37.184604 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5147de-a3e4-4658-a9ab-409af6610979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:37.185550 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5147de-a3e4-4658-a9ab-409af6610979 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:37.185834 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5147de-a3e4-4658-a9ab-409af6610979 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:37.186111 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5147de-a3e4-4658-a9ab-409af6610979 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:37.194440 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5147de-a3e4-4658-a9ab-409af6610979 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:37.195795 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5147de-a3e4-4658-a9ab-409af6610979 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:37.196379 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 391/788] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:04:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:04:37.210356 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-7d5147de-a3e4-4658-a9ab-409af6610979 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 17 18:04:37.210356 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:37.210356 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:37.210356 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:37.210356 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:37.210356 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:37.210356 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:37.210356 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:37.210356 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:37.210356 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:37.210356 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:37.210356 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:37.210356 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 18:04:37.210356 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 18:04:37.210356 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 18:04:37.210356 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 18:04:37.211360 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:37.211360 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:37.211360 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 18:04:37.211360 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:04:37.211360 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 18:04:37.211360 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:04:37.211360 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:37.211360 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:37.211360 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:37.211360 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:37.211360 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:37.211360 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:37.211360 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:37.211360 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:37.211360 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:37.211360 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:37.211360 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:37.211360 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:37.212292 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:37.212292 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:37.212292 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 18:04:37.212292 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 18:04:37.212292 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 18:04:37.212292 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 18:04:37.212292 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 18:04:37.212292 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 18:04:37.212292 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 17 18:04:37.212292 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:37.212292 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 398/789] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 17 18:04:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:37.217091 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac47955-b2e1-4543-adc3-e3577f740ec8 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:37.223639 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5147de-a3e4-4658-a9ab-409af6610979 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:37.323830 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5147de-a3e4-4658-a9ab-409af6610979 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:37.357747 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36815eef-189c-4573-9947-bf79afb2c3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:37.358533 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36815eef-189c-4573-9947-bf79afb2c3c2 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:37.358814 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36815eef-189c-4573-9947-bf79afb2c3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:37.359089 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36815eef-189c-4573-9947-bf79afb2c3c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:37.369057 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36815eef-189c-4573-9947-bf79afb2c3c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:04:37.376631 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-36815eef-189c-4573-9947-bf79afb2c3c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:04:37.376631 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:37.376631 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:37.376631 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:37.376631 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:37.376631 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:37.376631 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:37.376631 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:37.376631 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:37.376631 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:37.376631 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:37.376631 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:37.376631 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:04:37.376631 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:04:37.376631 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:04:37.376631 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:04:37.377596 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:04:37.377596 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:04:37.377596 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:04:37.377596 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:04:37.377596 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:37.377596 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:37.377596 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:37.377596 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:37.377596 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:37.377596 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:37.377596 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:37.377596 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:37.377596 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:37.377596 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:37.377596 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:37.377596 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:37.378417 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:37.378417 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:37.378417 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:37.378417 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:37.378417 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:04:37.378417 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:04:37.378417 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:04:37.378417 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:04:37.378417 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:04:37.378417 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:04:37.378417 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:04:37.378417 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:37.378417 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 399/790] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 17 18:04:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:04:37.379089 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ac701-51ec-4680-96cb-9309524fe16e None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:37.379621 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ac701-51ec-4680-96cb-9309524fe16e None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:37.379621 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ac701-51ec-4680-96cb-9309524fe16e None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:37.381061 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 400/791] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:04:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:04:37.383576 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753ac701-51ec-4680-96cb-9309524fe16e None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:37.404308 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac47955-b2e1-4543-adc3-e3577f740ec8 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:37.446711 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45692d53-505b-4b4e-ad75-df987a94e71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:37.447645 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45692d53-505b-4b4e-ad75-df987a94e71d None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:37.447926 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45692d53-505b-4b4e-ad75-df987a94e71d None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:37.448348 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45692d53-505b-4b4e-ad75-df987a94e71d None admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:37.449528 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45692d53-505b-4b4e-ad75-df987a94e71d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:37.449983 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45692d53-505b-4b4e-ad75-df987a94e71d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:37.451555 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45692d53-505b-4b4e-ad75-df987a94e71d None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:37.471878 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 392/792] 10.222.0.65 () {56 vars in 1135 bytes} [Tue May 17 18:04:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:37.473225 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2056e4d-3831-4a97-830a-31baeba15aab None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:37.473612 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2056e4d-3831-4a97-830a-31baeba15aab None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:37.473954 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2056e4d-3831-4a97-830a-31baeba15aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:37.490684 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-b2056e4d-3831-4a97-830a-31baeba15aab None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:37.491999 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-b2056e4d-3831-4a97-830a-31baeba15aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:37.500578 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753ac701-51ec-4680-96cb-9309524fe16e None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:37.542205 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092aa6f8-5ab7-4376-ba8b-bdb641286e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:37.543140 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092aa6f8-5ab7-4376-ba8b-bdb641286e85 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:37.543421 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092aa6f8-5ab7-4376-ba8b-bdb641286e85 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:37.543700 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092aa6f8-5ab7-4376-ba8b-bdb641286e85 None admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:37.544679 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092aa6f8-5ab7-4376-ba8b-bdb641286e85 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:37.544986 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092aa6f8-5ab7-4376-ba8b-bdb641286e85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:37.546691 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092aa6f8-5ab7-4376-ba8b-bdb641286e85 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:37.561618 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 401/793] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 17 18:04:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:37.562475 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092aa6f8-5ab7-4376-ba8b-bdb641286e85 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:37.568279 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 393/794] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:04:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:04:37.569161 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2056e4d-3831-4a97-830a-31baeba15aab None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:37.695162 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092aa6f8-5ab7-4376-ba8b-bdb641286e85 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:37.700255 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2056e4d-3831-4a97-830a-31baeba15aab None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:37.740856 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d776e4-1e5b-40ca-b17f-46bd6bf5a757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:37.742032 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d776e4-1e5b-40ca-b17f-46bd6bf5a757 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:37.742316 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d776e4-1e5b-40ca-b17f-46bd6bf5a757 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:37.742590 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d776e4-1e5b-40ca-b17f-46bd6bf5a757 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:37.744908 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb98385-661e-4658-b76e-09bb120a781b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:37.745735 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb98385-661e-4658-b76e-09bb120a781b None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:37.746017 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb98385-661e-4658-b76e-09bb120a781b None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:37.746290 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb98385-661e-4658-b76e-09bb120a781b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:37.753646 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d776e4-1e5b-40ca-b17f-46bd6bf5a757 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:37.755302 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d776e4-1e5b-40ca-b17f-46bd6bf5a757 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:37.758012 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb98385-661e-4658-b76e-09bb120a781b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:37.759496 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb98385-661e-4658-b76e-09bb120a781b None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:37.775396 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-f7d776e4-1e5b-40ca-b17f-46bd6bf5a757 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:37.775396 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:37.775396 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:37.775396 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:37.775396 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:37.775396 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:37.775396 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:37.775396 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:37.775396 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:37.775396 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:37.775396 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:37.775396 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:37.775396 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:04:37.775396 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:04:37.775396 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:04:37.777365 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:04:37.777365 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:37.777365 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:37.777365 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:37.777365 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:37.777365 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:37.777365 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:37.777365 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:37.777365 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:37.777365 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:37.777365 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:37.777365 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:37.777365 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:37.777365 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:37.777365 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:37.777365 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:37.777365 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:37.779543 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:04:37.779543 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:04:37.779543 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:37.779543 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:37.780033 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-3cb98385-661e-4658-b76e-09bb120a781b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:37.780033 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:37.780033 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:37.780033 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:37.780033 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:37.780033 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:37.780033 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:37.780033 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:37.780033 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:37.780033 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:37.780033 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:37.780033 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:37.780033 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:04:37.780033 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:04:37.780033 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:04:37.781441 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:04:37.781441 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:37.781441 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:37.781441 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:37.781441 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:37.781441 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:37.781441 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:37.781441 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:37.781441 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:37.781441 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:37.781441 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:37.781441 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:37.781441 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:37.781441 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:37.781441 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:37.781441 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:37.781441 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:37.783125 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:04:37.783125 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:04:37.783125 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:37.783125 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:37.783125 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 394/795] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:04:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:37.783125 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb98385-661e-4658-b76e-09bb120a781b None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:37.789980 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 402/796] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:04:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:37.789980 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d776e4-1e5b-40ca-b17f-46bd6bf5a757 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:37.885579 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb98385-661e-4658-b76e-09bb120a781b None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:37.903334 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d776e4-1e5b-40ca-b17f-46bd6bf5a757 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:37.920259 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcacbdfb-bf87-4e97-bdee-80cf285b6313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:37.920964 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcacbdfb-bf87-4e97-bdee-80cf285b6313 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:37.921319 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcacbdfb-bf87-4e97-bdee-80cf285b6313 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:37.921696 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcacbdfb-bf87-4e97-bdee-80cf285b6313 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:37.933575 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcacbdfb-bf87-4e97-bdee-80cf285b6313 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:04:37.946448 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-fcacbdfb-bf87-4e97-bdee-80cf285b6313 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 18:04:37.946448 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:37.946448 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:37.946448 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:37.946448 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:37.946448 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:37.946448 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:37.946448 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:37.946448 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:37.946448 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:37.946448 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:37.946448 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:37.946448 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:04:37.946448 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:04:37.946448 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:04:37.946448 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:04:37.947448 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:04:37.947448 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:04:37.947448 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:04:37.947448 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:04:37.947448 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:37.947448 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:37.947448 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:37.947448 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:37.947448 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:37.947448 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:37.947448 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:37.947448 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:37.947448 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:37.947448 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:37.947448 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:37.947448 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:37.948720 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:37.948720 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:37.948720 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:37.948720 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:37.948720 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:04:37.948720 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:04:37.948720 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:04:37.948720 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:04:37.948720 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:04:37.948720 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:04:37.948720 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 18:04:37.948720 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:37.948720 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 395/797] 10.222.0.65 () {56 vars in 1102 bytes} [Tue May 17 18:04:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:37.948720 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcacbdfb-bf87-4e97-bdee-80cf285b6313 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:37.957954 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6bbe9e-ea8b-41b2-9484-41dc0207048d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:37.959105 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6bbe9e-ea8b-41b2-9484-41dc0207048d None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:37.959551 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6bbe9e-ea8b-41b2-9484-41dc0207048d None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:37.960036 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6bbe9e-ea8b-41b2-9484-41dc0207048d None admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:37.960951 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6bbe9e-ea8b-41b2-9484-41dc0207048d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:37.961407 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6bbe9e-ea8b-41b2-9484-41dc0207048d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:37.963000 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6bbe9e-ea8b-41b2-9484-41dc0207048d None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:37.980844 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 403/798] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:04:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:37.982086 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6bbe9e-ea8b-41b2-9484-41dc0207048d None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:38.058273 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcacbdfb-bf87-4e97-bdee-80cf285b6313 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:38.086170 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6bbe9e-ea8b-41b2-9484-41dc0207048d None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:38.093256 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1529582b-6fb8-4063-97a5-ecfbdc06dbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:38.093956 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529582b-6fb8-4063-97a5-ecfbdc06dbf8 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:38.094235 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529582b-6fb8-4063-97a5-ecfbdc06dbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:38.094559 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1529582b-6fb8-4063-97a5-ecfbdc06dbf8 None admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:38.095293 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1529582b-6fb8-4063-97a5-ecfbdc06dbf8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:38.095611 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1529582b-6fb8-4063-97a5-ecfbdc06dbf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:38.096974 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1529582b-6fb8-4063-97a5-ecfbdc06dbf8 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:38.114306 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 396/799] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:04:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:38.114306 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1529582b-6fb8-4063-97a5-ecfbdc06dbf8 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:38.132037 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b904525-3314-457f-bf84-fc95ba6f8092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:38.132707 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b904525-3314-457f-bf84-fc95ba6f8092 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:38.132987 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b904525-3314-457f-bf84-fc95ba6f8092 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:38.133259 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b904525-3314-457f-bf84-fc95ba6f8092 None admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:38.134050 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b904525-3314-457f-bf84-fc95ba6f8092 None admin] RBAC: Adding query filter params (name=service) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:38.134354 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b904525-3314-457f-bf84-fc95ba6f8092 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:38.135720 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b904525-3314-457f-bf84-fc95ba6f8092 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:38.143952 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 404/800] 10.222.0.65 () {56 vars in 1103 bytes} [Tue May 17 18:04:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:38.145578 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b904525-3314-457f-bf84-fc95ba6f8092 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:38.209370 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1529582b-6fb8-4063-97a5-ecfbdc06dbf8 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:38.243497 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d08e17d-23ab-4258-a6b3-ae30b48ff10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:38.244289 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d08e17d-23ab-4258-a6b3-ae30b48ff10d None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:38.244614 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d08e17d-23ab-4258-a6b3-ae30b48ff10d None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:38.244910 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d08e17d-23ab-4258-a6b3-ae30b48ff10d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:38.245836 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b904525-3314-457f-bf84-fc95ba6f8092 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:38.251861 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d08e17d-23ab-4258-a6b3-ae30b48ff10d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:38.253346 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d08e17d-23ab-4258-a6b3-ae30b48ff10d None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:38.267590 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-7d08e17d-23ab-4258-a6b3-ae30b48ff10d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:04:38.267590 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:38.267590 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:38.267590 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:38.267590 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:38.267590 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:38.267590 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:38.267590 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:38.267590 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:38.267590 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:38.267590 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:38.267590 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:38.267590 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 18:04:38.267590 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 18:04:38.267590 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 18:04:38.268552 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 18:04:38.268552 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:38.268552 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:38.268552 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:38.268552 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:38.268552 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:38.268552 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:38.268552 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:38.268552 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:38.268552 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:38.268552 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:38.268552 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:38.268552 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:38.268552 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:38.268552 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:38.268552 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:38.268552 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:38.269482 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 18:04:38.269482 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 18:04:38.269482 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 18:04:38.269482 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 18:04:38.269482 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 18:04:38.269482 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 18:04:38.269482 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:04:38.269482 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:38.269482 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 397/801] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 17 18:04:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:38.269992 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb1243-205c-413a-a694-f3f415d14e43 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:38.270557 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb1243-205c-413a-a694-f3f415d14e43 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:38.270557 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb1243-205c-413a-a694-f3f415d14e43 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:38.273749 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 398/802] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:04:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:04:38.274724 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb1243-205c-413a-a694-f3f415d14e43 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:38.287215 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b336bc-50b8-4aee-9fbf-d1d2741d8335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:38.288003 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b336bc-50b8-4aee-9fbf-d1d2741d8335 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:38.288282 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b336bc-50b8-4aee-9fbf-d1d2741d8335 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:38.288583 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b336bc-50b8-4aee-9fbf-d1d2741d8335 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:38.296759 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b336bc-50b8-4aee-9fbf-d1d2741d8335 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:38.298236 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b336bc-50b8-4aee-9fbf-d1d2741d8335 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:38.312155 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-a1b336bc-50b8-4aee-9fbf-d1d2741d8335 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 17 18:04:38.312155 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:38.312155 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:38.312155 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:38.312155 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:38.312155 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:38.312155 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:38.312155 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:38.312155 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:38.312155 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:38.312155 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:38.312155 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:38.312155 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 18:04:38.312155 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 18:04:38.312155 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 18:04:38.312155 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 18:04:38.313121 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:38.313121 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:38.313121 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 18:04:38.313121 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:04:38.313121 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 18:04:38.313121 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:04:38.313121 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:38.313121 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:38.313121 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:38.313121 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:38.313121 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:38.313121 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:38.313121 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:38.313121 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:38.313121 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:38.313121 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:38.313121 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:38.313121 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:38.314133 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:38.314133 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:38.314133 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 18:04:38.314133 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 18:04:38.314133 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 18:04:38.314133 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 18:04:38.314133 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 18:04:38.314133 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 18:04:38.314133 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 17 18:04:38.314133 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:38.318272 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 405/803] 10.222.0.65 () {56 vars in 1093 bytes} [Tue May 17 18:04:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:38.318895 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b336bc-50b8-4aee-9fbf-d1d2741d8335 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:38.375547 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb1243-205c-413a-a694-f3f415d14e43 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:38.408509 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3288ba4-731b-496e-a09d-b9ae366d44f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:38.409298 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3288ba4-731b-496e-a09d-b9ae366d44f3 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:38.409600 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3288ba4-731b-496e-a09d-b9ae366d44f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:38.409871 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3288ba4-731b-496e-a09d-b9ae366d44f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:38.421621 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3288ba4-731b-496e-a09d-b9ae366d44f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:38.422552 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b336bc-50b8-4aee-9fbf-d1d2741d8335 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:38.423404 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3288ba4-731b-496e-a09d-b9ae366d44f3 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:38.440520 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-f3288ba4-731b-496e-a09d-b9ae366d44f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:38.440520 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:38.440520 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:38.440520 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:38.440520 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:38.440520 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:38.440520 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:38.440520 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:38.440520 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:38.440520 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:38.440520 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:38.440520 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:38.440520 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:04:38.440520 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:04:38.440520 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:04:38.441516 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:04:38.441516 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:38.441516 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:38.441516 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:38.441516 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:38.441516 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:38.441516 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:38.441516 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:38.441516 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:38.441516 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:38.441516 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:38.441516 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:38.441516 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:38.441516 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:38.441516 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:38.441516 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:38.441516 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:38.442676 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:04:38.442676 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:04:38.442676 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:38.442676 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:38.442676 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 399/804] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:04:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:38.443413 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a897f-4ac1-4ef1-9a2f-a896720da252 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:38.443514 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a897f-4ac1-4ef1-9a2f-a896720da252 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:38.444048 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a897f-4ac1-4ef1-9a2f-a896720da252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:38.460159 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-739a897f-4ac1-4ef1-9a2f-a896720da252 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:38.460534 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6c005b-e3a2-4e53-98d3-2fa734fb7922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:38.461183 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c005b-e3a2-4e53-98d3-2fa734fb7922 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:38.461291 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-739a897f-4ac1-4ef1-9a2f-a896720da252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:38.461519 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c005b-e3a2-4e53-98d3-2fa734fb7922 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:38.461754 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c005b-e3a2-4e53-98d3-2fa734fb7922 None admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:38.462533 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6c005b-e3a2-4e53-98d3-2fa734fb7922 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:38.462835 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6c005b-e3a2-4e53-98d3-2fa734fb7922 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:38.464240 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6c005b-e3a2-4e53-98d3-2fa734fb7922 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:38.476415 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 406/805] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 17 18:04:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:38.477203 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6c005b-e3a2-4e53-98d3-2fa734fb7922 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:38.545636 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 400/806] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:04:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:04:38.546626 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a897f-4ac1-4ef1-9a2f-a896720da252 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:38.586702 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6c005b-e3a2-4e53-98d3-2fa734fb7922 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:38.621085 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9296f4-029c-4589-86e0-e8e065f67424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:38.621788 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9296f4-029c-4589-86e0-e8e065f67424 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:38.622065 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9296f4-029c-4589-86e0-e8e065f67424 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:38.622379 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9296f4-029c-4589-86e0-e8e065f67424 None admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:38.623223 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9296f4-029c-4589-86e0-e8e065f67424 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:38.623527 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9296f4-029c-4589-86e0-e8e065f67424 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:38.624961 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9296f4-029c-4589-86e0-e8e065f67424 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:38.646507 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 407/807] 10.222.0.65 () {56 vars in 1133 bytes} [Tue May 17 18:04:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:38.646507 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9296f4-029c-4589-86e0-e8e065f67424 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:38.659427 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a897f-4ac1-4ef1-9a2f-a896720da252 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:38.692670 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2388bff-52ea-4113-ae11-384f70707e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:38.693502 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2388bff-52ea-4113-ae11-384f70707e00 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:38.693886 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2388bff-52ea-4113-ae11-384f70707e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:38.694260 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2388bff-52ea-4113-ae11-384f70707e00 None admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:38.695076 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2388bff-52ea-4113-ae11-384f70707e00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:38.695481 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2388bff-52ea-4113-ae11-384f70707e00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:38.696939 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2388bff-52ea-4113-ae11-384f70707e00 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:38.708530 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 401/808] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:04:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:38.709336 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2388bff-52ea-4113-ae11-384f70707e00 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:38.738838 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9296f4-029c-4589-86e0-e8e065f67424 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:38.770389 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fdf506-1a4c-4886-9b3e-e6dfa2160f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:38.771254 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fdf506-1a4c-4886-9b3e-e6dfa2160f02 None admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:38.771526 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fdf506-1a4c-4886-9b3e-e6dfa2160f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:38.771795 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fdf506-1a4c-4886-9b3e-e6dfa2160f02 None admin] PATH_INFO: `/v3/projects/0cf165918c1f46cb96d4b54409862659/users/1464e84a3a2d4321a98b98d398bc7be3/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:38.773872 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fdf506-1a4c-4886-9b3e-e6dfa2160f02 None admin] RBAC: Authorizing `identity:create_grant(project_id=0cf165918c1f46cb96d4b54409862659, user_id=1464e84a3a2d4321a98b98d398bc7be3, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:38.775287 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fdf506-1a4c-4886-9b3e-e6dfa2160f02 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:38.788171 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 408/809] 10.222.0.65 () {58 vars in 1439 bytes} [Tue May 17 18:04:38 2022] PUT /identity/v3/projects/0cf165918c1f46cb96d4b54409862659/users/1464e84a3a2d4321a98b98d398bc7be3/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:04:38.788735 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fdf506-1a4c-4886-9b3e-e6dfa2160f02 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:38.804255 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2388bff-52ea-4113-ae11-384f70707e00 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:38.841843 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f1a048-9605-4da5-ba6d-575818f85f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:38.843097 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1a048-9605-4da5-ba6d-575818f85f06 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:38.843685 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1a048-9605-4da5-ba6d-575818f85f06 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:38.844155 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1a048-9605-4da5-ba6d-575818f85f06 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:38.845184 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f1a048-9605-4da5-ba6d-575818f85f06 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:38.846996 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f1a048-9605-4da5-ba6d-575818f85f06 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:38.860522 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-01f1a048-9605-4da5-ba6d-575818f85f06 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 17 18:04:38.860522 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:38.860522 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 18:04:38.860522 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 18:04:38.860522 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 18:04:38.860522 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 18:04:38.860522 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 18:04:38.860522 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:04:38.860522 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 17 18:04:38.860522 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:38.860522 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 18:04:38.860522 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:38.860522 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:38.860522 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:38.860522 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:38.860522 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:38.861731 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:38.861731 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:38.861731 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:38.861731 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:38.861731 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:38.861731 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:38.861731 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:38.861731 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 18:04:38.861731 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 18:04:38.861731 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 18:04:38.861731 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 18:04:38.861731 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:38.861731 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:38.861731 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:38.861731 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:38.861731 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:38.862755 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:38.862755 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:38.862755 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:38.862755 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:38.862755 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:38.862755 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:38.862755 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:38.862755 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:38.862755 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:38.862755 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:38.862755 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:38.862755 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 18:04:38.862755 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:04:38.862755 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 17 18:04:38.862755 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:38.865093 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 402/810] 10.222.0.65 () {56 vars in 1129 bytes} [Tue May 17 18:04:38 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:38.866676 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6996819-b15b-442c-a6e0-3bd961101cae None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:38.867118 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6996819-b15b-442c-a6e0-3bd961101cae None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:38.867514 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6996819-b15b-442c-a6e0-3bd961101cae None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:38.869343 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 403/811] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:04:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:04:38.870302 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6996819-b15b-442c-a6e0-3bd961101cae None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:38.910436 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fdf506-1a4c-4886-9b3e-e6dfa2160f02 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:38.946197 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf864d5-2c89-4346-ba46-378b5834c9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:38.946861 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf864d5-2c89-4346-ba46-378b5834c9f4 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:38.947140 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf864d5-2c89-4346-ba46-378b5834c9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:38.947413 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf864d5-2c89-4346-ba46-378b5834c9f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:38.986374 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6996819-b15b-442c-a6e0-3bd961101cae None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:39.016428 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf864d5-2c89-4346-ba46-378b5834c9f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:39.017814 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf864d5-2c89-4346-ba46-378b5834c9f4 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:39.021403 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef07423-f679-4c30-8643-258e45963ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:39.022344 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef07423-f679-4c30-8643-258e45963ed9 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:39.022719 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef07423-f679-4c30-8643-258e45963ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:39.023083 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef07423-f679-4c30-8643-258e45963ed9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:39.030667 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef07423-f679-4c30-8643-258e45963ed9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:39.032190 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef07423-f679-4c30-8643-258e45963ed9 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:39.046446 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-2ef07423-f679-4c30-8643-258e45963ed9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 18:04:39.046446 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:39.046446 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:39.046446 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:39.046446 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:39.046446 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:39.046446 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:39.046446 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:39.046446 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:39.046446 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:39.046446 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:39.046446 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:39.046446 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 18:04:39.046446 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 18:04:39.046446 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 18:04:39.046446 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 18:04:39.047590 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:39.047590 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:39.047590 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 18:04:39.047590 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:04:39.047590 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 18:04:39.047590 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:04:39.047590 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:39.047590 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:39.047590 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:39.047590 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:39.047590 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:39.047590 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:39.047590 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:39.047590 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:39.047590 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:39.047590 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:39.047590 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:39.047590 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:39.048744 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:39.048744 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:39.048744 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 18:04:39.048744 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 18:04:39.048744 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 18:04:39.048744 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 18:04:39.048744 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 18:04:39.048744 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 18:04:39.048744 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 18:04:39.048744 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:39.053829 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 404/812] 10.222.0.65 () {56 vars in 1117 bytes} [Tue May 17 18:04:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:39.053829 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef07423-f679-4c30-8643-258e45963ed9 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:39.121048 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 409/813] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 17 18:04:38 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 18:04:39.122898 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9837f3-ad29-4024-a810-972ea07a3b76 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:39.123174 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9837f3-ad29-4024-a810-972ea07a3b76 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:39.123444 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9837f3-ad29-4024-a810-972ea07a3b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:39.140325 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-4f9837f3-ad29-4024-a810-972ea07a3b76 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:39.141507 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-4f9837f3-ad29-4024-a810-972ea07a3b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:39.157173 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef07423-f679-4c30-8643-258e45963ed9 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:39.189800 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f4e791-b978-40ae-a860-ecae301439bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:39.190454 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4e791-b978-40ae-a860-ecae301439bd None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:39.190728 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4e791-b978-40ae-a860-ecae301439bd None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:39.190991 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4e791-b978-40ae-a860-ecae301439bd None admin] PATH_INFO: `/v3/services` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:39.191685 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f4e791-b978-40ae-a860-ecae301439bd None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:39.191984 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f4e791-b978-40ae-a860-ecae301439bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:39.193619 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f4e791-b978-40ae-a860-ecae301439bd None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:39.197986 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 405/814] 10.222.0.65 () {56 vars in 1124 bytes} [Tue May 17 18:04:39 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:39.198751 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f4e791-b978-40ae-a860-ecae301439bd None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:39.212837 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 410/815] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:04:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:04:39.213913 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9837f3-ad29-4024-a810-972ea07a3b76 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:39.300271 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f4e791-b978-40ae-a860-ecae301439bd None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:39.330463 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9837f3-ad29-4024-a810-972ea07a3b76 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:39.332757 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5587d0-4452-4297-a343-4b60da894a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:39.333416 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5587d0-4452-4297-a343-4b60da894a6d None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:39.333726 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5587d0-4452-4297-a343-4b60da894a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:39.334003 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5587d0-4452-4297-a343-4b60da894a6d None admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:39.334839 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5587d0-4452-4297-a343-4b60da894a6d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:39.335147 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5587d0-4452-4297-a343-4b60da894a6d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:39.336572 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5587d0-4452-4297-a343-4b60da894a6d None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:39.353496 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 406/816] 10.222.0.65 () {56 vars in 1149 bytes} [Tue May 17 18:04:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:39.354492 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5587d0-4452-4297-a343-4b60da894a6d None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:39.368912 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f5f33-0926-4070-b578-5037ec2726be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:39.369859 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f5f33-0926-4070-b578-5037ec2726be None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:39.370234 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f5f33-0926-4070-b578-5037ec2726be None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:39.370575 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f5f33-0926-4070-b578-5037ec2726be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:39.380865 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f5f33-0926-4070-b578-5037ec2726be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:39.382407 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f5f33-0926-4070-b578-5037ec2726be None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:39.399212 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-502f5f33-0926-4070-b578-5037ec2726be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:39.399212 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:39.399212 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:39.399212 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:39.399212 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:39.399212 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:39.399212 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:39.399212 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:39.399212 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:39.399212 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:39.399212 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:39.399212 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:39.399212 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:04:39.399212 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:04:39.399212 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:04:39.400120 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:04:39.400120 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:39.400120 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:39.400120 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:39.400120 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:39.400120 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:39.400120 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:39.400120 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:39.400120 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:39.400120 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:39.400120 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:39.400120 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:39.400120 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:39.400120 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:39.400120 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:39.400120 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:39.400120 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:39.400988 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:04:39.400988 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:04:39.400988 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:39.400988 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:39.400988 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 411/817] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:04:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:39.401269 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f5f33-0926-4070-b578-5037ec2726be None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:39.456127 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5587d0-4452-4297-a343-4b60da894a6d None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:39.489649 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405a29f8-038b-4647-8e87-b01fa5cc350a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:39.490307 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a29f8-038b-4647-8e87-b01fa5cc350a None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:39.490577 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a29f8-038b-4647-8e87-b01fa5cc350a None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:39.490843 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a29f8-038b-4647-8e87-b01fa5cc350a None admin] PATH_INFO: `/v3/services` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:39.491539 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405a29f8-038b-4647-8e87-b01fa5cc350a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:39.491836 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405a29f8-038b-4647-8e87-b01fa5cc350a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:39.493187 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405a29f8-038b-4647-8e87-b01fa5cc350a None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:39.502338 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 407/818] 10.222.0.65 () {56 vars in 1124 bytes} [Tue May 17 18:04:39 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:39.502338 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405a29f8-038b-4647-8e87-b01fa5cc350a None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:39.507701 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f5f33-0926-4070-b578-5037ec2726be None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:39.542196 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc349f3-9650-4923-b6c4-e290f55ab813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:39.542981 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc349f3-9650-4923-b6c4-e290f55ab813 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:39.543254 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc349f3-9650-4923-b6c4-e290f55ab813 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:39.543549 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc349f3-9650-4923-b6c4-e290f55ab813 None admin] PATH_INFO: `/v3/services/network` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:39.544196 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc349f3-9650-4923-b6c4-e290f55ab813 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:39.545574 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc349f3-9650-4923-b6c4-e290f55ab813 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:39.556897 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-1dc349f3-9650-4923-b6c4-e290f55ab813 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 17 18:04:39.556897 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:39.556897 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 18:04:39.556897 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 18:04:39.556897 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 18:04:39.556897 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 18:04:39.556897 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 18:04:39.556897 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:04:39.556897 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 17 18:04:39.556897 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:39.556897 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 18:04:39.556897 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:39.556897 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:39.556897 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:39.556897 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:39.556897 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:39.556897 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:39.557933 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:39.557933 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:39.557933 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:39.557933 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:39.557933 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:39.557933 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:39.557933 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 18:04:39.557933 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 18:04:39.557933 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 18:04:39.557933 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 18:04:39.557933 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:39.557933 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:39.557933 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:39.557933 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:39.557933 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:39.557933 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:39.558767 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:39.558767 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:39.558767 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:39.558767 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:39.558767 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:39.558767 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:39.558767 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:39.558767 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:39.558767 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:39.558767 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:39.558767 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 18:04:39.558767 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:04:39.558767 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 17 18:04:39.558767 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:39.558767 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 412/819] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 17 18:04:39 2022] GET /identity/v3/services/network => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:39.560052 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc349f3-9650-4923-b6c4-e290f55ab813 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:39.604183 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405a29f8-038b-4647-8e87-b01fa5cc350a None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:39.642920 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6b8e6-46d0-4637-ba9d-4070bf72d738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:39.643788 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6b8e6-46d0-4637-ba9d-4070bf72d738 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:39.644127 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6b8e6-46d0-4637-ba9d-4070bf72d738 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:39.644464 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6b8e6-46d0-4637-ba9d-4070bf72d738 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:39.654127 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a6b8e6-46d0-4637-ba9d-4070bf72d738 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:39.655554 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a6b8e6-46d0-4637-ba9d-4070bf72d738 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:39.659066 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc349f3-9650-4923-b6c4-e290f55ab813 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:39.672796 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-b1a6b8e6-46d0-4637-ba9d-4070bf72d738 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:39.672796 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:39.672796 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:39.672796 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:39.672796 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:39.672796 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:39.672796 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:39.672796 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:39.672796 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:39.672796 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:39.672796 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:39.672796 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:39.672796 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:04:39.672796 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:04:39.672796 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:04:39.673717 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:04:39.673717 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:39.673717 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:39.673717 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:39.673717 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:39.673717 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:39.673717 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:39.673717 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:39.673717 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:39.673717 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:39.673717 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:39.673717 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:39.673717 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:39.673717 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:39.673717 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:39.673717 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:39.673717 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:39.674631 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:04:39.674631 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:04:39.674631 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:39.674631 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:39.674631 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 408/820] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:04:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:39.674913 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6b8e6-46d0-4637-ba9d-4070bf72d738 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:39.695360 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa6c9b-a9ee-48fc-976b-93f145774a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:39.696302 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa6c9b-a9ee-48fc-976b-93f145774a40 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:39.696580 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa6c9b-a9ee-48fc-976b-93f145774a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:39.696851 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa6c9b-a9ee-48fc-976b-93f145774a40 None admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:39.697592 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaa6c9b-a9ee-48fc-976b-93f145774a40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:39.697897 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaa6c9b-a9ee-48fc-976b-93f145774a40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:39.699258 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaa6c9b-a9ee-48fc-976b-93f145774a40 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:39.711095 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 413/821] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:04:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:39.712251 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa6c9b-a9ee-48fc-976b-93f145774a40 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:39.774647 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6b8e6-46d0-4637-ba9d-4070bf72d738 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:39.807228 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa6c9b-a9ee-48fc-976b-93f145774a40 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:39.808850 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a125b-0f8e-4b39-a6b9-f8792eb2d72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:39.809521 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a125b-0f8e-4b39-a6b9-f8792eb2d72b None admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:39.809827 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a125b-0f8e-4b39-a6b9-f8792eb2d72b None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:39.810100 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a125b-0f8e-4b39-a6b9-f8792eb2d72b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:39.810827 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7a125b-0f8e-4b39-a6b9-f8792eb2d72b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:39.812178 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7a125b-0f8e-4b39-a6b9-f8792eb2d72b None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:39.846538 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 409/822] 10.222.0.65 () {60 vars in 1144 bytes} [Tue May 17 18:04:39 2022] POST /identity/v3/endpoints => generated 346 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:04:39.846770 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a125b-0f8e-4b39-a6b9-f8792eb2d72b None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:39.849112 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2a7b6-17e7-49f9-825b-511f43de7a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:39.849825 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2a7b6-17e7-49f9-825b-511f43de7a08 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:39.850101 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2a7b6-17e7-49f9-825b-511f43de7a08 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:39.850375 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a2a7b6-17e7-49f9-825b-511f43de7a08 None admin] PATH_INFO: `/v3/services` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:39.851089 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a2a7b6-17e7-49f9-825b-511f43de7a08 None admin] RBAC: Adding query filter params (name=network) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:39.851409 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a2a7b6-17e7-49f9-825b-511f43de7a08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:39.852789 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a2a7b6-17e7-49f9-825b-511f43de7a08 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:39.864203 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 414/823] 10.222.0.65 () {56 vars in 1112 bytes} [Tue May 17 18:04:39 2022] GET /identity/v3/services?name=network => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:39.865560 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2a7b6-17e7-49f9-825b-511f43de7a08 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:39.963582 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a125b-0f8e-4b39-a6b9-f8792eb2d72b None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:39.976996 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a2a7b6-17e7-49f9-825b-511f43de7a08 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:40.006787 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0939ecd2-e7b9-47e8-a8b9-1d239f4feccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:40.008365 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0939ecd2-e7b9-47e8-a8b9-1d239f4feccf None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:40.009129 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0939ecd2-e7b9-47e8-a8b9-1d239f4feccf None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:40.009846 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0939ecd2-e7b9-47e8-a8b9-1d239f4feccf None admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:40.010939 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0939ecd2-e7b9-47e8-a8b9-1d239f4feccf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:40.011397 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0939ecd2-e7b9-47e8-a8b9-1d239f4feccf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:40.013870 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0939ecd2-e7b9-47e8-a8b9-1d239f4feccf None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:40.014959 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dab1f18-0352-4ce4-91bc-dd529c260344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:40.015977 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab1f18-0352-4ce4-91bc-dd529c260344 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:40.016289 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab1f18-0352-4ce4-91bc-dd529c260344 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:40.016660 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab1f18-0352-4ce4-91bc-dd529c260344 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:40.024492 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dab1f18-0352-4ce4-91bc-dd529c260344 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:40.026801 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dab1f18-0352-4ce4-91bc-dd529c260344 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:40.029350 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 410/824] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:04:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:40.030735 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0939ecd2-e7b9-47e8-a8b9-1d239f4feccf None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:40.041803 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-9dab1f18-0352-4ce4-91bc-dd529c260344 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:04:40.041803 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:40.041803 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:40.041803 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:40.041803 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:40.041803 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:40.041803 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:40.041803 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:40.041803 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:40.041803 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:40.041803 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:40.041803 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:40.041803 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 18:04:40.041803 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 18:04:40.041803 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 18:04:40.042902 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 18:04:40.042902 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:40.042902 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:40.042902 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:40.042902 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:40.042902 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:40.042902 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:40.042902 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:40.042902 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:40.042902 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:40.042902 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:40.042902 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:40.042902 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:40.042902 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:40.042902 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:40.042902 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:40.042902 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:40.043924 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 18:04:40.043924 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 18:04:40.043924 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 18:04:40.043924 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 18:04:40.043924 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 18:04:40.043924 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 18:04:40.043924 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:04:40.043924 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:40.046383 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 415/825] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 17 18:04:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:40.047133 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dab1f18-0352-4ce4-91bc-dd529c260344 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:40.146809 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0939ecd2-e7b9-47e8-a8b9-1d239f4feccf None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:40.179113 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dab1f18-0352-4ce4-91bc-dd529c260344 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:40.180669 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08edea1-a39a-4c2e-99a9-ce9c322f9e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:40.181333 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08edea1-a39a-4c2e-99a9-ce9c322f9e5d None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:40.181664 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08edea1-a39a-4c2e-99a9-ce9c322f9e5d None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:40.181936 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08edea1-a39a-4c2e-99a9-ce9c322f9e5d None admin] PATH_INFO: `/v3/services` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:40.182640 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08edea1-a39a-4c2e-99a9-ce9c322f9e5d None admin] RBAC: Adding query filter params (type=network) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:40.182941 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08edea1-a39a-4c2e-99a9-ce9c322f9e5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:40.184302 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08edea1-a39a-4c2e-99a9-ce9c322f9e5d None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:40.190583 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 411/826] 10.222.0.65 () {56 vars in 1112 bytes} [Tue May 17 18:04:40 2022] GET /identity/v3/services?type=network => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:40.191576 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08edea1-a39a-4c2e-99a9-ce9c322f9e5d None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:40.220878 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8351dd91-dad3-491c-b7be-8cb498bc216e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:40.221987 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8351dd91-dad3-491c-b7be-8cb498bc216e None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:40.222678 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8351dd91-dad3-491c-b7be-8cb498bc216e None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:40.223327 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8351dd91-dad3-491c-b7be-8cb498bc216e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:40.232249 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8351dd91-dad3-491c-b7be-8cb498bc216e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:40.234203 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8351dd91-dad3-491c-b7be-8cb498bc216e None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:40.254422 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-8351dd91-dad3-491c-b7be-8cb498bc216e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:04:40.254422 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:40.254422 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:40.254422 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:40.254422 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:40.254422 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:40.254422 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:40.254422 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:40.254422 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:40.254422 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:40.254422 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:40.254422 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:40.254422 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 18:04:40.254422 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 18:04:40.254422 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 18:04:40.256253 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 18:04:40.256253 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:40.256253 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:40.256253 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:40.256253 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:40.256253 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:40.256253 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:40.256253 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:40.256253 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:40.256253 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:40.256253 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:40.256253 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:40.256253 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:40.256253 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:40.256253 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:40.256253 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:40.256253 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:40.257891 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 18:04:40.257891 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 18:04:40.257891 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 18:04:40.257891 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 18:04:40.257891 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 18:04:40.257891 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 18:04:40.257891 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:04:40.257891 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:40.257891 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 416/827] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 17 18:04:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:40.257891 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8351dd91-dad3-491c-b7be-8cb498bc216e None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:40.316904 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08edea1-a39a-4c2e-99a9-ce9c322f9e5d None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:40.353423 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f700a1-4e94-4ae0-bebd-33ccae229060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:40.354124 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f700a1-4e94-4ae0-bebd-33ccae229060 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:40.354402 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f700a1-4e94-4ae0-bebd-33ccae229060 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:40.354674 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f700a1-4e94-4ae0-bebd-33ccae229060 None admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:40.355515 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f700a1-4e94-4ae0-bebd-33ccae229060 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:40.355753 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f700a1-4e94-4ae0-bebd-33ccae229060 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:40.357814 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f700a1-4e94-4ae0-bebd-33ccae229060 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:40.370023 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 412/828] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 17 18:04:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:40.370913 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f700a1-4e94-4ae0-bebd-33ccae229060 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:40.381988 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8351dd91-dad3-491c-b7be-8cb498bc216e None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:40.417435 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6889cdf5-a9a8-47da-a0d5-717567a6be1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:40.418469 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6889cdf5-a9a8-47da-a0d5-717567a6be1a None admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:40.418957 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6889cdf5-a9a8-47da-a0d5-717567a6be1a None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:40.419523 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6889cdf5-a9a8-47da-a0d5-717567a6be1a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:40.421139 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6889cdf5-a9a8-47da-a0d5-717567a6be1a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:40.423438 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6889cdf5-a9a8-47da-a0d5-717567a6be1a None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:40.451376 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 417/829] 10.222.0.65 () {60 vars in 1144 bytes} [Tue May 17 18:04:40 2022] POST /identity/v3/endpoints => generated 327 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:04:40.453219 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6889cdf5-a9a8-47da-a0d5-717567a6be1a None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:40.478413 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f700a1-4e94-4ae0-bebd-33ccae229060 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:40.523292 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799151a0-65a5-4288-bd1e-b6d488c6f330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:40.523963 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799151a0-65a5-4288-bd1e-b6d488c6f330 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:40.524240 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799151a0-65a5-4288-bd1e-b6d488c6f330 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:40.524510 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799151a0-65a5-4288-bd1e-b6d488c6f330 None admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:40.525373 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799151a0-65a5-4288-bd1e-b6d488c6f330 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:40.525754 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799151a0-65a5-4288-bd1e-b6d488c6f330 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:40.527234 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799151a0-65a5-4288-bd1e-b6d488c6f330 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:40.548560 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 413/830] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 17 18:04:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:40.549949 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799151a0-65a5-4288-bd1e-b6d488c6f330 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:40.600930 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6889cdf5-a9a8-47da-a0d5-717567a6be1a None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:40.639914 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c85a7b-1833-4666-a8a7-3323b3283f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:40.640637 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c85a7b-1833-4666-a8a7-3323b3283f14 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:40.640921 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c85a7b-1833-4666-a8a7-3323b3283f14 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:40.641195 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c85a7b-1833-4666-a8a7-3323b3283f14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:40.642065 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c85a7b-1833-4666-a8a7-3323b3283f14 None admin] RBAC: Adding query filter params (role.id=332c8d70fd0f41e2beea20aaead5daa5, scope.project.id=0cf165918c1f46cb96d4b54409862659, user.id=5b430b739cb54fc7911bc89f8ea2df72) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:40.642376 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c85a7b-1833-4666-a8a7-3323b3283f14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:40.643806 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c85a7b-1833-4666-a8a7-3323b3283f14 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:40.654154 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 418/831] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 17 18:04:40 2022] GET /identity/v3/role_assignments?user.id=5b430b739cb54fc7911bc89f8ea2df72&scope.project.id=0cf165918c1f46cb96d4b54409862659&role.id=332c8d70fd0f41e2beea20aaead5daa5 => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:40.677781 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799151a0-65a5-4288-bd1e-b6d488c6f330 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:40.718373 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e447e6c-76db-4863-83d1-b75b1f5103c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:40.719667 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e447e6c-76db-4863-83d1-b75b1f5103c7 None admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:40.720174 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e447e6c-76db-4863-83d1-b75b1f5103c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:40.720670 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e447e6c-76db-4863-83d1-b75b1f5103c7 None admin] PATH_INFO: `/v3/projects/0cf165918c1f46cb96d4b54409862659/users/f370e353067848b5843c5650183be347/roles/60e39e2185d346a192b8698767df6018` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:40.739420 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e447e6c-76db-4863-83d1-b75b1f5103c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=0cf165918c1f46cb96d4b54409862659, user_id=f370e353067848b5843c5650183be347, role_id=60e39e2185d346a192b8698767df6018)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:40.741231 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e447e6c-76db-4863-83d1-b75b1f5103c7 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:40.758489 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 414/832] 10.222.0.65 () {58 vars in 1439 bytes} [Tue May 17 18:04:40 2022] PUT /identity/v3/projects/0cf165918c1f46cb96d4b54409862659/users/f370e353067848b5843c5650183be347/roles/60e39e2185d346a192b8698767df6018 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:04:41.067990 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f4c14-eace-44a6-a896-55c1bead9426 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:41.068479 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f4c14-eace-44a6-a896-55c1bead9426 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:41.068479 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f4c14-eace-44a6-a896-55c1bead9426 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:41.070064 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 419/833] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:04:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:04:41.075995 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00706f-02d6-4af4-bece-bd3a00cab555 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:41.076420 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00706f-02d6-4af4-bece-bd3a00cab555 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:41.076615 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a00706f-02d6-4af4-bece-bd3a00cab555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:41.093784 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-2a00706f-02d6-4af4-bece-bd3a00cab555 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:41.094952 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-2a00706f-02d6-4af4-bece-bd3a00cab555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:41.161305 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 415/834] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:04:41 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 18:04:41.184117 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f4c14-eace-44a6-a896-55c1bead9426 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:41.290266 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f4c14-eace-44a6-a896-55c1bead9426 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:41.325068 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f19bf4-67f5-45a2-9a34-3e2884f36e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:41.326225 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f19bf4-67f5-45a2-9a34-3e2884f36e83 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:41.326686 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f19bf4-67f5-45a2-9a34-3e2884f36e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:41.327151 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f19bf4-67f5-45a2-9a34-3e2884f36e83 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:41.338459 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f19bf4-67f5-45a2-9a34-3e2884f36e83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:04:41.346987 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-72f19bf4-67f5-45a2-9a34-3e2884f36e83 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:04:41.346987 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:41.346987 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:41.346987 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:41.346987 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:41.346987 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:41.346987 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:41.346987 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:41.346987 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:41.346987 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:41.346987 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:41.346987 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:41.346987 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:04:41.346987 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:04:41.346987 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:04:41.346987 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:04:41.347903 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:04:41.347903 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:04:41.347903 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:04:41.347903 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:04:41.347903 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:41.347903 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:41.347903 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:41.347903 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:41.347903 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:41.347903 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:41.347903 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:41.347903 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:41.347903 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:41.347903 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:41.347903 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:41.347903 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:41.348742 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:41.348742 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:41.348742 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:41.348742 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:41.348742 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:04:41.348742 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:04:41.348742 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:04:41.348742 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:04:41.348742 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:04:41.348742 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:04:41.348742 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:04:41.348742 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:41.355684 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 420/835] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 17 18:04:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:41.357903 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a00706f-02d6-4af4-bece-bd3a00cab555 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:41.454799 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a00706f-02d6-4af4-bece-bd3a00cab555 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:41.487561 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ab55fc-1a3c-48ab-bd6d-737df3e84cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:41.488221 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ab55fc-1a3c-48ab-bd6d-737df3e84cb5 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:41.488495 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ab55fc-1a3c-48ab-bd6d-737df3e84cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:41.488762 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ab55fc-1a3c-48ab-bd6d-737df3e84cb5 None admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:41.489518 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ab55fc-1a3c-48ab-bd6d-737df3e84cb5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:41.489822 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ab55fc-1a3c-48ab-bd6d-737df3e84cb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:41.491172 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ab55fc-1a3c-48ab-bd6d-737df3e84cb5 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:41.499805 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 416/836] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 17 18:04:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:41.505356 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f19bf4-67f5-45a2-9a34-3e2884f36e83 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:41.612282 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f19bf4-67f5-45a2-9a34-3e2884f36e83 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:41.647119 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a4b724-54c9-44a8-a33d-1c63702f5db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:41.648278 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4b724-54c9-44a8-a33d-1c63702f5db0 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:41.648758 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4b724-54c9-44a8-a33d-1c63702f5db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:41.649250 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4b724-54c9-44a8-a33d-1c63702f5db0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:41.660027 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a4b724-54c9-44a8-a33d-1c63702f5db0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:41.661796 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a4b724-54c9-44a8-a33d-1c63702f5db0 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:41.680391 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-69a4b724-54c9-44a8-a33d-1c63702f5db0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:41.680391 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:41.680391 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:41.680391 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:41.680391 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:41.680391 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:41.680391 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:41.680391 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:41.680391 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:41.680391 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:41.680391 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:41.680391 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:41.680391 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:04:41.680391 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:04:41.680391 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:04:41.681330 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:04:41.681330 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:41.681330 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:41.681330 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:41.681330 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:41.681330 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:41.681330 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:41.681330 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:41.681330 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:41.681330 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:41.681330 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:41.681330 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:41.681330 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:41.681330 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:41.681330 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:41.681330 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:41.681330 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:41.682246 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:04:41.682246 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:04:41.682246 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:41.682246 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:41.689293 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 421/837] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:04:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:41.694534 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ab55fc-1a3c-48ab-bd6d-737df3e84cb5 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:41.795418 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ab55fc-1a3c-48ab-bd6d-737df3e84cb5 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:41.828443 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc79128-f04d-4992-a0b8-376ad0c1fd10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:41.834182 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc79128-f04d-4992-a0b8-376ad0c1fd10 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:41.834469 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc79128-f04d-4992-a0b8-376ad0c1fd10 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:41.834747 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc79128-f04d-4992-a0b8-376ad0c1fd10 None admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:41.835480 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc79128-f04d-4992-a0b8-376ad0c1fd10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:41.835786 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc79128-f04d-4992-a0b8-376ad0c1fd10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:41.837161 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc79128-f04d-4992-a0b8-376ad0c1fd10 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:41.855599 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 417/838] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:04:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:41.862455 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a4b724-54c9-44a8-a33d-1c63702f5db0 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:41.969909 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a4b724-54c9-44a8-a33d-1c63702f5db0 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:42.004595 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbfcce1-2203-4dfa-9c63-f1938453997e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:42.005784 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbfcce1-2203-4dfa-9c63-f1938453997e None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:42.006266 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbfcce1-2203-4dfa-9c63-f1938453997e None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:42.006752 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbfcce1-2203-4dfa-9c63-f1938453997e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:42.014391 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbfcce1-2203-4dfa-9c63-f1938453997e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:42.016207 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbfcce1-2203-4dfa-9c63-f1938453997e None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:42.031644 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-4cbfcce1-2203-4dfa-9c63-f1938453997e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 17 18:04:42.031644 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:42.031644 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:42.031644 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:42.031644 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:42.031644 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:42.031644 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:42.031644 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:42.031644 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:42.031644 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:42.031644 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:42.031644 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:42.031644 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 18:04:42.031644 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 18:04:42.031644 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 18:04:42.031644 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 18:04:42.032650 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:42.032650 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:42.032650 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 18:04:42.032650 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:04:42.032650 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 18:04:42.032650 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:04:42.032650 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:42.032650 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:42.032650 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:42.032650 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:42.032650 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:42.032650 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:42.032650 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:42.032650 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:42.032650 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:42.032650 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:42.032650 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:42.032650 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:42.033712 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:42.033712 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:42.033712 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 18:04:42.033712 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 18:04:42.033712 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 18:04:42.033712 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 18:04:42.033712 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 18:04:42.033712 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 18:04:42.033712 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 17 18:04:42.033712 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:42.040631 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 422/839] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 17 18:04:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:42.042270 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc79128-f04d-4992-a0b8-376ad0c1fd10 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:42.142836 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc79128-f04d-4992-a0b8-376ad0c1fd10 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:42.182652 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3edd98-f3dc-4728-a0bb-6a29681bf5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:42.183710 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3edd98-f3dc-4728-a0bb-6a29681bf5cc None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:42.184212 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3edd98-f3dc-4728-a0bb-6a29681bf5cc None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:42.184715 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3edd98-f3dc-4728-a0bb-6a29681bf5cc None admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:42.185814 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3edd98-f3dc-4728-a0bb-6a29681bf5cc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:42.186344 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3edd98-f3dc-4728-a0bb-6a29681bf5cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:42.188002 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3edd98-f3dc-4728-a0bb-6a29681bf5cc None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:42.211479 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 418/840] 10.222.0.65 () {56 vars in 1135 bytes} [Tue May 17 18:04:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:42.213141 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbfcce1-2203-4dfa-9c63-f1938453997e None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:42.313503 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbfcce1-2203-4dfa-9c63-f1938453997e None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:42.347474 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a5416-8534-4258-b124-3665ca136e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:42.347831 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0fa8b-2fc0-4b01-ab42-55b10c12779d None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:42.348110 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a5416-8534-4258-b124-3665ca136e11 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:42.348217 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0fa8b-2fc0-4b01-ab42-55b10c12779d None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:42.348398 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0fa8b-2fc0-4b01-ab42-55b10c12779d None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:42.348493 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a5416-8534-4258-b124-3665ca136e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:42.348641 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a5416-8534-4258-b124-3665ca136e11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:42.350022 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 419/841] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:04:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 18:04:42.355030 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd47555-09b0-4876-931f-6ff28412eb3b None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:42.355311 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd47555-09b0-4876-931f-6ff28412eb3b None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:42.355583 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd47555-09b0-4876-931f-6ff28412eb3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:42.373195 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-9fd47555-09b0-4876-931f-6ff28412eb3b None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:42.374452 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-9fd47555-09b0-4876-931f-6ff28412eb3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:42.418232 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3a5416-8534-4258-b124-3665ca136e11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:42.420130 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3a5416-8534-4258-b124-3665ca136e11 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:42.445111 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 420/842] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:04:42 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 18:04:42.468452 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd47555-09b0-4876-931f-6ff28412eb3b None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:42.544551 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 423/843] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 17 18:04:42 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 18:04:42.546652 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a5416-8534-4258-b124-3665ca136e11 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:42.568948 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd47555-09b0-4876-931f-6ff28412eb3b None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:42.602916 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38031d93-cab7-4bd3-8589-6fa9135dbc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:42.603781 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38031d93-cab7-4bd3-8589-6fa9135dbc9b None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:42.603989 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38031d93-cab7-4bd3-8589-6fa9135dbc9b None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:42.604261 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38031d93-cab7-4bd3-8589-6fa9135dbc9b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:42.604919 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38031d93-cab7-4bd3-8589-6fa9135dbc9b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:42.606340 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38031d93-cab7-4bd3-8589-6fa9135dbc9b None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:42.618816 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-38031d93-cab7-4bd3-8589-6fa9135dbc9b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 17 18:04:42.618816 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:42.618816 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 18:04:42.618816 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 18:04:42.618816 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 18:04:42.618816 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 18:04:42.618816 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 18:04:42.618816 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:04:42.618816 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 17 18:04:42.618816 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:42.618816 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 18:04:42.618816 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:42.618816 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:42.618816 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:42.618816 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:42.618816 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:42.618816 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:42.619845 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:42.619845 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:42.619845 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:42.619845 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:42.619845 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:42.619845 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:42.619845 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 18:04:42.619845 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 18:04:42.619845 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 18:04:42.619845 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 18:04:42.619845 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:42.619845 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:42.619845 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:42.619845 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:42.619845 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:42.619845 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:42.621336 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:42.621336 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:42.621336 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:42.621336 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:42.621336 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:42.621336 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:42.621336 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:42.621336 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:42.621336 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:42.621336 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:42.621336 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 18:04:42.621336 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:04:42.621336 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 17 18:04:42.621336 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:42.625485 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 421/844] 10.222.0.65 () {56 vars in 1114 bytes} [Tue May 17 18:04:42 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:04:42.626449 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38031d93-cab7-4bd3-8589-6fa9135dbc9b None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:42.673638 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a5416-8534-4258-b124-3665ca136e11 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:42.718474 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8605775-3389-45cc-a26a-cc47e23fed29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:42.719553 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8605775-3389-45cc-a26a-cc47e23fed29 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:42.720108 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8605775-3389-45cc-a26a-cc47e23fed29 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:42.720832 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8605775-3389-45cc-a26a-cc47e23fed29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:42.729581 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38031d93-cab7-4bd3-8589-6fa9135dbc9b None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:42.734157 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8605775-3389-45cc-a26a-cc47e23fed29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:42.735791 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8605775-3389-45cc-a26a-cc47e23fed29 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:42.758323 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-f8605775-3389-45cc-a26a-cc47e23fed29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:42.758323 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:42.758323 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:42.758323 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:42.758323 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:42.758323 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:42.758323 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:42.758323 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:42.758323 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:42.758323 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:42.758323 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:42.758323 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:42.758323 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:04:42.758323 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:04:42.758323 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:04:42.759446 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:04:42.759446 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:42.759446 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:42.759446 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:42.759446 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:42.759446 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:42.759446 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:42.759446 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:42.759446 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:42.759446 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:42.759446 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:42.759446 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:42.759446 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:42.759446 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:42.759446 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:42.759446 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:42.759446 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:42.760565 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:04:42.760565 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:04:42.760565 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:42.760565 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:42.763132 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 424/845] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:04:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:42.768145 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8605775-3389-45cc-a26a-cc47e23fed29 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:42.772323 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a3722-1ba6-4d33-ad43-e80540fcd3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:42.773834 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a3722-1ba6-4d33-ad43-e80540fcd3cd None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:42.774115 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a3722-1ba6-4d33-ad43-e80540fcd3cd None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:42.774385 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a3722-1ba6-4d33-ad43-e80540fcd3cd None admin] PATH_INFO: `/v3/services` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:42.775096 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173a3722-1ba6-4d33-ad43-e80540fcd3cd None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:42.775402 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173a3722-1ba6-4d33-ad43-e80540fcd3cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:42.776773 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173a3722-1ba6-4d33-ad43-e80540fcd3cd None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:42.787379 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 422/846] 10.222.0.65 () {56 vars in 1114 bytes} [Tue May 17 18:04:42 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:04:42.788350 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a3722-1ba6-4d33-ad43-e80540fcd3cd None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:42.884820 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8605775-3389-45cc-a26a-cc47e23fed29 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:42.932921 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a3722-1ba6-4d33-ad43-e80540fcd3cd None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:42.933303 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606abbbd-2746-4385-be5d-8da072f11d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:42.934341 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606abbbd-2746-4385-be5d-8da072f11d98 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:42.934624 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606abbbd-2746-4385-be5d-8da072f11d98 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:42.935463 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606abbbd-2746-4385-be5d-8da072f11d98 None admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:42.936217 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606abbbd-2746-4385-be5d-8da072f11d98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:42.936596 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606abbbd-2746-4385-be5d-8da072f11d98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:42.939449 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606abbbd-2746-4385-be5d-8da072f11d98 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:42.957583 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 425/847] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:04:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:04:42.959604 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606abbbd-2746-4385-be5d-8da072f11d98 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:42.979410 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de0fd00-1232-438d-baaf-d6530d0a9434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:42.980468 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0fd00-1232-438d-baaf-d6530d0a9434 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:42.981410 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0fd00-1232-438d-baaf-d6530d0a9434 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:42.982441 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0fd00-1232-438d-baaf-d6530d0a9434 None admin] PATH_INFO: `/v3/services` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:42.983600 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de0fd00-1232-438d-baaf-d6530d0a9434 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:42.984312 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de0fd00-1232-438d-baaf-d6530d0a9434 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:42.986484 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de0fd00-1232-438d-baaf-d6530d0a9434 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:42.998254 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 423/848] 10.222.0.65 () {56 vars in 1114 bytes} [Tue May 17 18:04:42 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:43.072900 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606abbbd-2746-4385-be5d-8da072f11d98 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:43.083179 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2601c-8fce-4ff5-9650-09cd59c650c0 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:43.083530 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2601c-8fce-4ff5-9650-09cd59c650c0 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:43.083728 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b2601c-8fce-4ff5-9650-09cd59c650c0 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:43.085274 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 424/849] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:04:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 18:04:43.091067 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6261b903-2f2b-4970-b868-45388c02aa54 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:43.091650 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6261b903-2f2b-4970-b868-45388c02aa54 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:43.092155 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6261b903-2f2b-4970-b868-45388c02aa54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:43.110197 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-6261b903-2f2b-4970-b868-45388c02aa54 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:43.111663 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-6261b903-2f2b-4970-b868-45388c02aa54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:43.118766 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b051f-1b6f-4138-994f-73960fbb999b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:43.119577 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b051f-1b6f-4138-994f-73960fbb999b None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:43.120395 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b051f-1b6f-4138-994f-73960fbb999b None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:43.120670 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b051f-1b6f-4138-994f-73960fbb999b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:43.131665 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0b051f-1b6f-4138-994f-73960fbb999b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:43.133129 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0b051f-1b6f-4138-994f-73960fbb999b None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:43.151900 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-ea0b051f-1b6f-4138-994f-73960fbb999b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:04:43.151900 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:43.151900 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:43.151900 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:43.151900 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:43.151900 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:43.151900 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:43.151900 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:43.151900 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:43.151900 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:43.151900 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:43.151900 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:43.151900 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 18:04:43.151900 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 18:04:43.151900 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 18:04:43.152865 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 18:04:43.152865 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:43.152865 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:43.152865 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:43.152865 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:43.152865 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:43.152865 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:43.152865 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:43.152865 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:43.152865 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:43.152865 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:43.152865 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:43.152865 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:43.152865 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:43.152865 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:43.152865 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:43.152865 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:43.153972 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 18:04:43.153972 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 18:04:43.153972 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 18:04:43.153972 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 18:04:43.153972 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 18:04:43.153972 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 18:04:43.153972 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:04:43.153972 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:43.153972 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 426/850] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 17 18:04:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:43.155034 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ec7d0-cb06-4ca5-a286-d46b9026414e None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:43.155198 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ec7d0-cb06-4ca5-a286-d46b9026414e None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:43.155401 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ec7d0-cb06-4ca5-a286-d46b9026414e None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:43.156856 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 427/851] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:04:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:04:43.162370 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f828865-eefc-41d8-bc9c-6091b08ee257 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:43.162677 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f828865-eefc-41d8-bc9c-6091b08ee257 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:43.163182 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f828865-eefc-41d8-bc9c-6091b08ee257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:43.180167 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-1f828865-eefc-41d8-bc9c-6091b08ee257 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:43.181372 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-1f828865-eefc-41d8-bc9c-6091b08ee257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:43.187938 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 425/852] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:04:43 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 18:04:43.188638 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6261b903-2f2b-4970-b868-45388c02aa54 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:43.258109 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 428/853] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:04:43 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 18:04:43.259141 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f828865-eefc-41d8-bc9c-6091b08ee257 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:43.301152 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6261b903-2f2b-4970-b868-45388c02aa54 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:43.334093 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750452a-5b74-41d7-9cc6-0450542ae648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:43.334741 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750452a-5b74-41d7-9cc6-0450542ae648 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:43.335015 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750452a-5b74-41d7-9cc6-0450542ae648 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:43.335283 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750452a-5b74-41d7-9cc6-0450542ae648 None admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:43.336049 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b750452a-5b74-41d7-9cc6-0450542ae648 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:43.336355 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b750452a-5b74-41d7-9cc6-0450542ae648 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:43.337803 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b750452a-5b74-41d7-9cc6-0450542ae648 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:43.349500 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 426/854] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 17 18:04:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:43.350245 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750452a-5b74-41d7-9cc6-0450542ae648 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:43.367849 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f828865-eefc-41d8-bc9c-6091b08ee257 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:43.400804 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9385c683-1487-40ef-bca3-0250bc2f1f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:43.401640 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385c683-1487-40ef-bca3-0250bc2f1f32 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:43.401915 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385c683-1487-40ef-bca3-0250bc2f1f32 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:43.402183 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385c683-1487-40ef-bca3-0250bc2f1f32 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:43.402827 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9385c683-1487-40ef-bca3-0250bc2f1f32 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:43.404709 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9385c683-1487-40ef-bca3-0250bc2f1f32 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:43.416722 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-9385c683-1487-40ef-bca3-0250bc2f1f32 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 17 18:04:43.416722 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:43.416722 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 18:04:43.416722 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 18:04:43.416722 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 18:04:43.416722 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 18:04:43.416722 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 18:04:43.416722 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:04:43.416722 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 17 18:04:43.416722 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:43.416722 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 18:04:43.416722 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:43.416722 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:43.416722 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:43.416722 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:43.416722 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:43.417919 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:43.417919 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:43.417919 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:43.417919 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:43.417919 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:43.417919 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:43.417919 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:43.417919 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 18:04:43.417919 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 18:04:43.417919 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 18:04:43.417919 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 18:04:43.417919 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:43.417919 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:43.417919 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:43.417919 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:43.417919 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:43.418770 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:43.418770 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:43.418770 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:43.418770 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:43.418770 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:43.418770 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:43.418770 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:43.418770 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:43.418770 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:43.418770 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:43.418770 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:43.418770 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 18:04:43.418770 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:04:43.418770 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 17 18:04:43.418770 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:43.418770 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 429/855] 10.222.0.65 () {56 vars in 1132 bytes} [Tue May 17 18:04:43 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:43.420214 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9385c683-1487-40ef-bca3-0250bc2f1f32 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:43.451718 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750452a-5b74-41d7-9cc6-0450542ae648 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:43.483931 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5008c2d6-bfca-40af-a4f3-d451222bb2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:43.484720 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008c2d6-bfca-40af-a4f3-d451222bb2fb None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:43.485000 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008c2d6-bfca-40af-a4f3-d451222bb2fb None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:43.485276 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008c2d6-bfca-40af-a4f3-d451222bb2fb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:43.495160 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5008c2d6-bfca-40af-a4f3-d451222bb2fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:04:43.503304 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-5008c2d6-bfca-40af-a4f3-d451222bb2fb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 18:04:43.503304 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:43.503304 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:43.503304 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:43.503304 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:43.503304 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:43.503304 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:43.503304 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:43.503304 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:43.503304 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:43.503304 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:43.503304 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:43.503304 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:04:43.503304 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:04:43.503304 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:04:43.503304 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:04:43.504356 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:04:43.504356 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:04:43.504356 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:04:43.504356 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:04:43.504356 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:43.504356 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:43.504356 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:43.504356 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:43.504356 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:43.504356 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:43.504356 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:43.504356 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:43.504356 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:43.504356 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:43.504356 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:43.504356 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:43.510010 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:43.510010 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:43.510010 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:43.510010 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:43.510010 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:04:43.510010 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:04:43.510010 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:04:43.510010 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:04:43.510010 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:04:43.510010 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:04:43.510010 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 18:04:43.510010 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:43.510010 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 427/856] 10.222.0.65 () {56 vars in 1102 bytes} [Tue May 17 18:04:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:43.510010 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5008c2d6-bfca-40af-a4f3-d451222bb2fb None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:43.523616 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9385c683-1487-40ef-bca3-0250bc2f1f32 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:43.555825 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1e234-0263-49b9-bde8-bdedd9ae9754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:43.556476 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1e234-0263-49b9-bde8-bdedd9ae9754 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:43.556752 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1e234-0263-49b9-bde8-bdedd9ae9754 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:43.557019 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1e234-0263-49b9-bde8-bdedd9ae9754 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:43.557857 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c1e234-0263-49b9-bde8-bdedd9ae9754 None admin] RBAC: Adding query filter params (role.id=332c8d70fd0f41e2beea20aaead5daa5, scope.project.id=0cf165918c1f46cb96d4b54409862659, user.id=1464e84a3a2d4321a98b98d398bc7be3) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:43.558155 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c1e234-0263-49b9-bde8-bdedd9ae9754 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:43.559564 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c1e234-0263-49b9-bde8-bdedd9ae9754 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:43.566853 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 430/857] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 17 18:04:43 2022] GET /identity/v3/role_assignments?user.id=1464e84a3a2d4321a98b98d398bc7be3&scope.project.id=0cf165918c1f46cb96d4b54409862659&role.id=332c8d70fd0f41e2beea20aaead5daa5 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:43.576083 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1e234-0263-49b9-bde8-bdedd9ae9754 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:43.610092 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5008c2d6-bfca-40af-a4f3-d451222bb2fb None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:43.650620 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c33c5-dbe1-477b-b54b-b106af079e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:43.651292 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c33c5-dbe1-477b-b54b-b106af079e74 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:43.651576 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c33c5-dbe1-477b-b54b-b106af079e74 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:43.651876 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c33c5-dbe1-477b-b54b-b106af079e74 None admin] PATH_INFO: `/v3/services` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:43.652603 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62c33c5-dbe1-477b-b54b-b106af079e74 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:43.652906 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62c33c5-dbe1-477b-b54b-b106af079e74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:43.654317 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62c33c5-dbe1-477b-b54b-b106af079e74 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:43.663770 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 428/858] 10.222.0.65 () {56 vars in 1126 bytes} [Tue May 17 18:04:43 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:43.666095 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c33c5-dbe1-477b-b54b-b106af079e74 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:43.706106 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1e234-0263-49b9-bde8-bdedd9ae9754 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:43.741986 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f83f66-0fa3-400c-9582-0f9259059fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:43.742796 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f83f66-0fa3-400c-9582-0f9259059fef None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:43.743189 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f83f66-0fa3-400c-9582-0f9259059fef None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:43.743554 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f83f66-0fa3-400c-9582-0f9259059fef None admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:43.744418 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f83f66-0fa3-400c-9582-0f9259059fef None admin] RBAC: Adding query filter params (name=service) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:43.744846 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f83f66-0fa3-400c-9582-0f9259059fef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:43.746403 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f83f66-0fa3-400c-9582-0f9259059fef None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:43.759480 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 431/859] 10.222.0.65 () {56 vars in 1103 bytes} [Tue May 17 18:04:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:43.764137 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f83f66-0fa3-400c-9582-0f9259059fef None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:43.796017 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c33c5-dbe1-477b-b54b-b106af079e74 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:43.846966 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9cd4bc-8d35-4bf9-ac83-a533a590dcff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:43.848000 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9cd4bc-8d35-4bf9-ac83-a533a590dcff None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:43.848477 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9cd4bc-8d35-4bf9-ac83-a533a590dcff None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:43.848949 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9cd4bc-8d35-4bf9-ac83-a533a590dcff None admin] PATH_INFO: `/v3/services` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:43.850283 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9cd4bc-8d35-4bf9-ac83-a533a590dcff None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:43.851065 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9cd4bc-8d35-4bf9-ac83-a533a590dcff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:43.853240 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9cd4bc-8d35-4bf9-ac83-a533a590dcff None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:43.859983 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 429/860] 10.222.0.65 () {56 vars in 1126 bytes} [Tue May 17 18:04:43 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:43.875402 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f83f66-0fa3-400c-9582-0f9259059fef None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:43.912546 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc6ca5-44df-4898-9a9d-507a4d7e005c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:43.913784 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc6ca5-44df-4898-9a9d-507a4d7e005c None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:43.914263 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc6ca5-44df-4898-9a9d-507a4d7e005c None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:43.914773 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc6ca5-44df-4898-9a9d-507a4d7e005c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:43.928141 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc6ca5-44df-4898-9a9d-507a4d7e005c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:43.930013 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc6ca5-44df-4898-9a9d-507a4d7e005c None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:43.948797 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-5fcc6ca5-44df-4898-9a9d-507a4d7e005c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:43.948797 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:43.948797 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:43.948797 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:43.948797 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:43.948797 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:43.948797 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:43.948797 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:43.948797 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:43.948797 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:43.948797 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:43.948797 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:43.948797 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:04:43.948797 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:04:43.948797 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:04:43.949791 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:04:43.949791 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:43.949791 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:43.949791 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:43.949791 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:43.949791 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:43.949791 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:43.949791 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:43.949791 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:43.949791 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:43.949791 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:43.949791 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:43.949791 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:43.949791 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:43.949791 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:43.949791 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:43.949791 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:43.951715 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:04:43.951715 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:04:43.951715 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:43.951715 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:43.957971 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 432/861] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:04:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:43.959721 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9cd4bc-8d35-4bf9-ac83-a533a590dcff None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:44.070345 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9cd4bc-8d35-4bf9-ac83-a533a590dcff None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:44.103499 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10739a-704f-4609-af5d-90b83d842941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:44.104151 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10739a-704f-4609-af5d-90b83d842941 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:44.104423 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10739a-704f-4609-af5d-90b83d842941 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:44.104689 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe10739a-704f-4609-af5d-90b83d842941 None admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:44.105399 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe10739a-704f-4609-af5d-90b83d842941 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:44.105728 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe10739a-704f-4609-af5d-90b83d842941 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:44.107219 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe10739a-704f-4609-af5d-90b83d842941 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:44.119230 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 430/862] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:04:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:44.125225 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc6ca5-44df-4898-9a9d-507a4d7e005c None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:44.227543 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc6ca5-44df-4898-9a9d-507a4d7e005c None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:44.261178 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53372980-e594-47a6-bd42-2dc353ba9921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:44.262851 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53372980-e594-47a6-bd42-2dc353ba9921 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:44.263366 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53372980-e594-47a6-bd42-2dc353ba9921 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:44.263835 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53372980-e594-47a6-bd42-2dc353ba9921 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:44.271887 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53372980-e594-47a6-bd42-2dc353ba9921 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:44.273703 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53372980-e594-47a6-bd42-2dc353ba9921 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:44.288855 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-53372980-e594-47a6-bd42-2dc353ba9921 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 18:04:44.288855 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:44.288855 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:44.288855 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:44.288855 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:44.288855 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:44.288855 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:44.288855 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:44.288855 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:44.288855 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:44.288855 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:44.288855 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:44.288855 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 18:04:44.288855 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 18:04:44.288855 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 18:04:44.288855 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 18:04:44.289859 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:44.289859 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:44.289859 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 18:04:44.289859 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:04:44.289859 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 18:04:44.289859 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:04:44.289859 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:44.289859 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:44.289859 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:44.289859 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:44.289859 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:44.289859 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:44.289859 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:44.289859 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:44.289859 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:44.289859 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:44.289859 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:44.289859 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:44.290785 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:44.290785 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:44.290785 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 18:04:44.290785 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 18:04:44.290785 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 18:04:44.290785 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 18:04:44.290785 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 18:04:44.290785 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 18:04:44.290785 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 18:04:44.290785 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:44.293370 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 433/863] 10.222.0.65 () {56 vars in 1117 bytes} [Tue May 17 18:04:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:44.299082 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10739a-704f-4609-af5d-90b83d842941 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:44.401393 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe10739a-704f-4609-af5d-90b83d842941 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:44.437119 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95274ad0-c6b4-4d3d-a83d-6140651d8f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:44.437809 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95274ad0-c6b4-4d3d-a83d-6140651d8f12 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:44.438089 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95274ad0-c6b4-4d3d-a83d-6140651d8f12 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:44.438359 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95274ad0-c6b4-4d3d-a83d-6140651d8f12 None admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:44.439251 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95274ad0-c6b4-4d3d-a83d-6140651d8f12 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:44.439559 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95274ad0-c6b4-4d3d-a83d-6140651d8f12 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:44.441039 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95274ad0-c6b4-4d3d-a83d-6140651d8f12 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:44.462574 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 431/864] 10.222.0.65 () {56 vars in 1149 bytes} [Tue May 17 18:04:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:44.467856 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53372980-e594-47a6-bd42-2dc353ba9921 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:44.566705 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53372980-e594-47a6-bd42-2dc353ba9921 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:44.599906 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c8809e-df64-46e4-9309-7f6f49ad1cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:44.600604 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c8809e-df64-46e4-9309-7f6f49ad1cb5 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:44.600877 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c8809e-df64-46e4-9309-7f6f49ad1cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:44.601146 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c8809e-df64-46e4-9309-7f6f49ad1cb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:44.668426 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c8809e-df64-46e4-9309-7f6f49ad1cb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:44.670465 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c8809e-df64-46e4-9309-7f6f49ad1cb5 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:44.768690 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 434/865] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 17 18:04:44 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 18:04:44.774586 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95274ad0-c6b4-4d3d-a83d-6140651d8f12 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:44.878653 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95274ad0-c6b4-4d3d-a83d-6140651d8f12 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:44.912788 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833ac33-135d-47a8-8287-099c48f4864c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:44.913960 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833ac33-135d-47a8-8287-099c48f4864c None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:44.914593 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833ac33-135d-47a8-8287-099c48f4864c None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:44.915084 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0833ac33-135d-47a8-8287-099c48f4864c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:44.925345 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0833ac33-135d-47a8-8287-099c48f4864c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:44.927054 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0833ac33-135d-47a8-8287-099c48f4864c None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:44.945548 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-0833ac33-135d-47a8-8287-099c48f4864c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:44.945548 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:44.945548 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:44.945548 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:44.945548 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:44.945548 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:44.945548 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:44.945548 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:44.945548 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:44.945548 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:44.945548 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:44.945548 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:44.945548 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:04:44.945548 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:04:44.945548 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:04:44.946476 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:04:44.946476 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:44.946476 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:44.946476 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:44.946476 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:44.946476 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:44.946476 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:44.946476 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:44.946476 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:44.946476 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:44.946476 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:44.946476 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:44.946476 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:44.946476 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:44.946476 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:44.946476 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:44.946476 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:44.947343 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:04:44.947343 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:04:44.947343 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:44.947343 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:44.949709 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 432/866] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:04:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:44.958443 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c8809e-df64-46e4-9309-7f6f49ad1cb5 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:45.053968 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c8809e-df64-46e4-9309-7f6f49ad1cb5 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:45.089423 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9219e50a-e220-434b-a32b-1c2383aad579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:45.091887 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219e50a-e220-434b-a32b-1c2383aad579 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:45.092172 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219e50a-e220-434b-a32b-1c2383aad579 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:45.092440 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219e50a-e220-434b-a32b-1c2383aad579 None admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:45.093180 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9219e50a-e220-434b-a32b-1c2383aad579 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:45.093494 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9219e50a-e220-434b-a32b-1c2383aad579 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:45.094905 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9219e50a-e220-434b-a32b-1c2383aad579 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:45.107975 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 435/867] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:04:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:45.113539 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833ac33-135d-47a8-8287-099c48f4864c None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:45.212434 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0833ac33-135d-47a8-8287-099c48f4864c None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:45.245233 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbd0f44-8863-411d-9ebf-4ed809229326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:45.246048 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd0f44-8863-411d-9ebf-4ed809229326 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:45.246322 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd0f44-8863-411d-9ebf-4ed809229326 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:45.246589 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd0f44-8863-411d-9ebf-4ed809229326 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:45.253333 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbd0f44-8863-411d-9ebf-4ed809229326 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:45.254800 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbd0f44-8863-411d-9ebf-4ed809229326 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:45.268722 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-dbbd0f44-8863-411d-9ebf-4ed809229326 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:04:45.268722 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:45.268722 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:45.268722 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:45.268722 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:45.268722 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:45.268722 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:45.268722 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:45.268722 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:45.268722 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:45.268722 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:45.268722 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:45.268722 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 18:04:45.268722 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 18:04:45.268722 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 18:04:45.269615 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 18:04:45.269615 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:45.269615 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:45.269615 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:45.269615 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:45.269615 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:45.269615 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:45.269615 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:45.269615 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:45.269615 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:45.269615 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:45.269615 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:45.269615 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:45.269615 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:45.269615 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:45.269615 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:45.269615 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:45.270532 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 18:04:45.270532 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 18:04:45.270532 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 18:04:45.270532 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 18:04:45.270532 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 18:04:45.270532 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 18:04:45.270532 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:04:45.270532 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:45.270532 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 433/868] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 17 18:04:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:45.275826 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9219e50a-e220-434b-a32b-1c2383aad579 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:45.328466 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce8908-22dd-4bf8-8b1e-0b34130cbd41 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:45.328975 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce8908-22dd-4bf8-8b1e-0b34130cbd41 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:45.328975 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce8908-22dd-4bf8-8b1e-0b34130cbd41 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:45.330660 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 434/869] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:04:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:04:45.335392 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c14051-61f9-4c50-8c90-292be846c237 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:45.335674 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c14051-61f9-4c50-8c90-292be846c237 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:45.335948 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c14051-61f9-4c50-8c90-292be846c237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:45.352640 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-f2c14051-61f9-4c50-8c90-292be846c237 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:45.353819 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-f2c14051-61f9-4c50-8c90-292be846c237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:45.381184 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9219e50a-e220-434b-a32b-1c2383aad579 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:45.415064 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65801085-65f9-4f33-8d3f-f39653e74052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:45.416048 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65801085-65f9-4f33-8d3f-f39653e74052 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:45.416523 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65801085-65f9-4f33-8d3f-f39653e74052 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:45.417039 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65801085-65f9-4f33-8d3f-f39653e74052 None admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:45.418233 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65801085-65f9-4f33-8d3f-f39653e74052 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:45.418819 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65801085-65f9-4f33-8d3f-f39653e74052 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:45.420947 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65801085-65f9-4f33-8d3f-f39653e74052 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:45.429795 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 435/870] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:04:45 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 18:04:45.433973 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 436/871] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 17 18:04:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:45.440010 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c14051-61f9-4c50-8c90-292be846c237 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:45.442827 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65801085-65f9-4f33-8d3f-f39653e74052 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:45.550722 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65801085-65f9-4f33-8d3f-f39653e74052 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:45.553859 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c14051-61f9-4c50-8c90-292be846c237 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:45.586031 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e3274-0b06-4fd6-b0f9-a8b43db87a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:45.587047 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e3274-0b06-4fd6-b0f9-a8b43db87a08 None admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:45.587522 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e3274-0b06-4fd6-b0f9-a8b43db87a08 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:45.588004 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e3274-0b06-4fd6-b0f9-a8b43db87a08 None admin] PATH_INFO: `/v3/services` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:45.588277 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1840811f-41d7-451f-80d0-df0528c2b83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:45.588932 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840811f-41d7-451f-80d0-df0528c2b83a None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:45.589209 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840811f-41d7-451f-80d0-df0528c2b83a None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:45.589495 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1840811f-41d7-451f-80d0-df0528c2b83a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:45.589831 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3e3274-0b06-4fd6-b0f9-a8b43db87a08 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:45.590326 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1840811f-41d7-451f-80d0-df0528c2b83a None admin] RBAC: Adding query filter params (role.id=60e39e2185d346a192b8698767df6018, scope.project.id=0cf165918c1f46cb96d4b54409862659, user.id=f370e353067848b5843c5650183be347) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:45.590629 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1840811f-41d7-451f-80d0-df0528c2b83a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:45.592173 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1840811f-41d7-451f-80d0-df0528c2b83a None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:45.592282 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3e3274-0b06-4fd6-b0f9-a8b43db87a08 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:45.599204 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 436/872] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 17 18:04:45 2022] GET /identity/v3/role_assignments?user.id=f370e353067848b5843c5650183be347&scope.project.id=0cf165918c1f46cb96d4b54409862659&role.id=60e39e2185d346a192b8698767df6018 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:45.613878 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 437/873] 10.222.0.65 () {60 vars in 1141 bytes} [Tue May 17 18:04:45 2022] POST /identity/v3/services => generated 251 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:04:45.933316 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9745fa33-3ae9-4f42-9ed0-e804147dfb93 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:45.933665 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9745fa33-3ae9-4f42-9ed0-e804147dfb93 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:45.933912 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9745fa33-3ae9-4f42-9ed0-e804147dfb93 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:45.935559 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 437/874] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:04:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:04:45.940846 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af4c3c-a14c-491d-942a-82493317b23a None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:45.941129 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af4c3c-a14c-491d-942a-82493317b23a None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:45.941406 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45af4c3c-a14c-491d-942a-82493317b23a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:45.959391 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-45af4c3c-a14c-491d-942a-82493317b23a None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:45.960725 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-45af4c3c-a14c-491d-942a-82493317b23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:46.042602 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 438/875] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:04:45 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:04:46.064555 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9745fa33-3ae9-4f42-9ed0-e804147dfb93 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:46.169397 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9745fa33-3ae9-4f42-9ed0-e804147dfb93 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:46.195389 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c82f8b-81e2-48ec-96c4-72a066f6f217 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:46.195570 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c82f8b-81e2-48ec-96c4-72a066f6f217 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:46.195852 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c82f8b-81e2-48ec-96c4-72a066f6f217 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:46.197486 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 439/876] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:04:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 18:04:46.202923 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea6177-f63c-45e1-862e-1670b60d451f None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:46.203204 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea6177-f63c-45e1-862e-1670b60d451f None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:46.203477 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea6177-f63c-45e1-862e-1670b60d451f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:46.205517 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018245f4-2155-43ec-a2ce-659b313c5878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:46.206548 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018245f4-2155-43ec-a2ce-659b313c5878 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:46.206968 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018245f4-2155-43ec-a2ce-659b313c5878 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:46.207375 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018245f4-2155-43ec-a2ce-659b313c5878 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:46.208363 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018245f4-2155-43ec-a2ce-659b313c5878 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:46.210468 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018245f4-2155-43ec-a2ce-659b313c5878 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:46.221010 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-f1ea6177-f63c-45e1-862e-1670b60d451f None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:46.222212 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-f1ea6177-f63c-45e1-862e-1670b60d451f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:46.227720 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-018245f4-2155-43ec-a2ce-659b313c5878 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 18:04:46.227720 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:46.227720 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 18:04:46.227720 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 18:04:46.227720 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 18:04:46.227720 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 18:04:46.227720 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 18:04:46.227720 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:04:46.227720 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 18:04:46.227720 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:46.227720 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 18:04:46.227720 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:46.227720 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:46.227720 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:46.227720 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:46.227720 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:46.227720 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:46.228743 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:46.228743 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:46.228743 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:46.228743 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:46.228743 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:46.228743 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:46.228743 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 18:04:46.228743 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 18:04:46.228743 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 18:04:46.228743 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 18:04:46.228743 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:46.228743 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:46.228743 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:46.228743 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:46.228743 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:46.228743 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:46.229622 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:46.229622 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:46.229622 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:46.229622 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:46.229622 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:46.229622 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:46.229622 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:46.229622 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:46.229622 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:46.229622 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:46.229622 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 18:04:46.229622 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:04:46.229622 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 18:04:46.229622 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:46.231292 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 438/877] 10.222.0.65 () {56 vars in 1126 bytes} [Tue May 17 18:04:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:46.237392 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018245f4-2155-43ec-a2ce-659b313c5878 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:46.309674 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 440/878] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:04:46 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 18:04:46.324118 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ea6177-f63c-45e1-862e-1670b60d451f None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:46.352597 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018245f4-2155-43ec-a2ce-659b313c5878 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:46.388198 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20250bfd-c3ed-48f4-83c6-8f1bc2ff6014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:46.389132 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20250bfd-c3ed-48f4-83c6-8f1bc2ff6014 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:46.389584 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20250bfd-c3ed-48f4-83c6-8f1bc2ff6014 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:46.390023 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20250bfd-c3ed-48f4-83c6-8f1bc2ff6014 None admin] PATH_INFO: `/v3/services` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:46.390880 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20250bfd-c3ed-48f4-83c6-8f1bc2ff6014 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:46.391343 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20250bfd-c3ed-48f4-83c6-8f1bc2ff6014 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:46.392854 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20250bfd-c3ed-48f4-83c6-8f1bc2ff6014 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:46.398217 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 439/879] 10.222.0.65 () {56 vars in 1122 bytes} [Tue May 17 18:04:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:46.403229 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20250bfd-c3ed-48f4-83c6-8f1bc2ff6014 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:46.429871 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ea6177-f63c-45e1-862e-1670b60d451f None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:46.463408 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b23c8-9208-40d7-ae46-72e92f0b668b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:46.464094 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b23c8-9208-40d7-ae46-72e92f0b668b None admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:46.464283 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b23c8-9208-40d7-ae46-72e92f0b668b None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:46.464548 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b23c8-9208-40d7-ae46-72e92f0b668b None admin] PATH_INFO: `/v3/services` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:46.465260 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9b23c8-9208-40d7-ae46-72e92f0b668b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:46.467198 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9b23c8-9208-40d7-ae46-72e92f0b668b None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:46.489697 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 441/880] 10.222.0.65 () {60 vars in 1141 bytes} [Tue May 17 18:04:46 2022] POST /identity/v3/services => generated 269 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:04:46.519592 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20250bfd-c3ed-48f4-83c6-8f1bc2ff6014 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:46.562882 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc95b978-43dc-4077-8df2-46e73ed8fcd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:46.563955 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc95b978-43dc-4077-8df2-46e73ed8fcd5 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:46.564450 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc95b978-43dc-4077-8df2-46e73ed8fcd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:46.564975 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc95b978-43dc-4077-8df2-46e73ed8fcd5 None admin] PATH_INFO: `/v3/services` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:46.565970 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc95b978-43dc-4077-8df2-46e73ed8fcd5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:46.566547 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc95b978-43dc-4077-8df2-46e73ed8fcd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:46.568502 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc95b978-43dc-4077-8df2-46e73ed8fcd5 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:46.574671 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 440/881] 10.222.0.65 () {56 vars in 1122 bytes} [Tue May 17 18:04:46 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:47.955649 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66630c9-838a-471e-b916-8f14b74dbefe None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:47.956230 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66630c9-838a-471e-b916-8f14b74dbefe None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:47.956230 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66630c9-838a-471e-b916-8f14b74dbefe None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:47.957820 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 442/882] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:04:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:04:47.963183 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b082b-8306-4a63-8a69-7119f25b016f None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:47.963590 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b082b-8306-4a63-8a69-7119f25b016f None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:47.963832 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b082b-8306-4a63-8a69-7119f25b016f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:47.978947 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b9e0a-4483-4f67-b0c2-a3a292e8791f None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:47.979249 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b9e0a-4483-4f67-b0c2-a3a292e8791f None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:47.979497 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b9e0a-4483-4f67-b0c2-a3a292e8791f None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:47.980962 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 443/883] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:04:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 18:04:47.984841 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-d35b082b-8306-4a63-8a69-7119f25b016f None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:47.986343 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-d35b082b-8306-4a63-8a69-7119f25b016f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:47.987113 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b37bbf-e82c-495e-9f7d-7dec35388062 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:47.987613 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b37bbf-e82c-495e-9f7d-7dec35388062 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:47.988096 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b37bbf-e82c-495e-9f7d-7dec35388062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:48.008080 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-66b37bbf-e82c-495e-9f7d-7dec35388062 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:48.009706 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-66b37bbf-e82c-495e-9f7d-7dec35388062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:48.059225 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 441/884] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:04:47 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:04:48.080383 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 444/885] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:04:47 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 18:04:48.085517 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b082b-8306-4a63-8a69-7119f25b016f None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:48.103833 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b37bbf-e82c-495e-9f7d-7dec35388062 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:48.204689 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b37bbf-e82c-495e-9f7d-7dec35388062 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:48.208126 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b082b-8306-4a63-8a69-7119f25b016f None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:48.239208 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa0f40-cea8-4796-97f9-8c9416bd5c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:48.240085 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa0f40-cea8-4796-97f9-8c9416bd5c2c None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:48.240290 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa0f40-cea8-4796-97f9-8c9416bd5c2c None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:48.240561 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa0f40-cea8-4796-97f9-8c9416bd5c2c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:48.250636 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6040a428-3971-439a-a5d1-aeaf5bb5e738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:48.250841 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfa0f40-cea8-4796-97f9-8c9416bd5c2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:04:48.251897 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040a428-3971-439a-a5d1-aeaf5bb5e738 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:48.252397 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040a428-3971-439a-a5d1-aeaf5bb5e738 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:48.252878 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040a428-3971-439a-a5d1-aeaf5bb5e738 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:48.253774 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6040a428-3971-439a-a5d1-aeaf5bb5e738 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:48.255343 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6040a428-3971-439a-a5d1-aeaf5bb5e738 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:48.259034 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-edfa0f40-cea8-4796-97f9-8c9416bd5c2c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 18:04:48.259034 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:48.259034 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:48.259034 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:48.259034 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:48.259034 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:48.259034 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:48.259034 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:48.259034 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:48.259034 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:48.259034 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:48.259034 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:48.259034 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:04:48.259034 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:04:48.259034 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:04:48.259034 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:04:48.260035 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:04:48.260035 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:04:48.260035 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:04:48.260035 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:04:48.260035 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:48.260035 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:48.260035 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:48.260035 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:48.260035 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:48.260035 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:48.260035 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:48.260035 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:48.260035 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:48.260035 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:48.260035 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:48.260035 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:48.260946 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:48.260946 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:48.260946 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:48.260946 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:48.260946 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:04:48.260946 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:04:48.260946 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:04:48.260946 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:04:48.260946 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:04:48.260946 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:04:48.260946 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 18:04:48.260946 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:48.265709 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 445/886] 10.222.0.65 () {56 vars in 1120 bytes} [Tue May 17 18:04:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:48.266698 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa0f40-cea8-4796-97f9-8c9416bd5c2c None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:48.273545 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-6040a428-3971-439a-a5d1-aeaf5bb5e738 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 17 18:04:48.273545 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:48.273545 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 18:04:48.273545 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 18:04:48.273545 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 18:04:48.273545 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 18:04:48.273545 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 18:04:48.273545 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:04:48.273545 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 17 18:04:48.273545 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:48.273545 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 18:04:48.273545 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:48.273545 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:48.273545 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:48.273545 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:48.273545 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:48.273545 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:48.274581 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:48.274581 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:48.274581 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:48.274581 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:48.274581 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:48.274581 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:48.274581 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 18:04:48.274581 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 18:04:48.274581 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 18:04:48.274581 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 18:04:48.274581 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:48.274581 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:48.274581 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:48.274581 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:48.274581 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:48.274581 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:48.275502 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:48.275502 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:48.275502 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:48.275502 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:48.275502 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:48.275502 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:48.275502 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:48.275502 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:48.275502 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:48.275502 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:48.275502 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 18:04:48.275502 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:04:48.275502 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 17 18:04:48.275502 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:48.279725 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 442/887] 10.222.0.65 () {56 vars in 1114 bytes} [Tue May 17 18:04:48 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:48.285090 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6040a428-3971-439a-a5d1-aeaf5bb5e738 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:48.375213 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa0f40-cea8-4796-97f9-8c9416bd5c2c None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:48.389673 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6040a428-3971-439a-a5d1-aeaf5bb5e738 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:48.410258 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5606d676-3e82-4fab-b689-61071f000b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:48.410936 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606d676-3e82-4fab-b689-61071f000b5f None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:48.411219 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606d676-3e82-4fab-b689-61071f000b5f None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:48.411497 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606d676-3e82-4fab-b689-61071f000b5f None admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:48.412312 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5606d676-3e82-4fab-b689-61071f000b5f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:48.412559 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5606d676-3e82-4fab-b689-61071f000b5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:48.414057 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5606d676-3e82-4fab-b689-61071f000b5f None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:48.426981 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea652ee-47e4-4e93-be38-700aaaea0ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:48.427684 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 446/888] 10.222.0.65 () {56 vars in 1115 bytes} [Tue May 17 18:04:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:04:48.428524 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea652ee-47e4-4e93-be38-700aaaea0ac9 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:48.428632 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5606d676-3e82-4fab-b689-61071f000b5f None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:48.429233 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea652ee-47e4-4e93-be38-700aaaea0ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:48.429747 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea652ee-47e4-4e93-be38-700aaaea0ac9 None admin] PATH_INFO: `/v3/services` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:48.430672 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea652ee-47e4-4e93-be38-700aaaea0ac9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:48.431195 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea652ee-47e4-4e93-be38-700aaaea0ac9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:48.432768 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea652ee-47e4-4e93-be38-700aaaea0ac9 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:48.438403 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 443/889] 10.222.0.65 () {56 vars in 1114 bytes} [Tue May 17 18:04:48 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:04:48.444386 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea652ee-47e4-4e93-be38-700aaaea0ac9 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:48.552228 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5606d676-3e82-4fab-b689-61071f000b5f None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:48.568542 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea652ee-47e4-4e93-be38-700aaaea0ac9 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:48.593446 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5656b1c3-c462-402f-85c8-89cd1b66b8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:48.593912 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656b1c3-c462-402f-85c8-89cd1b66b8a1 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:48.594191 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656b1c3-c462-402f-85c8-89cd1b66b8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:48.594462 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5656b1c3-c462-402f-85c8-89cd1b66b8a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:48.605544 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5656b1c3-c462-402f-85c8-89cd1b66b8a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:48.607055 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5656b1c3-c462-402f-85c8-89cd1b66b8a1 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:48.612000 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f9d025-3fd0-4b43-877f-8365e915a045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:48.613071 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9d025-3fd0-4b43-877f-8365e915a045 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:48.613585 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9d025-3fd0-4b43-877f-8365e915a045 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:48.614095 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f9d025-3fd0-4b43-877f-8365e915a045 None admin] PATH_INFO: `/v3/services` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:48.615778 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f9d025-3fd0-4b43-877f-8365e915a045 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:48.616342 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f9d025-3fd0-4b43-877f-8365e915a045 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:48.618719 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f9d025-3fd0-4b43-877f-8365e915a045 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:48.625539 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 444/890] 10.222.0.65 () {56 vars in 1114 bytes} [Tue May 17 18:04:48 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:04:48.630808 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-5656b1c3-c462-402f-85c8-89cd1b66b8a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:48.630808 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:48.630808 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:48.630808 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:48.630808 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:48.630808 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:48.630808 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:48.630808 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:48.630808 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:48.630808 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:48.630808 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:48.630808 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:48.630808 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:04:48.630808 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:04:48.630808 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:04:48.631793 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:04:48.631793 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:48.631793 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:48.631793 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:48.631793 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:48.631793 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:48.631793 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:48.631793 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:48.631793 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:48.631793 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:48.631793 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:48.631793 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:48.631793 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:48.631793 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:48.631793 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:48.631793 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:48.631793 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:48.632685 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:04:48.632685 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:04:48.632685 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:48.632685 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:48.632685 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 447/891] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:04:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:48.633415 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f9d025-3fd0-4b43-877f-8365e915a045 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:48.639506 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5656b1c3-c462-402f-85c8-89cd1b66b8a1 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:48.749689 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f9d025-3fd0-4b43-877f-8365e915a045 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:48.758441 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5656b1c3-c462-402f-85c8-89cd1b66b8a1 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:48.789290 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06587dbb-9845-4039-a03a-446afbf26478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:48.790054 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06587dbb-9845-4039-a03a-446afbf26478 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:48.790331 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06587dbb-9845-4039-a03a-446afbf26478 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:48.790604 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06587dbb-9845-4039-a03a-446afbf26478 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:48.791542 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06587dbb-9845-4039-a03a-446afbf26478 None admin] RBAC: Adding query filter params (interface=public, service_id=e454445aa4194c5da2090e8ed349213a, region_id=RegionOne) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:48.791848 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06587dbb-9845-4039-a03a-446afbf26478 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:48.793506 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06587dbb-9845-4039-a03a-446afbf26478 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:48.794671 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc165309-55ce-4370-8456-280f245da356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:48.795580 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc165309-55ce-4370-8456-280f245da356 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:48.796082 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc165309-55ce-4370-8456-280f245da356 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:48.796570 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc165309-55ce-4370-8456-280f245da356 None admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:48.797551 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc165309-55ce-4370-8456-280f245da356 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:48.798091 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc165309-55ce-4370-8456-280f245da356 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:48.799180 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 445/892] 10.222.0.65 () {56 vars in 1251 bytes} [Tue May 17 18:04:48 2022] GET /identity/v3/endpoints?service_id=e454445aa4194c5da2090e8ed349213a&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:48.800664 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb021e-6a12-4a93-8620-e959d3590b3b None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:48.800945 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb021e-6a12-4a93-8620-e959d3590b3b None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:48.801216 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cb021e-6a12-4a93-8620-e959d3590b3b None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:48.802603 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 446/893] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:04:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:04:48.803897 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb021e-6a12-4a93-8620-e959d3590b3b None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:48.804122 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc165309-55ce-4370-8456-280f245da356 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:48.817801 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 448/894] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:04:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:04:48.819435 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449265ae-5487-450e-8960-5e99a314401e None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:48.819959 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449265ae-5487-450e-8960-5e99a314401e None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:48.820457 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449265ae-5487-450e-8960-5e99a314401e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:48.837073 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-449265ae-5487-450e-8960-5e99a314401e None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:48.838287 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-449265ae-5487-450e-8960-5e99a314401e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:48.901666 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 449/895] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:04:48 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:04:48.902514 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449265ae-5487-450e-8960-5e99a314401e None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:48.914719 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cb021e-6a12-4a93-8620-e959d3590b3b None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:48.948320 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84dd679-5722-4ede-ad42-31d44bfc8243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:48.948972 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84dd679-5722-4ede-ad42-31d44bfc8243 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:48.949258 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84dd679-5722-4ede-ad42-31d44bfc8243 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:48.949559 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84dd679-5722-4ede-ad42-31d44bfc8243 None admin] PATH_INFO: `/v3/services` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:48.950827 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84dd679-5722-4ede-ad42-31d44bfc8243 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:48.952181 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84dd679-5722-4ede-ad42-31d44bfc8243 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:48.957651 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 447/896] 10.222.0.65 () {56 vars in 1087 bytes} [Tue May 17 18:04:48 2022] GET /identity/v3/services => generated 1268 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:04:48.958899 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977343e4-aa8e-4b3a-b3d4-ffb6f47c5c9a None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:48.959184 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977343e4-aa8e-4b3a-b3d4-ffb6f47c5c9a None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:48.959457 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977343e4-aa8e-4b3a-b3d4-ffb6f47c5c9a None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:48.960676 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 448/897] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:04:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:04:48.961401 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977343e4-aa8e-4b3a-b3d4-ffb6f47c5c9a None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:49.013518 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449265ae-5487-450e-8960-5e99a314401e None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:49.049616 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d250c6-f058-4c13-95ee-ebe75dbd65e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:49.050443 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d250c6-f058-4c13-95ee-ebe75dbd65e1 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:49.050724 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d250c6-f058-4c13-95ee-ebe75dbd65e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:49.050997 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d250c6-f058-4c13-95ee-ebe75dbd65e1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:49.058756 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d250c6-f058-4c13-95ee-ebe75dbd65e1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:49.060822 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d250c6-f058-4c13-95ee-ebe75dbd65e1 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:49.071832 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977343e4-aa8e-4b3a-b3d4-ffb6f47c5c9a None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:49.077078 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-a0d250c6-f058-4c13-95ee-ebe75dbd65e1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 18:04:49.077078 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:49.077078 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:49.077078 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:49.077078 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:49.077078 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:49.077078 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:49.077078 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:49.077078 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:49.077078 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:49.077078 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:49.077078 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:49.077078 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 18:04:49.077078 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 18:04:49.077078 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 18:04:49.077078 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 18:04:49.078128 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:49.078128 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:49.078128 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 18:04:49.078128 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:04:49.078128 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 18:04:49.078128 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:04:49.078128 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:49.078128 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:49.078128 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:49.078128 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:49.078128 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:49.078128 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:49.078128 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:49.078128 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:49.078128 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:49.078128 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:49.078128 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:49.078128 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:49.079068 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:49.079068 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:49.079068 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 18:04:49.079068 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 18:04:49.079068 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 18:04:49.079068 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 18:04:49.079068 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 18:04:49.079068 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 18:04:49.079068 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 18:04:49.079068 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:49.082977 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 450/898] 10.222.0.65 () {56 vars in 1117 bytes} [Tue May 17 18:04:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:49.083567 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351667b-483a-42e3-aa03-877748f0b770 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:49.083832 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351667b-483a-42e3-aa03-877748f0b770 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:49.084108 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351667b-483a-42e3-aa03-877748f0b770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:49.101431 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-4351667b-483a-42e3-aa03-877748f0b770 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:49.102664 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-4351667b-483a-42e3-aa03-877748f0b770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:49.112099 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0479d85c-d9bd-4931-96d3-10b964c05af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:49.112912 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479d85c-d9bd-4931-96d3-10b964c05af8 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:49.113206 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479d85c-d9bd-4931-96d3-10b964c05af8 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:49.113507 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479d85c-d9bd-4931-96d3-10b964c05af8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:49.114179 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0479d85c-d9bd-4931-96d3-10b964c05af8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:49.115632 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0479d85c-d9bd-4931-96d3-10b964c05af8 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:49.129290 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-0479d85c-d9bd-4931-96d3-10b964c05af8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 17 18:04:49.129290 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:49.129290 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 18:04:49.129290 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 18:04:49.129290 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 18:04:49.129290 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 18:04:49.129290 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 18:04:49.129290 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:04:49.129290 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 17 18:04:49.129290 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:49.129290 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 18:04:49.129290 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:49.129290 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:49.129290 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:49.129290 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:49.129290 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:49.130620 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:49.130620 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:49.130620 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:49.130620 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:49.130620 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:49.130620 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:49.130620 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:49.130620 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 18:04:49.130620 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 18:04:49.130620 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 18:04:49.130620 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 18:04:49.130620 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:49.130620 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:49.130620 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:49.130620 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:49.130620 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:49.131724 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:49.131724 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:49.131724 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:49.131724 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:49.131724 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:49.131724 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:49.131724 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:49.131724 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:49.131724 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:49.131724 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:49.131724 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:49.131724 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 18:04:49.131724 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:04:49.131724 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 17 18:04:49.131724 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:49.135736 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 449/899] 10.222.0.65 () {56 vars in 1132 bytes} [Tue May 17 18:04:48 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:49.136626 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0479d85c-d9bd-4931-96d3-10b964c05af8 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:49.180687 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 451/900] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:04:49 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:04:49.181289 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4351667b-483a-42e3-aa03-877748f0b770 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:49.243574 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0479d85c-d9bd-4931-96d3-10b964c05af8 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:49.276171 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e81c87-2e5b-4b23-942e-9795cb2fb373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:49.276825 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e81c87-2e5b-4b23-942e-9795cb2fb373 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:49.277100 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e81c87-2e5b-4b23-942e-9795cb2fb373 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:49.277366 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e81c87-2e5b-4b23-942e-9795cb2fb373 None admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:49.278326 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e81c87-2e5b-4b23-942e-9795cb2fb373 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:49.279162 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e81c87-2e5b-4b23-942e-9795cb2fb373 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:49.280579 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e81c87-2e5b-4b23-942e-9795cb2fb373 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:49.297732 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 450/901] 10.222.0.65 () {56 vars in 1149 bytes} [Tue May 17 18:04:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:49.298195 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4351667b-483a-42e3-aa03-877748f0b770 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:49.299111 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e81c87-2e5b-4b23-942e-9795cb2fb373 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:49.336549 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4426461a-00c0-424b-b488-df5d47df830c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:49.337269 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4426461a-00c0-424b-b488-df5d47df830c None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:49.337584 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4426461a-00c0-424b-b488-df5d47df830c None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:49.337917 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4426461a-00c0-424b-b488-df5d47df830c None admin] PATH_INFO: `/v3/services` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:49.338628 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4426461a-00c0-424b-b488-df5d47df830c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:49.338933 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4426461a-00c0-424b-b488-df5d47df830c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:49.340312 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4426461a-00c0-424b-b488-df5d47df830c None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:49.346090 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 452/902] 10.222.0.65 () {56 vars in 1126 bytes} [Tue May 17 18:04:49 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:49.346874 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4426461a-00c0-424b-b488-df5d47df830c None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:49.405298 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e81c87-2e5b-4b23-942e-9795cb2fb373 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:49.439256 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0738815-bb1d-40b5-b7b3-2c76dc10d6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:49.440171 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0738815-bb1d-40b5-b7b3-2c76dc10d6ca None admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:49.440449 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0738815-bb1d-40b5-b7b3-2c76dc10d6ca None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:49.440722 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0738815-bb1d-40b5-b7b3-2c76dc10d6ca None admin] PATH_INFO: `/v3/services` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:49.441437 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0738815-bb1d-40b5-b7b3-2c76dc10d6ca None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:49.443090 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0738815-bb1d-40b5-b7b3-2c76dc10d6ca None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:49.446131 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4426461a-00c0-424b-b488-df5d47df830c None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:49.458047 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 451/903] 10.222.0.65 () {60 vars in 1141 bytes} [Tue May 17 18:04:49 2022] POST /identity/v3/services => generated 241 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:04:49.459105 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0738815-bb1d-40b5-b7b3-2c76dc10d6ca None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:49.505356 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed1597e-adce-41a6-afee-653f5ea38d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:49.506061 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed1597e-adce-41a6-afee-653f5ea38d84 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:49.506338 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed1597e-adce-41a6-afee-653f5ea38d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:49.506609 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed1597e-adce-41a6-afee-653f5ea38d84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:49.590606 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed1597e-adce-41a6-afee-653f5ea38d84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:49.592664 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed1597e-adce-41a6-afee-653f5ea38d84 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:49.597830 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0738815-bb1d-40b5-b7b3-2c76dc10d6ca None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:49.635584 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd6feb-3895-4153-914d-715dbbf48e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:49.636273 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd6feb-3895-4153-914d-715dbbf48e25 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:49.636601 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd6feb-3895-4153-914d-715dbbf48e25 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:49.636879 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd6feb-3895-4153-914d-715dbbf48e25 None admin] PATH_INFO: `/v3/services` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:49.637704 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbd6feb-3895-4153-914d-715dbbf48e25 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:49.638010 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbd6feb-3895-4153-914d-715dbbf48e25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:49.639393 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbd6feb-3895-4153-914d-715dbbf48e25 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:49.646270 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 452/904] 10.222.0.65 () {56 vars in 1126 bytes} [Tue May 17 18:04:49 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:49.652211 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd6feb-3895-4153-914d-715dbbf48e25 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:49.711966 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 453/905] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 17 18:04:49 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 18:04:49.717836 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed1597e-adce-41a6-afee-653f5ea38d84 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:49.769871 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd6feb-3895-4153-914d-715dbbf48e25 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:49.804269 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff8dd01-9624-4820-98ae-2603193b9a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:49.805215 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8dd01-9624-4820-98ae-2603193b9a2c None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:49.805739 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8dd01-9624-4820-98ae-2603193b9a2c None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:49.806166 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff8dd01-9624-4820-98ae-2603193b9a2c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:49.807093 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff8dd01-9624-4820-98ae-2603193b9a2c None admin] RBAC: Adding query filter params (interface=public, service_id=cd9daaa2926741d881898a284f457d1b, region_id=RegionOne) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:49.807559 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff8dd01-9624-4820-98ae-2603193b9a2c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:49.809006 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff8dd01-9624-4820-98ae-2603193b9a2c None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:49.815836 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 453/906] 10.222.0.65 () {56 vars in 1251 bytes} [Tue May 17 18:04:49 2022] GET /identity/v3/endpoints?service_id=cd9daaa2926741d881898a284f457d1b&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:49.825639 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff8dd01-9624-4820-98ae-2603193b9a2c None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:49.835398 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed1597e-adce-41a6-afee-653f5ea38d84 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:49.870111 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c6954f-5963-4d51-bab3-8b0b05e1bfb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:49.871389 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6954f-5963-4d51-bab3-8b0b05e1bfb8 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:49.871389 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6954f-5963-4d51-bab3-8b0b05e1bfb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:49.871833 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6954f-5963-4d51-bab3-8b0b05e1bfb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:49.882903 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c6954f-5963-4d51-bab3-8b0b05e1bfb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:49.884460 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c6954f-5963-4d51-bab3-8b0b05e1bfb8 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:49.902461 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-31c6954f-5963-4d51-bab3-8b0b05e1bfb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:49.902461 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:49.902461 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:49.902461 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:49.902461 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:49.902461 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:49.902461 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:49.902461 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:49.902461 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:49.902461 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:49.902461 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:49.902461 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:49.902461 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:04:49.902461 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:04:49.902461 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:04:49.903511 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:04:49.903511 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:49.903511 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:49.903511 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:49.903511 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:49.903511 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:49.903511 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:49.903511 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:49.903511 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:49.903511 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:49.903511 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:49.903511 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:49.903511 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:49.903511 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:49.903511 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:49.903511 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:49.903511 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:49.904403 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:04:49.904403 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:04:49.904403 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:49.904403 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:49.904621 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 454/907] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:04:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:49.910373 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c6954f-5963-4d51-bab3-8b0b05e1bfb8 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:49.935815 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff8dd01-9624-4820-98ae-2603193b9a2c None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:49.976002 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9dc256-290b-42c6-ad0a-1e17af27c06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:49.976488 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9dc256-290b-42c6-ad0a-1e17af27c06a None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:49.976769 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9dc256-290b-42c6-ad0a-1e17af27c06a None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:49.977041 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9dc256-290b-42c6-ad0a-1e17af27c06a None admin] PATH_INFO: `/v3/services` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:49.977805 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9dc256-290b-42c6-ad0a-1e17af27c06a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:49.979271 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9dc256-290b-42c6-ad0a-1e17af27c06a None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:49.986167 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 454/908] 10.222.0.65 () {56 vars in 1087 bytes} [Tue May 17 18:04:49 2022] GET /identity/v3/services => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:04:50.025689 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c6954f-5963-4d51-bab3-8b0b05e1bfb8 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:50.074542 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa82ff-9b2f-4ce0-a527-afac3e308bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:50.075542 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa82ff-9b2f-4ce0-a527-afac3e308bd2 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:50.075878 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa82ff-9b2f-4ce0-a527-afac3e308bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:50.076259 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa82ff-9b2f-4ce0-a527-afac3e308bd2 None admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:50.077347 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa82ff-9b2f-4ce0-a527-afac3e308bd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:50.077915 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa82ff-9b2f-4ce0-a527-afac3e308bd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:50.079933 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa82ff-9b2f-4ce0-a527-afac3e308bd2 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:50.101657 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 455/909] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:04:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:50.105424 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9dc256-290b-42c6-ad0a-1e17af27c06a None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:50.230502 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9dc256-290b-42c6-ad0a-1e17af27c06a None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:50.274026 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b5eed0-67d7-4efc-8803-d628e9e7084c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:50.275109 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5eed0-67d7-4efc-8803-d628e9e7084c None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:50.275485 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5eed0-67d7-4efc-8803-d628e9e7084c None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:50.275872 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5eed0-67d7-4efc-8803-d628e9e7084c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:50.284643 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b5eed0-67d7-4efc-8803-d628e9e7084c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:50.287313 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b5eed0-67d7-4efc-8803-d628e9e7084c None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:50.306509 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-39b5eed0-67d7-4efc-8803-d628e9e7084c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:04:50.306509 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:50.306509 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:50.306509 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:50.306509 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:50.306509 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:50.306509 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:50.306509 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:50.306509 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:50.306509 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:50.306509 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:50.306509 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:50.306509 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 18:04:50.306509 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 18:04:50.306509 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 18:04:50.307463 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 18:04:50.307463 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:50.307463 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:50.307463 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:50.307463 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:50.307463 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:50.307463 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:50.307463 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:50.307463 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:50.307463 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:50.307463 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:50.307463 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:50.307463 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:50.307463 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:50.307463 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:50.307463 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:50.307463 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:50.309023 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 18:04:50.309023 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 18:04:50.309023 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 18:04:50.309023 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 18:04:50.309023 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 18:04:50.309023 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 18:04:50.309023 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:04:50.309023 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:50.309023 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 455/910] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 17 18:04:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:04:50.314088 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa82ff-9b2f-4ce0-a527-afac3e308bd2 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:50.415424 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa82ff-9b2f-4ce0-a527-afac3e308bd2 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:50.457174 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e22f860-e5de-4ade-9a05-62e49865929c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:50.457874 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22f860-e5de-4ade-9a05-62e49865929c None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:50.458156 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22f860-e5de-4ade-9a05-62e49865929c None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:50.458428 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22f860-e5de-4ade-9a05-62e49865929c None admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:50.459216 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e22f860-e5de-4ade-9a05-62e49865929c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:50.459522 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e22f860-e5de-4ade-9a05-62e49865929c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:50.460955 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e22f860-e5de-4ade-9a05-62e49865929c None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:50.474324 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 456/911] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 17 18:04:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:50.482633 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b5eed0-67d7-4efc-8803-d628e9e7084c None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:50.587082 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b5eed0-67d7-4efc-8803-d628e9e7084c None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:50.621000 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c1d2ab-0e21-4b29-b897-f3f30760f003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:50.621683 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1d2ab-0e21-4b29-b897-f3f30760f003 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:50.621992 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1d2ab-0e21-4b29-b897-f3f30760f003 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:50.622271 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1d2ab-0e21-4b29-b897-f3f30760f003 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:50.623099 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c1d2ab-0e21-4b29-b897-f3f30760f003 None admin] RBAC: Adding query filter params (role.id=389e932f10c643a2aa76b3a21351e061, scope.project.id=0cf165918c1f46cb96d4b54409862659, user.id=f370e353067848b5843c5650183be347) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:50.623408 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c1d2ab-0e21-4b29-b897-f3f30760f003 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:50.624841 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c1d2ab-0e21-4b29-b897-f3f30760f003 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:50.638127 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 456/912] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 17 18:04:50 2022] GET /identity/v3/role_assignments?user.id=f370e353067848b5843c5650183be347&scope.project.id=0cf165918c1f46cb96d4b54409862659&role.id=389e932f10c643a2aa76b3a21351e061 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:51.677831 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a844b-68cb-4d2a-bde2-f3ed957fed40 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:51.678369 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a844b-68cb-4d2a-bde2-f3ed957fed40 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:51.678675 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a844b-68cb-4d2a-bde2-f3ed957fed40 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:51.681303 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 457/913] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:04:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:04:51.690082 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc44d598-c9e3-4ff4-a542-76cf076a2c03 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:51.690598 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc44d598-c9e3-4ff4-a542-76cf076a2c03 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:51.691025 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc44d598-c9e3-4ff4-a542-76cf076a2c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:51.716414 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-dc44d598-c9e3-4ff4-a542-76cf076a2c03 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:51.718152 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-dc44d598-c9e3-4ff4-a542-76cf076a2c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:51.825607 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 457/914] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:04:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:04:51.851260 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867a844b-68cb-4d2a-bde2-f3ed957fed40 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:51.868164 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef477b-9401-41e2-a221-df3a8e0a6387 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:51.868549 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef477b-9401-41e2-a221-df3a8e0a6387 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:51.868934 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef477b-9401-41e2-a221-df3a8e0a6387 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:51.871937 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 458/915] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:04:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:04:51.877917 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6770ee-84d9-4fe9-a23c-2220a177cfbf None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:51.878489 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6770ee-84d9-4fe9-a23c-2220a177cfbf None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:51.879053 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6770ee-84d9-4fe9-a23c-2220a177cfbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:51.898662 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-1c6770ee-84d9-4fe9-a23c-2220a177cfbf None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:51.900440 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-1c6770ee-84d9-4fe9-a23c-2220a177cfbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:51.985962 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 459/916] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:04:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 18:04:52.003275 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6770ee-84d9-4fe9-a23c-2220a177cfbf None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:52.020678 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867a844b-68cb-4d2a-bde2-f3ed957fed40 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:52.061254 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e284efc-d4c7-4116-9ce7-38b08c780cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:52.062925 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e284efc-d4c7-4116-9ce7-38b08c780cda None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:52.063408 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e284efc-d4c7-4116-9ce7-38b08c780cda None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:52.064097 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e284efc-d4c7-4116-9ce7-38b08c780cda None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:52.064942 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e284efc-d4c7-4116-9ce7-38b08c780cda None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:52.066952 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e284efc-d4c7-4116-9ce7-38b08c780cda None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:52.081322 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-6e284efc-d4c7-4116-9ce7-38b08c780cda None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 17 18:04:52.081322 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:52.081322 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 18:04:52.081322 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 18:04:52.081322 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 18:04:52.081322 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 18:04:52.081322 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 18:04:52.081322 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:04:52.081322 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 17 18:04:52.081322 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:52.081322 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 18:04:52.081322 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:52.081322 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:52.081322 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:52.081322 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:52.081322 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:52.081322 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:52.082396 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:52.082396 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:52.082396 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:52.082396 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:52.082396 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:52.082396 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:52.082396 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 18:04:52.082396 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 18:04:52.082396 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 18:04:52.082396 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 18:04:52.082396 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:52.082396 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:52.082396 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:52.082396 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:52.082396 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:52.082396 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:52.083211 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:52.083211 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:52.083211 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:52.083211 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:52.083211 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:52.083211 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:52.083211 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:52.083211 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:52.083211 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:52.083211 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:52.083211 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 18:04:52.083211 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:04:52.083211 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 17 18:04:52.083211 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:52.086590 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 458/917] 10.222.0.65 () {56 vars in 1114 bytes} [Tue May 17 18:04:51 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:52.092653 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e284efc-d4c7-4116-9ce7-38b08c780cda None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:52.126927 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6770ee-84d9-4fe9-a23c-2220a177cfbf None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:52.162680 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a2b232-2af4-40fa-9776-1433b2a9c3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:52.163852 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a2b232-2af4-40fa-9776-1433b2a9c3a8 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:52.164324 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a2b232-2af4-40fa-9776-1433b2a9c3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:52.164782 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a2b232-2af4-40fa-9776-1433b2a9c3a8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:52.165649 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a2b232-2af4-40fa-9776-1433b2a9c3a8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:52.167393 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a2b232-2af4-40fa-9776-1433b2a9c3a8 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:52.181275 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-09a2b232-2af4-40fa-9776-1433b2a9c3a8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 18:04:52.181275 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:52.181275 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 18:04:52.181275 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 18:04:52.181275 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 18:04:52.181275 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 18:04:52.181275 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 18:04:52.181275 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:04:52.181275 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 18:04:52.181275 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:52.181275 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 18:04:52.181275 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:52.181275 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:52.181275 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:52.181275 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:52.181275 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:52.181275 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:52.182363 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:52.182363 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:52.182363 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:52.182363 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:52.182363 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:52.182363 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:52.182363 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 18:04:52.182363 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 18:04:52.182363 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 18:04:52.182363 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 18:04:52.182363 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:52.182363 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:52.182363 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:52.182363 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:52.182363 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:52.182363 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:52.183216 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:52.183216 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:52.183216 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:52.183216 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:52.183216 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:52.183216 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:52.183216 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:52.183216 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:52.183216 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:52.183216 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:52.183216 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 18:04:52.183216 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:04:52.183216 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 18:04:52.183216 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:52.191911 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 460/918] 10.222.0.65 () {56 vars in 1126 bytes} [Tue May 17 18:04:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:52.193416 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a2b232-2af4-40fa-9776-1433b2a9c3a8 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:52.198562 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e284efc-d4c7-4116-9ce7-38b08c780cda None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:52.234346 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f5991-15fc-4e80-88de-2a99c1f74894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:52.235015 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f5991-15fc-4e80-88de-2a99c1f74894 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:52.235295 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f5991-15fc-4e80-88de-2a99c1f74894 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:52.235568 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f5991-15fc-4e80-88de-2a99c1f74894 None admin] PATH_INFO: `/v3/services` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:52.236671 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6f5991-15fc-4e80-88de-2a99c1f74894 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:52.236671 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6f5991-15fc-4e80-88de-2a99c1f74894 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:52.237987 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6f5991-15fc-4e80-88de-2a99c1f74894 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:52.247673 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 459/919] 10.222.0.65 () {56 vars in 1114 bytes} [Tue May 17 18:04:52 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:04:52.248967 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f5991-15fc-4e80-88de-2a99c1f74894 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:52.298514 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a2b232-2af4-40fa-9776-1433b2a9c3a8 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:52.334488 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fadc2fb-19a6-41e6-a252-8628d5bcb338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:52.335452 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fadc2fb-19a6-41e6-a252-8628d5bcb338 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:52.336056 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fadc2fb-19a6-41e6-a252-8628d5bcb338 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:52.336572 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fadc2fb-19a6-41e6-a252-8628d5bcb338 None admin] PATH_INFO: `/v3/services` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:52.337780 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fadc2fb-19a6-41e6-a252-8628d5bcb338 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:52.338265 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fadc2fb-19a6-41e6-a252-8628d5bcb338 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:52.340319 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fadc2fb-19a6-41e6-a252-8628d5bcb338 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:52.349633 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 461/920] 10.222.0.65 () {56 vars in 1122 bytes} [Tue May 17 18:04:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:52.351064 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b052f-e4ee-4e69-88a6-b0abb8326555 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:52.351349 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b052f-e4ee-4e69-88a6-b0abb8326555 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:52.351686 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b052f-e4ee-4e69-88a6-b0abb8326555 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:52.353043 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 462/921] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:04:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:04:52.353841 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9b052f-e4ee-4e69-88a6-b0abb8326555 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:52.358639 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f5991-15fc-4e80-88de-2a99c1f74894 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:52.393417 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4852af-3b21-4b7e-9eff-319e92e0a61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:52.394123 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4852af-3b21-4b7e-9eff-319e92e0a61d None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:52.394401 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4852af-3b21-4b7e-9eff-319e92e0a61d None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:52.394673 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4852af-3b21-4b7e-9eff-319e92e0a61d None admin] PATH_INFO: `/v3/services` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:52.395385 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4852af-3b21-4b7e-9eff-319e92e0a61d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:52.395690 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4852af-3b21-4b7e-9eff-319e92e0a61d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:52.397069 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4852af-3b21-4b7e-9eff-319e92e0a61d None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:52.405851 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 460/922] 10.222.0.65 () {56 vars in 1114 bytes} [Tue May 17 18:04:52 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:04:52.405851 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc962a-a129-471a-b890-d5a037115989 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:52.405851 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc962a-a129-471a-b890-d5a037115989 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:52.405851 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bc962a-a129-471a-b890-d5a037115989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:52.424342 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-43bc962a-a129-471a-b890-d5a037115989 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:52.425567 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-43bc962a-a129-471a-b890-d5a037115989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:52.470771 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9b052f-e4ee-4e69-88a6-b0abb8326555 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:52.493010 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 461/923] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:04:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:04:52.494214 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc962a-a129-471a-b890-d5a037115989 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:52.512370 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de79f9cb-4306-46c0-907d-c61b490ddc22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:52.513673 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79f9cb-4306-46c0-907d-c61b490ddc22 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:52.514108 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79f9cb-4306-46c0-907d-c61b490ddc22 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:52.514382 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79f9cb-4306-46c0-907d-c61b490ddc22 None admin] PATH_INFO: `/v3/services` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:52.515091 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de79f9cb-4306-46c0-907d-c61b490ddc22 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:52.515406 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de79f9cb-4306-46c0-907d-c61b490ddc22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:52.517184 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de79f9cb-4306-46c0-907d-c61b490ddc22 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:52.522422 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 463/924] 10.222.0.65 () {56 vars in 1122 bytes} [Tue May 17 18:04:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:52.523510 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de79f9cb-4306-46c0-907d-c61b490ddc22 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:52.600405 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bc962a-a129-471a-b890-d5a037115989 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:52.623525 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de79f9cb-4306-46c0-907d-c61b490ddc22 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:52.637252 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01112dab-e46e-4715-a9de-19d257bf27da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:52.638631 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01112dab-e46e-4715-a9de-19d257bf27da None admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:52.639011 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01112dab-e46e-4715-a9de-19d257bf27da None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:52.639386 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01112dab-e46e-4715-a9de-19d257bf27da None admin] PATH_INFO: `/v3/endpoints` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:52.640206 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01112dab-e46e-4715-a9de-19d257bf27da None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:52.641674 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01112dab-e46e-4715-a9de-19d257bf27da None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:52.663003 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 462/925] 10.222.0.65 () {60 vars in 1144 bytes} [Tue May 17 18:04:52 2022] POST /identity/v3/endpoints => generated 346 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:04:52.663940 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01112dab-e46e-4715-a9de-19d257bf27da None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:52.682134 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6342b5d-9d43-4a58-adef-12c6bff8f01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:52.683256 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6342b5d-9d43-4a58-adef-12c6bff8f01f None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:52.683733 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6342b5d-9d43-4a58-adef-12c6bff8f01f None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:52.684193 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6342b5d-9d43-4a58-adef-12c6bff8f01f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:52.685661 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6342b5d-9d43-4a58-adef-12c6bff8f01f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:52.687677 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6342b5d-9d43-4a58-adef-12c6bff8f01f None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:52.706369 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-a6342b5d-9d43-4a58-adef-12c6bff8f01f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 17 18:04:52.706369 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:52.706369 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 18:04:52.706369 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 18:04:52.706369 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 18:04:52.706369 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 18:04:52.706369 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 18:04:52.706369 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:04:52.706369 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 17 18:04:52.706369 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:52.706369 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 18:04:52.706369 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:52.706369 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:52.706369 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:52.706369 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:52.706369 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:52.708957 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:52.708957 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:52.708957 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:52.708957 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:52.708957 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:52.708957 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:52.708957 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:52.708957 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 18:04:52.708957 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 18:04:52.708957 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 18:04:52.708957 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 18:04:52.708957 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:52.708957 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:52.708957 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:52.708957 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:52.708957 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:52.711108 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:52.711108 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:52.711108 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:52.711108 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:52.711108 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:52.711108 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:52.711108 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:52.711108 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:52.711108 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:52.711108 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:52.711108 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:52.711108 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 18:04:52.711108 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:04:52.711108 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 17 18:04:52.711108 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:52.719809 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 464/926] 10.222.0.65 () {56 vars in 1132 bytes} [Tue May 17 18:04:52 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:52.721001 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6342b5d-9d43-4a58-adef-12c6bff8f01f None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:52.788268 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01112dab-e46e-4715-a9de-19d257bf27da None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:52.830757 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77050b1c-85ed-4732-95ab-50d04668c8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:52.831415 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77050b1c-85ed-4732-95ab-50d04668c8e1 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:52.831693 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77050b1c-85ed-4732-95ab-50d04668c8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:52.831966 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77050b1c-85ed-4732-95ab-50d04668c8e1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:52.832773 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77050b1c-85ed-4732-95ab-50d04668c8e1 None admin] RBAC: Adding query filter params (interface=public, service_id=3831e4b129aa409db1ad6990401ed86e, region_id=RegionOne) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:52.833128 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77050b1c-85ed-4732-95ab-50d04668c8e1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:52.834648 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77050b1c-85ed-4732-95ab-50d04668c8e1 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:52.845548 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6342b5d-9d43-4a58-adef-12c6bff8f01f None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:52.847326 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 463/927] 10.222.0.65 () {56 vars in 1251 bytes} [Tue May 17 18:04:52 2022] GET /identity/v3/endpoints?service_id=3831e4b129aa409db1ad6990401ed86e&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:52.849391 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77050b1c-85ed-4732-95ab-50d04668c8e1 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:52.885715 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5eec0-aa8f-417b-a20b-74bc472369cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:52.886813 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5eec0-aa8f-417b-a20b-74bc472369cd None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:52.887643 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5eec0-aa8f-417b-a20b-74bc472369cd None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:52.887924 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c5eec0-aa8f-417b-a20b-74bc472369cd None admin] PATH_INFO: `/v3/services` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:52.888959 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c5eec0-aa8f-417b-a20b-74bc472369cd None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:52.889270 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c5eec0-aa8f-417b-a20b-74bc472369cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:52.890844 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c5eec0-aa8f-417b-a20b-74bc472369cd None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:52.897589 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 465/928] 10.222.0.65 () {56 vars in 1126 bytes} [Tue May 17 18:04:52 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:52.906646 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5eec0-aa8f-417b-a20b-74bc472369cd None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:52.980332 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77050b1c-85ed-4732-95ab-50d04668c8e1 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:53.019085 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f433141-dba9-499d-9ffd-6a3d2880c44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:53.019741 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f433141-dba9-499d-9ffd-6a3d2880c44a None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:53.020077 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f433141-dba9-499d-9ffd-6a3d2880c44a None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:53.020356 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f433141-dba9-499d-9ffd-6a3d2880c44a None admin] PATH_INFO: `/v3/services` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:53.021039 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f433141-dba9-499d-9ffd-6a3d2880c44a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:53.022444 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f433141-dba9-499d-9ffd-6a3d2880c44a None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:53.029055 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 464/929] 10.222.0.65 () {56 vars in 1087 bytes} [Tue May 17 18:04:52 2022] GET /identity/v3/services => generated 1497 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:04:53.030351 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9271224-3fa8-49fd-b30a-0fa408a5217a None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:53.030635 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9271224-3fa8-49fd-b30a-0fa408a5217a None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:53.030910 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9271224-3fa8-49fd-b30a-0fa408a5217a None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:53.033506 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 465/930] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:04:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:04:53.038090 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5373000b-3f73-43b0-98aa-555e3937fd59 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:53.038699 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5373000b-3f73-43b0-98aa-555e3937fd59 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:53.039180 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5373000b-3f73-43b0-98aa-555e3937fd59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:53.051925 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c5eec0-aa8f-417b-a20b-74bc472369cd None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:53.058235 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-5373000b-3f73-43b0-98aa-555e3937fd59 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:53.060592 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-5373000b-3f73-43b0-98aa-555e3937fd59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:53.100115 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c0100-9b03-46c2-946a-5bbd2edfa3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:53.101100 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c0100-9b03-46c2-946a-5bbd2edfa3ed None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:53.101452 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c0100-9b03-46c2-946a-5bbd2edfa3ed None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:53.102276 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c0100-9b03-46c2-946a-5bbd2edfa3ed None admin] PATH_INFO: `/v3/services` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:53.103403 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9c0100-9b03-46c2-946a-5bbd2edfa3ed None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:53.103793 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9c0100-9b03-46c2-946a-5bbd2edfa3ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:53.105659 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9c0100-9b03-46c2-946a-5bbd2edfa3ed None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:53.112805 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 466/931] 10.222.0.65 () {56 vars in 1126 bytes} [Tue May 17 18:04:52 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:53.118573 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c0100-9b03-46c2-946a-5bbd2edfa3ed None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:53.165722 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 466/932] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:04:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:04:53.197750 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5373000b-3f73-43b0-98aa-555e3937fd59 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:53.263156 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c0100-9b03-46c2-946a-5bbd2edfa3ed None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:53.311639 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c240487-af58-464a-8dd6-824744f6841a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:53.312715 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c240487-af58-464a-8dd6-824744f6841a None admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:53.314074 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c240487-af58-464a-8dd6-824744f6841a None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:53.314768 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c240487-af58-464a-8dd6-824744f6841a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:53.316316 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c240487-af58-464a-8dd6-824744f6841a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:53.319560 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c240487-af58-464a-8dd6-824744f6841a None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:53.329789 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5373000b-3f73-43b0-98aa-555e3937fd59 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:53.348840 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 467/933] 10.222.0.65 () {60 vars in 1144 bytes} [Tue May 17 18:04:53 2022] POST /identity/v3/endpoints => generated 347 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:04:53.388516 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e556768c-f0bd-415f-a8a1-f0ea308bbd3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:53.389924 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e556768c-f0bd-415f-a8a1-f0ea308bbd3b None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:53.390420 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e556768c-f0bd-415f-a8a1-f0ea308bbd3b None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:53.390914 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e556768c-f0bd-415f-a8a1-f0ea308bbd3b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:53.406042 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e556768c-f0bd-415f-a8a1-f0ea308bbd3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:04:53.414845 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-e556768c-f0bd-415f-a8a1-f0ea308bbd3b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 18:04:53.414845 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:53.414845 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:53.414845 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:53.414845 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:53.414845 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:53.414845 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:53.414845 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:53.414845 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:53.414845 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:53.414845 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:53.414845 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:53.414845 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:04:53.414845 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:04:53.414845 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:04:53.414845 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:04:53.415873 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:04:53.415873 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:04:53.415873 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:04:53.415873 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:04:53.415873 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:53.415873 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:53.415873 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:53.415873 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:53.415873 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:53.415873 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:53.415873 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:53.415873 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:53.415873 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:53.415873 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:53.415873 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:53.415873 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:53.416736 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:53.416736 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:53.416736 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:53.416736 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:53.416736 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:04:53.416736 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:04:53.416736 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:04:53.416736 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:04:53.416736 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:04:53.416736 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:04:53.416736 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 18:04:53.416736 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:53.419774 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 467/934] 10.222.0.65 () {56 vars in 1120 bytes} [Tue May 17 18:04:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:53.428130 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c240487-af58-464a-8dd6-824744f6841a None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:53.551451 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c240487-af58-464a-8dd6-824744f6841a None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:53.592842 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2183a54-e604-4c08-a4b0-2cc0249bba62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:53.593439 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2183a54-e604-4c08-a4b0-2cc0249bba62 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:53.593804 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2183a54-e604-4c08-a4b0-2cc0249bba62 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:53.594088 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2183a54-e604-4c08-a4b0-2cc0249bba62 None admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:53.594892 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2183a54-e604-4c08-a4b0-2cc0249bba62 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:53.595200 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2183a54-e604-4c08-a4b0-2cc0249bba62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:53.596574 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2183a54-e604-4c08-a4b0-2cc0249bba62 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:53.605487 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 468/935] 10.222.0.65 () {56 vars in 1115 bytes} [Tue May 17 18:04:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:53.614110 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e556768c-f0bd-415f-a8a1-f0ea308bbd3b None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:53.718201 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e556768c-f0bd-415f-a8a1-f0ea308bbd3b None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:53.754491 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727973a-4727-487d-9447-177aba046654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:53.755288 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727973a-4727-487d-9447-177aba046654 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:53.755562 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727973a-4727-487d-9447-177aba046654 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:53.755835 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727973a-4727-487d-9447-177aba046654 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:53.766970 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a727973a-4727-487d-9447-177aba046654 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:53.768457 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a727973a-4727-487d-9447-177aba046654 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:53.791530 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-a727973a-4727-487d-9447-177aba046654 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:53.791530 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:53.791530 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:53.791530 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:53.791530 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:53.791530 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:53.791530 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:53.791530 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:53.791530 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:53.791530 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:53.791530 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:53.791530 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:53.791530 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:04:53.791530 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:04:53.791530 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:04:53.792927 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:04:53.792927 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:53.792927 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:53.792927 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:53.792927 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:53.792927 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:53.792927 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:53.792927 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:53.792927 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:53.792927 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:53.792927 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:53.792927 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:53.792927 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:53.792927 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:53.792927 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:53.792927 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:53.792927 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:53.794660 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:04:53.794660 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:04:53.794660 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:53.794660 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:53.797565 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 468/936] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:04:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:53.799627 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2183a54-e604-4c08-a4b0-2cc0249bba62 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:53.904009 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2183a54-e604-4c08-a4b0-2cc0249bba62 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:53.937380 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6699c29-d262-4289-bd24-5d8d04ffe502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:53.938063 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6699c29-d262-4289-bd24-5d8d04ffe502 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:53.938341 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6699c29-d262-4289-bd24-5d8d04ffe502 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:53.938626 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6699c29-d262-4289-bd24-5d8d04ffe502 None admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:53.939338 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6699c29-d262-4289-bd24-5d8d04ffe502 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:53.939641 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6699c29-d262-4289-bd24-5d8d04ffe502 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:53.941006 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6699c29-d262-4289-bd24-5d8d04ffe502 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:53.957581 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 469/937] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:04:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:04:53.959342 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727973a-4727-487d-9447-177aba046654 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:54.088086 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727973a-4727-487d-9447-177aba046654 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:54.131347 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ffba6-80e3-4e07-a5bb-071ee9c523cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:54.132549 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ffba6-80e3-4e07-a5bb-071ee9c523cf None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:54.133066 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ffba6-80e3-4e07-a5bb-071ee9c523cf None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:54.133588 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ffba6-80e3-4e07-a5bb-071ee9c523cf None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:54.143191 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29ffba6-80e3-4e07-a5bb-071ee9c523cf None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:54.144913 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29ffba6-80e3-4e07-a5bb-071ee9c523cf None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:54.159961 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-f29ffba6-80e3-4e07-a5bb-071ee9c523cf None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 18:04:54.159961 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:54.159961 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:54.159961 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:54.159961 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:54.159961 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:54.159961 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:54.159961 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:54.159961 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:54.159961 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:54.159961 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:54.159961 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:54.159961 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 18:04:54.159961 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 18:04:54.159961 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 18:04:54.159961 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 18:04:54.160920 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:54.160920 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:54.160920 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 18:04:54.160920 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:04:54.160920 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 18:04:54.160920 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:04:54.160920 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:54.160920 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:54.160920 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:54.160920 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:54.160920 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:54.160920 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:54.160920 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:54.160920 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:54.160920 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:54.160920 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:54.160920 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:54.160920 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:54.161902 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:54.161902 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:54.161902 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 18:04:54.161902 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 18:04:54.161902 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 18:04:54.161902 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 18:04:54.161902 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 18:04:54.161902 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 18:04:54.161902 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 18:04:54.161902 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:54.164497 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 469/938] 10.222.0.65 () {56 vars in 1117 bytes} [Tue May 17 18:04:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:54.170302 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6699c29-d262-4289-bd24-5d8d04ffe502 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:54.276402 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6699c29-d262-4289-bd24-5d8d04ffe502 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:54.310861 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a686d0c-373f-4f76-b939-6af7b1b49171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:54.311541 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a686d0c-373f-4f76-b939-6af7b1b49171 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:54.311820 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a686d0c-373f-4f76-b939-6af7b1b49171 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:54.312101 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a686d0c-373f-4f76-b939-6af7b1b49171 None admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:54.312943 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a686d0c-373f-4f76-b939-6af7b1b49171 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:54.313253 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a686d0c-373f-4f76-b939-6af7b1b49171 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:54.314703 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a686d0c-373f-4f76-b939-6af7b1b49171 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:54.333842 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 470/939] 10.222.0.65 () {56 vars in 1149 bytes} [Tue May 17 18:04:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:54.339201 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ffba6-80e3-4e07-a5bb-071ee9c523cf None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:54.439185 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ffba6-80e3-4e07-a5bb-071ee9c523cf None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:54.472751 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836ebfb3-db58-4fc2-b19f-4fdaeb2310c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:54.473890 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ebfb3-db58-4fc2-b19f-4fdaeb2310c6 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:54.474392 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ebfb3-db58-4fc2-b19f-4fdaeb2310c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:54.474858 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836ebfb3-db58-4fc2-b19f-4fdaeb2310c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:54.486093 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836ebfb3-db58-4fc2-b19f-4fdaeb2310c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:54.487783 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836ebfb3-db58-4fc2-b19f-4fdaeb2310c6 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:54.505141 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-836ebfb3-db58-4fc2-b19f-4fdaeb2310c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:54.505141 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:54.505141 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:54.505141 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:54.505141 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:54.505141 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:54.505141 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:54.505141 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:54.505141 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:54.505141 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:54.505141 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:54.505141 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:54.505141 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:04:54.505141 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:04:54.505141 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:04:54.506073 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:04:54.506073 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:54.506073 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:54.506073 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:54.506073 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:54.506073 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:54.506073 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:54.506073 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:54.506073 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:54.506073 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:54.506073 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:54.506073 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:54.506073 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:54.506073 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:54.506073 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:54.506073 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:54.506073 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:54.506999 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:04:54.506999 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:04:54.506999 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:54.506999 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:54.509143 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 470/940] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:04:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:54.514641 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a686d0c-373f-4f76-b939-6af7b1b49171 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:54.622560 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a686d0c-373f-4f76-b939-6af7b1b49171 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:54.656755 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ebbe0f-69f8-43c9-890b-404b54dd135d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:54.657418 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ebbe0f-69f8-43c9-890b-404b54dd135d None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:54.657729 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ebbe0f-69f8-43c9-890b-404b54dd135d None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:54.657999 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ebbe0f-69f8-43c9-890b-404b54dd135d None admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:54.658714 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ebbe0f-69f8-43c9-890b-404b54dd135d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:54.659016 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ebbe0f-69f8-43c9-890b-404b54dd135d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:54.660382 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ebbe0f-69f8-43c9-890b-404b54dd135d None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:54.672307 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 471/941] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:04:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:04:54.677736 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836ebfb3-db58-4fc2-b19f-4fdaeb2310c6 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:54.780724 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836ebfb3-db58-4fc2-b19f-4fdaeb2310c6 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:54.814616 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b721a-5dd8-4012-8285-e54dcf092701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:54.816225 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b721a-5dd8-4012-8285-e54dcf092701 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:54.816701 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b721a-5dd8-4012-8285-e54dcf092701 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:54.817168 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b721a-5dd8-4012-8285-e54dcf092701 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:54.824424 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62b721a-5dd8-4012-8285-e54dcf092701 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:54.826732 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62b721a-5dd8-4012-8285-e54dcf092701 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:54.852725 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-d62b721a-5dd8-4012-8285-e54dcf092701 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:04:54.852725 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:54.852725 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:54.852725 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:54.852725 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:54.852725 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:54.852725 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:54.852725 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:54.852725 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:54.852725 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:54.852725 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:54.852725 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:54.852725 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 18:04:54.852725 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 18:04:54.852725 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 18:04:54.853688 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 18:04:54.853688 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:54.853688 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:54.853688 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:54.853688 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:54.853688 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:54.853688 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:54.853688 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:54.853688 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:54.853688 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:54.853688 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:54.853688 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:54.853688 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:54.853688 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:54.853688 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:54.853688 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:54.853688 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:54.854560 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 18:04:54.854560 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 18:04:54.854560 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 18:04:54.854560 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 18:04:54.854560 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 18:04:54.854560 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 18:04:54.854560 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:04:54.854560 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:54.857046 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 471/942] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 17 18:04:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:54.862721 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ebbe0f-69f8-43c9-890b-404b54dd135d None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:54.963829 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ebbe0f-69f8-43c9-890b-404b54dd135d None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:54.997994 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c630c948-108f-428e-a14e-d2ea6c59ff74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:54.998657 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630c948-108f-428e-a14e-d2ea6c59ff74 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:54.998941 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630c948-108f-428e-a14e-d2ea6c59ff74 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:54.999217 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c630c948-108f-428e-a14e-d2ea6c59ff74 None admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:55.000084 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c630c948-108f-428e-a14e-d2ea6c59ff74 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:55.000395 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c630c948-108f-428e-a14e-d2ea6c59ff74 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:55.001984 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c630c948-108f-428e-a14e-d2ea6c59ff74 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:55.017166 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 472/943] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 17 18:04:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:55.023307 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b721a-5dd8-4012-8285-e54dcf092701 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:55.125222 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b721a-5dd8-4012-8285-e54dcf092701 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:55.163595 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfac623-2d2a-4495-9681-7039460136d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:55.164499 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfac623-2d2a-4495-9681-7039460136d2 None admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:55.164780 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfac623-2d2a-4495-9681-7039460136d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:55.165063 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfac623-2d2a-4495-9681-7039460136d2 None admin] PATH_INFO: `/v3/projects/0cf165918c1f46cb96d4b54409862659/users/f370e353067848b5843c5650183be347/roles/389e932f10c643a2aa76b3a21351e061` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:55.167335 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfac623-2d2a-4495-9681-7039460136d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=0cf165918c1f46cb96d4b54409862659, user_id=f370e353067848b5843c5650183be347, role_id=389e932f10c643a2aa76b3a21351e061)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:55.169329 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfac623-2d2a-4495-9681-7039460136d2 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:55.184158 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 472/944] 10.222.0.65 () {58 vars in 1439 bytes} [Tue May 17 18:04:55 2022] PUT /identity/v3/projects/0cf165918c1f46cb96d4b54409862659/users/f370e353067848b5843c5650183be347/roles/389e932f10c643a2aa76b3a21351e061 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:04:55.237515 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7a38f-ad53-4bd2-b4c2-a62d6443cbd0 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:55.237515 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7a38f-ad53-4bd2-b4c2-a62d6443cbd0 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:55.237515 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7a38f-ad53-4bd2-b4c2-a62d6443cbd0 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:55.239470 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 473/945] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:04:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:04:55.245733 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea5c34e-1627-435c-9b20-34d1a66b3e94 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:55.246390 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea5c34e-1627-435c-9b20-34d1a66b3e94 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:55.246966 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea5c34e-1627-435c-9b20-34d1a66b3e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:55.266123 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-eea5c34e-1627-435c-9b20-34d1a66b3e94 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:55.267807 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-eea5c34e-1627-435c-9b20-34d1a66b3e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:55.342868 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 473/946] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:04:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:04:55.366490 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d7a38f-ad53-4bd2-b4c2-a62d6443cbd0 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:55.474371 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d7a38f-ad53-4bd2-b4c2-a62d6443cbd0 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:55.494197 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe17da-7679-49f8-840d-54b5c5a9d0f1 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:55.494832 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe17da-7679-49f8-840d-54b5c5a9d0f1 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:55.495303 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe17da-7679-49f8-840d-54b5c5a9d0f1 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:55.497243 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 474/947] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:04:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 18:04:55.502486 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f23f4-62a4-4dd3-8eba-818f234aa1b0 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:55.502990 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f23f4-62a4-4dd3-8eba-818f234aa1b0 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:55.503615 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f23f4-62a4-4dd3-8eba-818f234aa1b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:55.511182 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c64e14-26ba-437a-96e2-fb062a568aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:55.511850 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c64e14-26ba-437a-96e2-fb062a568aab None admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:55.512134 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c64e14-26ba-437a-96e2-fb062a568aab None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:55.512440 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c64e14-26ba-437a-96e2-fb062a568aab None admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:55.513145 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c64e14-26ba-437a-96e2-fb062a568aab None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:55.514611 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c64e14-26ba-437a-96e2-fb062a568aab None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:55.516000 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: WARNING keystone.server.flask.common [None req-d2c64e14-26ba-437a-96e2-fb062a568aab None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 17 18:04:55.522502 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-902f23f4-62a4-4dd3-8eba-818f234aa1b0 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:55.524043 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-902f23f4-62a4-4dd3-8eba-818f234aa1b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:55.539515 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.sql.core [None req-d2c64e14-26ba-437a-96e2-fb062a568aab None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 17 18:04:55.539515 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 17 18:04:55.539515 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [parameters: {'id': '780f050ca15d4db99b602a2309ec3935', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 17 18:04:55.539515 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80017) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 17 18:04:55.562847 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-d2c64e14-26ba-437a-96e2-fb062a568aab None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 780f050ca15d4db99b602a2309ec3935.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 780f050ca15d4db99b602a2309ec3935. May 17 18:04:55.562847 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:55.562847 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 17 18:04:55.562847 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application self.dialect.do_execute( May 17 18:04:55.562847 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 17 18:04:55.562847 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 17 18:04:55.562847 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 17 18:04:55.562847 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application result = self._query(query) May 17 18:04:55.562847 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 17 18:04:55.562847 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application conn.query(q) May 17 18:04:55.562847 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 17 18:04:55.562847 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 17 18:04:55.562847 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 17 18:04:55.563749 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application result.read() May 17 18:04:55.563749 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 17 18:04:55.563749 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 17 18:04:55.563749 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 17 18:04:55.563749 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application packet.raise_for_error() May 17 18:04:55.563749 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 17 18:04:55.563749 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 17 18:04:55.563749 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 17 18:04:55.563749 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 17 18:04:55.563749 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 17 18:04:55.563749 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:55.563749 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 17 18:04:55.563749 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:55.563749 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:55.563749 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 17 18:04:55.563749 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 17 18:04:55.563749 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 17 18:04:55.563749 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return project_ref.to_dict() May 17 18:04:55.564710 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 17 18:04:55.564710 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application next(self.gen) May 17 18:04:55.564710 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 17 18:04:55.564710 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application yield resource May 17 18:04:55.564710 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 17 18:04:55.564710 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application next(self.gen) May 17 18:04:55.564710 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 17 18:04:55.564710 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application self.session.rollback() May 17 18:04:55.564710 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 17 18:04:55.564710 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application self.force_reraise() May 17 18:04:55.564710 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 17 18:04:55.564710 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise self.value May 17 18:04:55.564710 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 17 18:04:55.564710 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 17 18:04:55.564710 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 17 18:04:55.564710 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application session.commit() May 17 18:04:55.564710 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 17 18:04:55.565639 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 17 18:04:55.565639 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 17 18:04:55.565639 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application self._prepare_impl() May 17 18:04:55.565639 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 17 18:04:55.565639 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application self.session.flush() May 17 18:04:55.565639 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 17 18:04:55.565639 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application self._flush(objects) May 17 18:04:55.565639 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 17 18:04:55.565639 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 17 18:04:55.565639 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 17 18:04:55.565639 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application compat.raise_( May 17 18:04:55.565639 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 17 18:04:55.565639 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception May 17 18:04:55.565639 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 17 18:04:55.565639 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application flush_context.execute() May 17 18:04:55.565639 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 17 18:04:55.565639 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rec.execute(self) May 17 18:04:55.566548 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 17 18:04:55.566548 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 17 18:04:55.566548 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 17 18:04:55.566548 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application _emit_insert_statements( May 17 18:04:55.566548 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 17 18:04:55.566548 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application c = connection._execute_20( May 17 18:04:55.566548 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 17 18:04:55.566548 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 17 18:04:55.566548 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 17 18:04:55.566548 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 17 18:04:55.566548 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 17 18:04:55.566548 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ret = self._execute_context( May 17 18:04:55.566548 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 17 18:04:55.566548 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 17 18:04:55.566548 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 17 18:04:55.567330 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 17 18:04:55.567330 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 17 18:04:55.567330 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception May 17 18:04:55.567330 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 17 18:04:55.567330 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application self.dialect.do_execute( May 17 18:04:55.567330 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 17 18:04:55.567330 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 17 18:04:55.567330 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 17 18:04:55.567330 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application result = self._query(query) May 17 18:04:55.567330 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 17 18:04:55.567330 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application conn.query(q) May 17 18:04:55.567330 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 17 18:04:55.567330 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 17 18:04:55.567330 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 17 18:04:55.567330 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application result.read() May 17 18:04:55.567330 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 17 18:04:55.567330 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 17 18:04:55.568455 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 17 18:04:55.568455 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application packet.raise_for_error() May 17 18:04:55.568455 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 17 18:04:55.568455 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 17 18:04:55.568455 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 17 18:04:55.568455 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 17 18:04:55.568455 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 17 18:04:55.568455 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 17 18:04:55.568455 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [parameters: {'id': '780f050ca15d4db99b602a2309ec3935', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 17 18:04:55.568455 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 17 18:04:55.568455 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:55.568455 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 18:04:55.568455 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:55.568455 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:55.568455 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 17 18:04:55.569229 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 17 18:04:55.569229 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 17 18:04:55.569229 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 17 18:04:55.569229 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 17 18:04:55.569229 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:55.569229 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 18:04:55.569229 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:55.569229 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:55.569229 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:55.569229 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:55.569229 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:55.569229 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:55.569229 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:55.569229 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:55.569229 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:55.569229 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:55.569229 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:55.577048 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:55.577048 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 17 18:04:55.577048 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 17 18:04:55.577048 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:55.577048 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:55.577048 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 17 18:04:55.577048 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.Conflict( May 17 18:04:55.577048 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 780f050ca15d4db99b602a2309ec3935. May 17 18:04:55.577048 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:55.577048 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 474/948] 10.222.0.65 () {60 vars in 1140 bytes} [Tue May 17 18:04:55 2022] POST /identity/v3/projects => generated 262 bytes in 198 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:55.577048 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c64e14-26ba-437a-96e2-fb062a568aab None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:55.617492 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 475/949] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:04:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 18:04:55.639679 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902f23f4-62a4-4dd3-8eba-818f234aa1b0 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:55.701256 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c64e14-26ba-437a-96e2-fb062a568aab None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:55.741284 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf18d7-9645-4d71-afd1-9a1fd2e005a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:55.742023 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf18d7-9645-4d71-afd1-9a1fd2e005a8 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:55.742303 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf18d7-9645-4d71-afd1-9a1fd2e005a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:55.742577 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf18d7-9645-4d71-afd1-9a1fd2e005a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:55.749195 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cf18d7-9645-4d71-afd1-9a1fd2e005a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:55.750885 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cf18d7-9645-4d71-afd1-9a1fd2e005a8 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:55.752482 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902f23f4-62a4-4dd3-8eba-818f234aa1b0 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:55.768307 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-42cf18d7-9645-4d71-afd1-9a1fd2e005a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:04:55.768307 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:55.768307 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:55.768307 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:55.768307 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:55.768307 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:55.768307 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:55.768307 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:55.768307 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:55.768307 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:55.768307 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:55.768307 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:55.768307 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 18:04:55.768307 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 18:04:55.768307 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 18:04:55.769272 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 18:04:55.769272 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:55.769272 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:55.769272 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:55.769272 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:55.769272 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:55.769272 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:55.769272 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:55.769272 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:55.769272 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:55.769272 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:55.769272 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:55.769272 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:55.769272 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:55.769272 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:55.769272 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:55.769272 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:55.770217 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 18:04:55.770217 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 18:04:55.770217 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 18:04:55.770217 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 18:04:55.770217 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 18:04:55.770217 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 18:04:55.770217 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:04:55.770217 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:55.770217 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 475/950] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 17 18:04:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:04:55.771484 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b33557e-a92f-46f5-97ea-ceeabf50d287 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:55.771759 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b33557e-a92f-46f5-97ea-ceeabf50d287 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:55.772026 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b33557e-a92f-46f5-97ea-ceeabf50d287 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:55.776528 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 476/951] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:04:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:04:55.777255 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b33557e-a92f-46f5-97ea-ceeabf50d287 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:55.795507 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026eacf5-051b-4e0f-8b2d-2cc1a6c5a8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:55.796715 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026eacf5-051b-4e0f-8b2d-2cc1a6c5a8d3 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:55.797251 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026eacf5-051b-4e0f-8b2d-2cc1a6c5a8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:55.797654 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026eacf5-051b-4e0f-8b2d-2cc1a6c5a8d3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:55.798303 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026eacf5-051b-4e0f-8b2d-2cc1a6c5a8d3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:55.799656 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026eacf5-051b-4e0f-8b2d-2cc1a6c5a8d3 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:55.811250 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-026eacf5-051b-4e0f-8b2d-2cc1a6c5a8d3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 18:04:55.811250 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:55.811250 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 18:04:55.811250 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 18:04:55.811250 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 18:04:55.811250 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 18:04:55.811250 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 18:04:55.811250 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:04:55.811250 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 18:04:55.811250 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:55.811250 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 18:04:55.811250 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:55.811250 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:55.811250 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:55.811250 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:55.811250 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:55.811250 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:55.812263 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:55.812263 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:55.812263 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:55.812263 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:55.812263 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:55.812263 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:55.812263 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 18:04:55.812263 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 18:04:55.812263 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 18:04:55.812263 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 18:04:55.812263 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:55.812263 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:55.812263 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:55.812263 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:55.812263 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:55.812263 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:55.813147 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:55.813147 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:55.813147 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:55.813147 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:55.813147 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:55.813147 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:55.813147 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:55.813147 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:55.813147 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:55.813147 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:55.813147 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 18:04:55.813147 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:04:55.813147 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 18:04:55.813147 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:55.813147 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 476/952] 10.222.0.65 () {56 vars in 1126 bytes} [Tue May 17 18:04:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:55.814020 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae562ba-9ff1-410a-be8b-4793838387e2 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:55.814020 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae562ba-9ff1-410a-be8b-4793838387e2 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:55.814243 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae562ba-9ff1-410a-be8b-4793838387e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:55.833392 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-4ae562ba-9ff1-410a-be8b-4793838387e2 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:55.835029 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-4ae562ba-9ff1-410a-be8b-4793838387e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:55.888911 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b33557e-a92f-46f5-97ea-ceeabf50d287 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:55.907243 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 477/953] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:04:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:04:55.910357 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae562ba-9ff1-410a-be8b-4793838387e2 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:55.931253 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2818741f-9f37-485f-971c-bbc871f06b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:55.932340 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818741f-9f37-485f-971c-bbc871f06b4e None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:55.932828 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818741f-9f37-485f-971c-bbc871f06b4e None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:55.933752 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818741f-9f37-485f-971c-bbc871f06b4e None admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:55.935033 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2818741f-9f37-485f-971c-bbc871f06b4e None admin] RBAC: Adding query filter params (name=service) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:55.935534 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2818741f-9f37-485f-971c-bbc871f06b4e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:55.937848 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2818741f-9f37-485f-971c-bbc871f06b4e None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:55.965632 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 477/954] 10.222.0.65 () {56 vars in 1112 bytes} [Tue May 17 18:04:55 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:55.965632 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2818741f-9f37-485f-971c-bbc871f06b4e None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:56.040491 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae562ba-9ff1-410a-be8b-4793838387e2 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:56.074373 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2818741f-9f37-485f-971c-bbc871f06b4e None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:56.087221 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec9a095-b1ff-4317-b437-ef6b91ffe0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:56.087960 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec9a095-b1ff-4317-b437-ef6b91ffe0f8 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:56.088644 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec9a095-b1ff-4317-b437-ef6b91ffe0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:56.088932 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec9a095-b1ff-4317-b437-ef6b91ffe0f8 None admin] PATH_INFO: `/v3/services` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:56.089680 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec9a095-b1ff-4317-b437-ef6b91ffe0f8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:56.089985 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec9a095-b1ff-4317-b437-ef6b91ffe0f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:56.092897 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec9a095-b1ff-4317-b437-ef6b91ffe0f8 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:56.101627 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 478/955] 10.222.0.65 () {56 vars in 1122 bytes} [Tue May 17 18:04:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:56.104796 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec9a095-b1ff-4317-b437-ef6b91ffe0f8 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:56.132295 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec82369-1123-46b3-975f-2def147169e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:56.133135 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec82369-1123-46b3-975f-2def147169e7 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:56.133371 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec82369-1123-46b3-975f-2def147169e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:56.133683 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec82369-1123-46b3-975f-2def147169e7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:56.134336 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec82369-1123-46b3-975f-2def147169e7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:56.135718 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec82369-1123-46b3-975f-2def147169e7 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:56.148734 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-cec82369-1123-46b3-975f-2def147169e7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 17 18:04:56.148734 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:56.148734 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 18:04:56.148734 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 18:04:56.148734 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 18:04:56.148734 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 18:04:56.148734 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 18:04:56.148734 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:04:56.148734 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 17 18:04:56.148734 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:56.148734 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 18:04:56.148734 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:56.148734 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:56.148734 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:56.148734 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:56.148734 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:56.148734 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:56.149840 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:56.149840 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:56.149840 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:56.149840 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:56.149840 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:56.149840 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:56.149840 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 18:04:56.149840 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 18:04:56.149840 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 18:04:56.149840 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 18:04:56.149840 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:56.149840 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:56.149840 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:56.149840 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:56.149840 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:56.149840 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:56.150692 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:56.150692 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:56.150692 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:56.150692 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:56.150692 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:56.150692 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:56.150692 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:56.150692 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:56.150692 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:56.150692 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:56.150692 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 18:04:56.150692 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:04:56.150692 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 17 18:04:56.150692 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:56.150692 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 478/956] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 17 18:04:55 2022] GET /identity/v3/services/compute => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:56.161504 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec82369-1123-46b3-975f-2def147169e7 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:56.227843 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec9a095-b1ff-4317-b437-ef6b91ffe0f8 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:56.271949 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a20c8-9d85-49c7-a9a3-16eb389d668c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:56.272702 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a20c8-9d85-49c7-a9a3-16eb389d668c None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:56.272975 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a20c8-9d85-49c7-a9a3-16eb389d668c None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:56.273241 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a20c8-9d85-49c7-a9a3-16eb389d668c None admin] PATH_INFO: `/v3/services` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:56.273911 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec82369-1123-46b3-975f-2def147169e7 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:56.274036 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a20c8-9d85-49c7-a9a3-16eb389d668c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:56.274260 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a20c8-9d85-49c7-a9a3-16eb389d668c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:56.275620 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a20c8-9d85-49c7-a9a3-16eb389d668c None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:56.281128 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 479/957] 10.222.0.65 () {56 vars in 1122 bytes} [Tue May 17 18:04:56 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:56.286454 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a20c8-9d85-49c7-a9a3-16eb389d668c None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:56.314620 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4eb6ec-70f4-457d-9bdd-6721310ab86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:56.315168 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4eb6ec-70f4-457d-9bdd-6721310ab86e None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:56.315518 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4eb6ec-70f4-457d-9bdd-6721310ab86e None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:56.315881 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4eb6ec-70f4-457d-9bdd-6721310ab86e None admin] PATH_INFO: `/v3/services` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:56.316652 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4eb6ec-70f4-457d-9bdd-6721310ab86e None admin] RBAC: Adding query filter params (name=compute) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:56.317023 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4eb6ec-70f4-457d-9bdd-6721310ab86e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:56.318740 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4eb6ec-70f4-457d-9bdd-6721310ab86e None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:56.324632 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 479/958] 10.222.0.65 () {56 vars in 1112 bytes} [Tue May 17 18:04:56 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:04:56.331995 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4eb6ec-70f4-457d-9bdd-6721310ab86e None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:56.407290 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a20c8-9d85-49c7-a9a3-16eb389d668c None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:56.445900 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b4635-4ddf-4b2e-a82d-6a582b3db057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:56.446562 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b4635-4ddf-4b2e-a82d-6a582b3db057 None admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:56.446841 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b4635-4ddf-4b2e-a82d-6a582b3db057 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:56.447116 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b4635-4ddf-4b2e-a82d-6a582b3db057 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:56.447859 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b4635-4ddf-4b2e-a82d-6a582b3db057 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:56.448687 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4eb6ec-70f4-457d-9bdd-6721310ab86e None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:56.449232 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b4635-4ddf-4b2e-a82d-6a582b3db057 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:56.477512 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 480/959] 10.222.0.65 () {60 vars in 1144 bytes} [Tue May 17 18:04:56 2022] POST /identity/v3/endpoints => generated 349 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:04:56.510106 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467b294a-91ad-45a6-a453-0a23242759d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:56.510855 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b294a-91ad-45a6-a453-0a23242759d4 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:56.511138 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b294a-91ad-45a6-a453-0a23242759d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:56.511417 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b294a-91ad-45a6-a453-0a23242759d4 None admin] PATH_INFO: `/v3/services` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:56.512242 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467b294a-91ad-45a6-a453-0a23242759d4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:56.513123 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467b294a-91ad-45a6-a453-0a23242759d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:56.514835 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467b294a-91ad-45a6-a453-0a23242759d4 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:56.520780 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 480/960] 10.222.0.65 () {56 vars in 1112 bytes} [Tue May 17 18:04:56 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:04:57.470544 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d185c6a-4ea9-4a01-bd6e-af97d118ed34 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:57.471069 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d185c6a-4ea9-4a01-bd6e-af97d118ed34 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:57.471069 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d185c6a-4ea9-4a01-bd6e-af97d118ed34 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:57.472694 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 481/961] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:04:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:04:57.478145 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8e050-1557-4d51-bc3f-c92b2aba49b8 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:57.478529 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8e050-1557-4d51-bc3f-c92b2aba49b8 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:57.478708 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8e050-1557-4d51-bc3f-c92b2aba49b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:57.496111 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-c1a8e050-1557-4d51-bc3f-c92b2aba49b8 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:57.497696 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-c1a8e050-1557-4d51-bc3f-c92b2aba49b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:57.569563 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 481/962] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:04:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:04:57.586981 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d185c6a-4ea9-4a01-bd6e-af97d118ed34 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:57.696846 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d185c6a-4ea9-4a01-bd6e-af97d118ed34 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:57.735781 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd1f539-0926-48a7-b08d-601c71057cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:57.736510 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1f539-0926-48a7-b08d-601c71057cb4 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:57.736789 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1f539-0926-48a7-b08d-601c71057cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:57.737066 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1f539-0926-48a7-b08d-601c71057cb4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:57.747972 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd1f539-0926-48a7-b08d-601c71057cb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:04:57.756183 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-cdd1f539-0926-48a7-b08d-601c71057cb4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 18:04:57.756183 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:57.756183 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:57.756183 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:57.756183 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:57.756183 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:57.756183 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:57.756183 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:57.756183 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:57.756183 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:57.756183 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:57.756183 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:57.756183 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:04:57.756183 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:04:57.756183 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:04:57.756183 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:04:57.757295 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:04:57.757295 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:04:57.757295 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:04:57.757295 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:04:57.757295 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:57.757295 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:57.757295 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:57.757295 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:57.757295 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:57.757295 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:57.757295 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:57.757295 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:57.757295 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:57.757295 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:57.757295 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:57.757295 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:57.758346 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:57.758346 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:57.758346 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:57.758346 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:57.758346 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:04:57.758346 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:04:57.758346 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:04:57.758346 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:04:57.758346 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:04:57.758346 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:04:57.758346 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 18:04:57.758346 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:57.758346 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 482/963] 10.222.0.65 () {56 vars in 1120 bytes} [Tue May 17 18:04:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:57.763466 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a8e050-1557-4d51-bc3f-c92b2aba49b8 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:57.862188 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a8e050-1557-4d51-bc3f-c92b2aba49b8 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:57.896357 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab2f0b6-76b9-4f64-8331-6783909cc6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:57.897018 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2f0b6-76b9-4f64-8331-6783909cc6bc None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:57.897296 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2f0b6-76b9-4f64-8331-6783909cc6bc None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:57.897596 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2f0b6-76b9-4f64-8331-6783909cc6bc None admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:57.898335 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab2f0b6-76b9-4f64-8331-6783909cc6bc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:57.898634 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab2f0b6-76b9-4f64-8331-6783909cc6bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:57.899992 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab2f0b6-76b9-4f64-8331-6783909cc6bc None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:57.913139 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 482/964] 10.222.0.65 () {56 vars in 1115 bytes} [Tue May 17 18:04:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:57.914736 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd1f539-0926-48a7-b08d-601c71057cb4 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:58.017175 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd1f539-0926-48a7-b08d-601c71057cb4 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:58.050512 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0b9f74-53b4-4a39-9920-52655a52f7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:58.051301 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b9f74-53b4-4a39-9920-52655a52f7cd None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:58.051578 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b9f74-53b4-4a39-9920-52655a52f7cd None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:58.051856 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b9f74-53b4-4a39-9920-52655a52f7cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:58.062446 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0b9f74-53b4-4a39-9920-52655a52f7cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:58.063923 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0b9f74-53b4-4a39-9920-52655a52f7cd None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:58.081962 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-6f0b9f74-53b4-4a39-9920-52655a52f7cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:58.081962 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:58.081962 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:58.081962 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:58.081962 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:58.081962 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:58.081962 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:58.081962 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:58.081962 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:58.081962 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:58.081962 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:58.081962 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:58.081962 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:04:58.081962 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:04:58.081962 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:04:58.084201 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:04:58.084201 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:58.084201 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:58.084201 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:58.084201 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:58.084201 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:58.084201 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:58.084201 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:58.084201 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:58.084201 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:58.084201 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:58.084201 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:58.084201 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:58.084201 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:58.084201 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:58.084201 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:58.084201 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:58.086309 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:04:58.086309 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:04:58.086309 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:58.086309 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:58.086309 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 483/965] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:04:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:58.088993 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab2f0b6-76b9-4f64-8331-6783909cc6bc None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:58.193844 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab2f0b6-76b9-4f64-8331-6783909cc6bc None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:58.228351 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f49fb2f-614e-40a9-b97a-95eb49f20616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:58.229014 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49fb2f-614e-40a9-b97a-95eb49f20616 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:58.229294 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49fb2f-614e-40a9-b97a-95eb49f20616 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:58.229601 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49fb2f-614e-40a9-b97a-95eb49f20616 None admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:58.230319 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f49fb2f-614e-40a9-b97a-95eb49f20616 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:58.230624 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f49fb2f-614e-40a9-b97a-95eb49f20616 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:58.232516 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f49fb2f-614e-40a9-b97a-95eb49f20616 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:58.249122 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 483/966] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:04:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:58.250522 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0b9f74-53b4-4a39-9920-52655a52f7cd None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:58.355396 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0b9f74-53b4-4a39-9920-52655a52f7cd None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:58.358126 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf4aa1-9bef-4386-b520-bf7bed86451b None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:58.358411 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf4aa1-9bef-4386-b520-bf7bed86451b None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:58.358684 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cf4aa1-9bef-4386-b520-bf7bed86451b None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:58.360300 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 484/967] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:04:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 18:04:58.365373 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3605d0-c682-41bb-bde7-6e5367c77520 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:58.365681 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3605d0-c682-41bb-bde7-6e5367c77520 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:58.365950 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3605d0-c682-41bb-bde7-6e5367c77520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:58.386994 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-8e3605d0-c682-41bb-bde7-6e5367c77520 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:58.388783 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-8e3605d0-c682-41bb-bde7-6e5367c77520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:58.389996 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4200437-543f-4618-847c-90acac6fc0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:58.390808 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4200437-543f-4618-847c-90acac6fc0ec None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:58.391090 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4200437-543f-4618-847c-90acac6fc0ec None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:58.392100 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4200437-543f-4618-847c-90acac6fc0ec None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:58.399032 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4200437-543f-4618-847c-90acac6fc0ec None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:58.400483 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4200437-543f-4618-847c-90acac6fc0ec None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:58.415096 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-c4200437-543f-4618-847c-90acac6fc0ec None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 18:04:58.415096 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:58.415096 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:58.415096 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:58.415096 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:58.415096 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:58.415096 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:58.415096 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:58.415096 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:58.415096 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:58.415096 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:58.415096 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:58.415096 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 18:04:58.415096 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 18:04:58.415096 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 18:04:58.415096 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 18:04:58.416113 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:58.416113 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:58.416113 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 18:04:58.416113 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:04:58.416113 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 18:04:58.416113 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:04:58.416113 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:58.416113 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:58.416113 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:58.416113 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:58.416113 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:58.416113 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:58.416113 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:58.416113 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:58.416113 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:58.416113 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:58.416113 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:58.416113 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:58.417674 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:58.417674 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:58.417674 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 18:04:58.417674 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 18:04:58.417674 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 18:04:58.417674 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 18:04:58.417674 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 18:04:58.417674 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 18:04:58.417674 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 18:04:58.417674 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:58.417674 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 484/968] 10.222.0.65 () {56 vars in 1117 bytes} [Tue May 17 18:04:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:58.422114 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4200437-543f-4618-847c-90acac6fc0ec None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:58.471715 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 485/969] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:04:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:04:58.496279 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3605d0-c682-41bb-bde7-6e5367c77520 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:58.529449 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4200437-543f-4618-847c-90acac6fc0ec None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:58.563214 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9452529-9089-4563-9277-9eec433c0c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:58.563879 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9452529-9089-4563-9277-9eec433c0c6a None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:58.564158 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9452529-9089-4563-9277-9eec433c0c6a None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:58.564431 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9452529-9089-4563-9277-9eec433c0c6a None admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:58.565276 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9452529-9089-4563-9277-9eec433c0c6a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:58.565594 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9452529-9089-4563-9277-9eec433c0c6a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:58.567024 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9452529-9089-4563-9277-9eec433c0c6a None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:58.585241 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 485/970] 10.222.0.65 () {56 vars in 1149 bytes} [Tue May 17 18:04:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:04:58.593749 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9452529-9089-4563-9277-9eec433c0c6a None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:58.605530 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3605d0-c682-41bb-bde7-6e5367c77520 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:58.644832 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd2b1f-be87-4c9b-9ef0-611be53bbf66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:58.646266 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd2b1f-be87-4c9b-9ef0-611be53bbf66 None admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:58.646700 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd2b1f-be87-4c9b-9ef0-611be53bbf66 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:58.647119 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cd2b1f-be87-4c9b-9ef0-611be53bbf66 None admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:58.648091 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cd2b1f-be87-4c9b-9ef0-611be53bbf66 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:58.650423 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cd2b1f-be87-4c9b-9ef0-611be53bbf66 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:58.667095 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.sql.core [None req-51cd2b1f-be87-4c9b-9ef0-611be53bbf66 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 17 18:04:58.667095 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 17 18:04:58.667095 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [parameters: {'user_id': '4d6d6ede48cb4d009a3e8d1095f0279f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 17 18:04:58.667095 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80017) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 17 18:04:58.678493 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-51cd2b1f-be87-4c9b-9ef0-611be53bbf66 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 17 18:04:58.678493 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:58.678493 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 17 18:04:58.678493 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application self.dialect.do_execute( May 17 18:04:58.678493 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 17 18:04:58.678493 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 17 18:04:58.678493 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 17 18:04:58.678493 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application result = self._query(query) May 17 18:04:58.678493 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 17 18:04:58.678493 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application conn.query(q) May 17 18:04:58.678493 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 17 18:04:58.678493 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 17 18:04:58.678493 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 17 18:04:58.678493 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application result.read() May 17 18:04:58.678493 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 17 18:04:58.679640 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 17 18:04:58.679640 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 17 18:04:58.679640 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application packet.raise_for_error() May 17 18:04:58.679640 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 17 18:04:58.679640 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 17 18:04:58.679640 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 17 18:04:58.679640 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 17 18:04:58.679640 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 17 18:04:58.679640 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:58.679640 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 17 18:04:58.679640 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:58.679640 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:58.679640 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 17 18:04:58.679640 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 17 18:04:58.679640 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 17 18:04:58.679640 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 17 18:04:58.679640 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 17 18:04:58.679640 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application next(self.gen) May 17 18:04:58.680831 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 17 18:04:58.680831 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application yield resource May 17 18:04:58.680831 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 17 18:04:58.680831 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application next(self.gen) May 17 18:04:58.680831 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 17 18:04:58.680831 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application self.session.rollback() May 17 18:04:58.680831 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 17 18:04:58.680831 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application self.force_reraise() May 17 18:04:58.680831 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 17 18:04:58.680831 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise self.value May 17 18:04:58.680831 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 17 18:04:58.680831 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 17 18:04:58.680831 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 17 18:04:58.680831 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application session.commit() May 17 18:04:58.680831 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 17 18:04:58.680831 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 17 18:04:58.680831 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 17 18:04:58.682002 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application self._prepare_impl() May 17 18:04:58.682002 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 17 18:04:58.682002 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application self.session.flush() May 17 18:04:58.682002 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 17 18:04:58.682002 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application self._flush(objects) May 17 18:04:58.682002 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 17 18:04:58.682002 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 17 18:04:58.682002 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 17 18:04:58.682002 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application compat.raise_( May 17 18:04:58.682002 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 17 18:04:58.682002 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception May 17 18:04:58.682002 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 17 18:04:58.682002 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application flush_context.execute() May 17 18:04:58.682002 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 17 18:04:58.682002 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rec.execute(self) May 17 18:04:58.682002 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 17 18:04:58.682002 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 17 18:04:58.683096 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 17 18:04:58.683096 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application _emit_insert_statements( May 17 18:04:58.683096 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 17 18:04:58.683096 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application result = connection._execute_20( May 17 18:04:58.683096 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 17 18:04:58.683096 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 17 18:04:58.683096 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 17 18:04:58.683096 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 17 18:04:58.683096 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 17 18:04:58.683096 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ret = self._execute_context( May 17 18:04:58.683096 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 17 18:04:58.683096 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 17 18:04:58.683096 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 17 18:04:58.683096 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 17 18:04:58.683096 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 17 18:04:58.683096 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception May 17 18:04:58.685030 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 17 18:04:58.685030 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application self.dialect.do_execute( May 17 18:04:58.685030 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 17 18:04:58.685030 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 17 18:04:58.685030 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 17 18:04:58.685030 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application result = self._query(query) May 17 18:04:58.685030 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 17 18:04:58.685030 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application conn.query(q) May 17 18:04:58.685030 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 17 18:04:58.685030 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 17 18:04:58.685030 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 17 18:04:58.685030 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application result.read() May 17 18:04:58.685030 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 17 18:04:58.685030 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 17 18:04:58.685030 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 17 18:04:58.685030 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application packet.raise_for_error() May 17 18:04:58.686161 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 17 18:04:58.686161 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 17 18:04:58.686161 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 17 18:04:58.686161 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 17 18:04:58.686161 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 17 18:04:58.686161 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 17 18:04:58.686161 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [parameters: {'user_id': '4d6d6ede48cb4d009a3e8d1095f0279f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 17 18:04:58.686161 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 17 18:04:58.686161 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:58.686161 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 18:04:58.686161 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:58.686161 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:58.686161 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:58.686161 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:58.686161 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:58.687190 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:58.687190 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:58.687190 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:58.687190 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:58.687190 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:58.687190 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:58.687190 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:58.687190 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 17 18:04:58.687190 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 17 18:04:58.687190 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:58.687190 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:58.687190 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 18:04:58.687190 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:04:58.687190 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 18:04:58.687190 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:04:58.687190 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 17 18:04:58.687190 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 17 18:04:58.688334 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 17 18:04:58.688334 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 17 18:04:58.688334 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 17 18:04:58.688334 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 17 18:04:58.688334 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 17 18:04:58.688334 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:58.696306 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 486/971] 10.222.0.65 () {60 vars in 1131 bytes} [Tue May 17 18:04:58 2022] POST /identity/v3/users => generated 160 bytes in 195 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 17 18:04:58.697367 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd2b1f-be87-4c9b-9ef0-611be53bbf66 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:58.747626 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9452529-9089-4563-9277-9eec433c0c6a None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:58.792269 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5ebe13-dab5-4822-998d-c550920f9da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:58.794106 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ebe13-dab5-4822-998d-c550920f9da7 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:58.794430 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ebe13-dab5-4822-998d-c550920f9da7 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:58.794714 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ebe13-dab5-4822-998d-c550920f9da7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:58.806545 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cd2b1f-be87-4c9b-9ef0-611be53bbf66 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:58.842385 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c4ddde-366a-4292-8c7d-2bf874890518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:58.843186 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c4ddde-366a-4292-8c7d-2bf874890518 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:58.843464 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c4ddde-366a-4292-8c7d-2bf874890518 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:58.845669 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c4ddde-366a-4292-8c7d-2bf874890518 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:58.851712 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c4ddde-366a-4292-8c7d-2bf874890518 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:58.853362 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c4ddde-366a-4292-8c7d-2bf874890518 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:58.866957 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5ebe13-dab5-4822-998d-c550920f9da7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:58.867765 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-c5c4ddde-366a-4292-8c7d-2bf874890518 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 17 18:04:58.867765 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:58.867765 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:58.867765 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:58.867765 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:58.867765 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:58.867765 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:58.867765 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:58.867765 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:58.867765 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:58.867765 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:58.867765 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:58.867765 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 18:04:58.867765 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 18:04:58.867765 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 18:04:58.867765 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 18:04:58.868766 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:58.868766 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:58.868766 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 18:04:58.868766 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:04:58.868766 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 18:04:58.868766 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:04:58.868766 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:58.868766 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:58.868766 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:58.868766 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:58.868766 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:58.868766 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:58.868766 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:58.868766 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:58.868766 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:58.868766 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:58.868766 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:58.868766 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:58.869748 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:58.869748 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:58.869748 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 18:04:58.869748 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 18:04:58.869748 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 18:04:58.869748 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 18:04:58.869748 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 18:04:58.869748 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 18:04:58.869748 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 17 18:04:58.869748 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:58.870515 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5ebe13-dab5-4822-998d-c550920f9da7 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:58.870596 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 487/972] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 17 18:04:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:04:58.870596 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8f7d0-90cd-4408-9db2-0f3dbb50de18 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:58.870596 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8f7d0-90cd-4408-9db2-0f3dbb50de18 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:58.870791 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8f7d0-90cd-4408-9db2-0f3dbb50de18 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:58.875511 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 488/973] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:04:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:04:58.876618 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eca9d4-f612-492d-a4ec-f304274a058b None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:58.876966 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eca9d4-f612-492d-a4ec-f304274a058b None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:58.877165 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eca9d4-f612-492d-a4ec-f304274a058b None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:58.878399 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 489/974] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:04:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:04:58.879090 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eca9d4-f612-492d-a4ec-f304274a058b None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:58.962372 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 486/975] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 17 18:04:58 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 17 18:04:58.963727 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc89da-b36b-4198-a53f-b3f241d0a50a None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:58.964020 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc89da-b36b-4198-a53f-b3f241d0a50a None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:58.964294 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc89da-b36b-4198-a53f-b3f241d0a50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:58.977364 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eca9d4-f612-492d-a4ec-f304274a058b None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:58.980086 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-bafc89da-b36b-4198-a53f-b3f241d0a50a None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:58.981280 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-bafc89da-b36b-4198-a53f-b3f241d0a50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:59.008677 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70945ec-e52b-4867-b16d-9095e5235270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:59.009391 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70945ec-e52b-4867-b16d-9095e5235270 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:59.009717 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70945ec-e52b-4867-b16d-9095e5235270 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:59.010010 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70945ec-e52b-4867-b16d-9095e5235270 None admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:59.010886 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70945ec-e52b-4867-b16d-9095e5235270 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:59.011217 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70945ec-e52b-4867-b16d-9095e5235270 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:59.013204 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70945ec-e52b-4867-b16d-9095e5235270 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:59.042466 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 487/976] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:04:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:04:59.044211 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadea6d1-10c8-44f2-9452-df5841c0875c None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:59.044486 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadea6d1-10c8-44f2-9452-df5841c0875c None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:59.044753 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadea6d1-10c8-44f2-9452-df5841c0875c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:59.058566 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 490/977] 10.222.0.65 () {56 vars in 1101 bytes} [Tue May 17 18:04:58 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:59.058566 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70945ec-e52b-4867-b16d-9095e5235270 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:59.060010 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-fadea6d1-10c8-44f2-9452-df5841c0875c None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:59.061291 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-fadea6d1-10c8-44f2-9452-df5841c0875c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:59.132330 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 488/978] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:04:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:04:59.133179 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadea6d1-10c8-44f2-9452-df5841c0875c None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:59.192471 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70945ec-e52b-4867-b16d-9095e5235270 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:59.228273 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7e0a4-cdb3-4390-bae2-157dbde802e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:59.229510 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7e0a4-cdb3-4390-bae2-157dbde802e4 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:59.229992 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7e0a4-cdb3-4390-bae2-157dbde802e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:59.230475 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7e0a4-cdb3-4390-bae2-157dbde802e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:59.237387 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadea6d1-10c8-44f2-9452-df5841c0875c None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:59.242262 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec7e0a4-cdb3-4390-bae2-157dbde802e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:59.243708 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec7e0a4-cdb3-4390-bae2-157dbde802e4 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:59.264846 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-0ec7e0a4-cdb3-4390-bae2-157dbde802e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:59.264846 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:59.264846 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:59.264846 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:59.264846 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:59.264846 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:59.264846 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:59.264846 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:59.264846 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:59.264846 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:59.264846 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:59.264846 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:59.264846 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:04:59.264846 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:04:59.264846 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:04:59.265834 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:04:59.265834 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:59.265834 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:59.265834 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:59.265834 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:59.265834 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:59.265834 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:59.265834 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:59.265834 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:04:59.265834 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:59.265834 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:59.265834 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:59.265834 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:59.265834 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:59.265834 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:59.265834 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:59.265834 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:59.266751 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:04:59.266751 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:04:59.266751 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:04:59.266751 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:04:59.266751 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 491/979] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:04:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:59.267036 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7e0a4-cdb3-4390-bae2-157dbde802e4 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:59.276047 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd8e333-0cc0-49e3-b36a-8bffff9b2ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:59.276047 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd8e333-0cc0-49e3-b36a-8bffff9b2ac4 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:59.276305 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd8e333-0cc0-49e3-b36a-8bffff9b2ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:59.276380 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd8e333-0cc0-49e3-b36a-8bffff9b2ac4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:59.280395 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd8e333-0cc0-49e3-b36a-8bffff9b2ac4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:59.280395 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd8e333-0cc0-49e3-b36a-8bffff9b2ac4 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:59.292584 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-dcd8e333-0cc0-49e3-b36a-8bffff9b2ac4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 18:04:59.292584 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:59.292584 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 18:04:59.292584 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 18:04:59.292584 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 18:04:59.292584 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 18:04:59.292584 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 18:04:59.292584 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:04:59.292584 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 18:04:59.292584 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:59.292584 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 18:04:59.292584 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:59.292584 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:59.292584 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:59.292584 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:59.292584 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:59.292584 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:59.293876 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:59.293876 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:59.293876 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:59.293876 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:59.293876 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:59.293876 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:59.293876 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 18:04:59.293876 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 18:04:59.293876 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 18:04:59.293876 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 18:04:59.293876 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:59.293876 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:59.293876 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:59.293876 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:59.293876 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:59.293876 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:59.294802 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:59.294802 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:59.294802 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:59.294802 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:59.294802 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:59.294802 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:59.294802 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:59.294802 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:59.294802 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:59.294802 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:59.294802 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 18:04:59.294802 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:04:59.294802 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 18:04:59.294802 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:59.294802 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 489/980] 10.222.0.65 () {56 vars in 1126 bytes} [Tue May 17 18:04:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:59.295641 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd8e333-0cc0-49e3-b36a-8bffff9b2ac4 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:59.367486 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7e0a4-cdb3-4390-bae2-157dbde802e4 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:59.399512 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd8e333-0cc0-49e3-b36a-8bffff9b2ac4 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:59.399918 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504f092-59d1-4a02-a63a-fbc5539d2297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:59.400569 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504f092-59d1-4a02-a63a-fbc5539d2297 None admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:59.400853 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504f092-59d1-4a02-a63a-fbc5539d2297 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:59.401125 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504f092-59d1-4a02-a63a-fbc5539d2297 None admin] PATH_INFO: `/v3/services` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:59.401879 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b504f092-59d1-4a02-a63a-fbc5539d2297 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:59.403269 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b504f092-59d1-4a02-a63a-fbc5539d2297 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:59.415852 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 492/981] 10.222.0.65 () {60 vars in 1141 bytes} [Tue May 17 18:04:59 2022] POST /identity/v3/services => generated 242 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:04:59.416639 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504f092-59d1-4a02-a63a-fbc5539d2297 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:59.439846 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3b5d7d-4df5-406c-b454-ac09f03307df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:59.440527 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b5d7d-4df5-406c-b454-ac09f03307df None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:59.440812 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b5d7d-4df5-406c-b454-ac09f03307df None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:59.441084 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b5d7d-4df5-406c-b454-ac09f03307df None admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:59.441850 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3b5d7d-4df5-406c-b454-ac09f03307df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:59.442155 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3b5d7d-4df5-406c-b454-ac09f03307df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:59.443844 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3b5d7d-4df5-406c-b454-ac09f03307df None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:59.461109 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 490/982] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:04:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:59.463368 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3b5d7d-4df5-406c-b454-ac09f03307df None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:59.522061 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504f092-59d1-4a02-a63a-fbc5539d2297 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:59.556384 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d10f35-4661-4152-a2f4-a2e48c8623f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:59.557055 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d10f35-4661-4152-a2f4-a2e48c8623f6 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:59.557329 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d10f35-4661-4152-a2f4-a2e48c8623f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:59.557628 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d10f35-4661-4152-a2f4-a2e48c8623f6 None admin] PATH_INFO: `/v3/services` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:59.558339 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d10f35-4661-4152-a2f4-a2e48c8623f6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:59.558643 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d10f35-4661-4152-a2f4-a2e48c8623f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:59.560097 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d10f35-4661-4152-a2f4-a2e48c8623f6 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:59.570454 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 493/983] 10.222.0.65 () {56 vars in 1122 bytes} [Tue May 17 18:04:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:59.570647 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3b5d7d-4df5-406c-b454-ac09f03307df None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:59.571563 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d10f35-4661-4152-a2f4-a2e48c8623f6 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:59.605581 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e9922-87c2-4985-99ef-480626efb7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:59.606928 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e9922-87c2-4985-99ef-480626efb7c0 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:59.607205 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e9922-87c2-4985-99ef-480626efb7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:59.607472 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e9922-87c2-4985-99ef-480626efb7c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:59.614805 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8e9922-87c2-4985-99ef-480626efb7c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:59.616244 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8e9922-87c2-4985-99ef-480626efb7c0 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:59.630347 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-1b8e9922-87c2-4985-99ef-480626efb7c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:04:59.630347 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:04:59.630347 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:04:59.630347 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:04:59.630347 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:04:59.630347 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:04:59.630347 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:04:59.630347 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:04:59.630347 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:04:59.630347 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:04:59.630347 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:04:59.630347 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:04:59.630347 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 18:04:59.630347 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 18:04:59.630347 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 18:04:59.631301 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 18:04:59.631301 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:04:59.631301 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:04:59.631301 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:04:59.631301 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:04:59.631301 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:04:59.631301 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:04:59.631301 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:04:59.631301 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:04:59.631301 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:04:59.631301 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:04:59.631301 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:04:59.631301 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:04:59.631301 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:04:59.631301 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:04:59.631301 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:04:59.631301 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:04:59.632242 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 18:04:59.632242 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 18:04:59.632242 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 18:04:59.632242 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 18:04:59.632242 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 18:04:59.632242 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 18:04:59.632242 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:04:59.632242 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:04:59.632242 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 491/984] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 17 18:04:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:04:59.637923 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e9922-87c2-4985-99ef-480626efb7c0 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:59.673413 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d10f35-4661-4152-a2f4-a2e48c8623f6 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:59.706251 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5dd0d0-6f96-479f-a675-3ad31f328237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:59.706904 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5dd0d0-6f96-479f-a675-3ad31f328237 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:59.707184 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5dd0d0-6f96-479f-a675-3ad31f328237 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:59.707452 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5dd0d0-6f96-479f-a675-3ad31f328237 None admin] PATH_INFO: `/v3/services` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:59.708175 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5dd0d0-6f96-479f-a675-3ad31f328237 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:59.708475 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5dd0d0-6f96-479f-a675-3ad31f328237 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:59.709847 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5dd0d0-6f96-479f-a675-3ad31f328237 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:59.714658 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 494/985] 10.222.0.65 () {56 vars in 1122 bytes} [Tue May 17 18:04:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:04:59.720463 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5dd0d0-6f96-479f-a675-3ad31f328237 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:59.736216 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e9922-87c2-4985-99ef-480626efb7c0 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:59.769726 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06de8a2-0d4a-4408-afb9-1ee0b8cefbdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:59.770617 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06de8a2-0d4a-4408-afb9-1ee0b8cefbdc None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:59.771041 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06de8a2-0d4a-4408-afb9-1ee0b8cefbdc None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:59.771468 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06de8a2-0d4a-4408-afb9-1ee0b8cefbdc None admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:59.772387 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06de8a2-0d4a-4408-afb9-1ee0b8cefbdc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:59.772884 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06de8a2-0d4a-4408-afb9-1ee0b8cefbdc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:59.774369 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06de8a2-0d4a-4408-afb9-1ee0b8cefbdc None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:59.789495 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 492/986] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 17 18:04:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:04:59.792996 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06de8a2-0d4a-4408-afb9-1ee0b8cefbdc None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:59.816877 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5dd0d0-6f96-479f-a675-3ad31f328237 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:59.854121 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d05c753-391b-4742-9453-ee04e682db7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:59.855023 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05c753-391b-4742-9453-ee04e682db7b None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:59.855290 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05c753-391b-4742-9453-ee04e682db7b None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:59.855554 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05c753-391b-4742-9453-ee04e682db7b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:59.856445 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d05c753-391b-4742-9453-ee04e682db7b None admin] RBAC: Adding query filter params (interface=admin, service_id=3831e4b129aa409db1ad6990401ed86e, region_id=RegionOne) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:59.856765 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d05c753-391b-4742-9453-ee04e682db7b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:59.858145 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d05c753-391b-4742-9453-ee04e682db7b None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:59.863196 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 495/987] 10.222.0.65 () {56 vars in 1249 bytes} [Tue May 17 18:04:59 2022] GET /identity/v3/endpoints?service_id=3831e4b129aa409db1ad6990401ed86e&interface=admin®ion_id=RegionOne => generated 193 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:04:59.868324 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d05c753-391b-4742-9453-ee04e682db7b None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:59.898318 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06de8a2-0d4a-4408-afb9-1ee0b8cefbdc None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:59.932844 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8843e47-732b-4787-99fd-60aa38fe8d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:59.933478 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8843e47-732b-4787-99fd-60aa38fe8d93 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:59.933891 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8843e47-732b-4787-99fd-60aa38fe8d93 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:59.934730 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8843e47-732b-4787-99fd-60aa38fe8d93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:59.935550 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8843e47-732b-4787-99fd-60aa38fe8d93 None admin] RBAC: Adding query filter params (role.id=389e932f10c643a2aa76b3a21351e061, scope.project.id=0cf165918c1f46cb96d4b54409862659, user.id=f370e353067848b5843c5650183be347) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:04:59.935859 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8843e47-732b-4787-99fd-60aa38fe8d93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:59.937269 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8843e47-732b-4787-99fd-60aa38fe8d93 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:59.943677 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 493/988] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 17 18:04:59 2022] GET /identity/v3/role_assignments?user.id=f370e353067848b5843c5650183be347&scope.project.id=0cf165918c1f46cb96d4b54409862659&role.id=389e932f10c643a2aa76b3a21351e061 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:04:59.967554 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d05c753-391b-4742-9453-ee04e682db7b None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:00.003208 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a5ae48-35a3-41c7-b17c-9ee5cbd2a5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:00.003891 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5ae48-35a3-41c7-b17c-9ee5cbd2a5ec None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:00.004167 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5ae48-35a3-41c7-b17c-9ee5cbd2a5ec None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:00.004439 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5ae48-35a3-41c7-b17c-9ee5cbd2a5ec None admin] PATH_INFO: `/v3/services` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:00.005127 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a5ae48-35a3-41c7-b17c-9ee5cbd2a5ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:00.006563 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a5ae48-35a3-41c7-b17c-9ee5cbd2a5ec None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:00.021582 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 496/989] 10.222.0.65 () {56 vars in 1087 bytes} [Tue May 17 18:04:59 2022] GET /identity/v3/services => generated 1727 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:05:01.666382 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b736af-a77d-4a6c-a4db-893235660026 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:01.666909 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b736af-a77d-4a6c-a4db-893235660026 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:01.666909 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b736af-a77d-4a6c-a4db-893235660026 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:01.668468 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 494/990] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:05:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:05:01.673752 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8cf791-d994-45a6-ac7e-9fc62338e5d3 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:01.674225 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8cf791-d994-45a6-ac7e-9fc62338e5d3 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:01.674317 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8cf791-d994-45a6-ac7e-9fc62338e5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:01.691446 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-7f8cf791-d994-45a6-ac7e-9fc62338e5d3 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:05:01.693213 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-7f8cf791-d994-45a6-ac7e-9fc62338e5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:05:01.757651 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 497/991] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:05:01 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:05:01.779744 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b736af-a77d-4a6c-a4db-893235660026 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:01.885097 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b736af-a77d-4a6c-a4db-893235660026 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:01.916779 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0761853-9215-4068-a754-8a9ee64749c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:01.917543 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0761853-9215-4068-a754-8a9ee64749c8 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:01.917781 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0761853-9215-4068-a754-8a9ee64749c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:01.918046 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0761853-9215-4068-a754-8a9ee64749c8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:01.919187 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0761853-9215-4068-a754-8a9ee64749c8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:01.920533 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0761853-9215-4068-a754-8a9ee64749c8 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:01.931880 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-a0761853-9215-4068-a754-8a9ee64749c8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 17 18:05:01.931880 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:05:01.931880 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 18:05:01.931880 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 18:05:01.931880 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 18:05:01.931880 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 18:05:01.931880 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 18:05:01.931880 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:05:01.931880 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 17 18:05:01.931880 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:05:01.931880 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 18:05:01.931880 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:05:01.931880 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:05:01.931880 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:05:01.931880 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:05:01.931880 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:05:01.931880 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:05:01.932897 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:05:01.932897 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:05:01.932897 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:05:01.932897 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:05:01.932897 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:05:01.932897 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:05:01.932897 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 18:05:01.932897 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 18:05:01.932897 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 18:05:01.932897 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 18:05:01.932897 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:05:01.932897 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:05:01.932897 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:05:01.932897 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:05:01.932897 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:05:01.932897 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:05:01.939480 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:05:01.939480 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:05:01.939480 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:05:01.939480 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:05:01.939480 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:05:01.939480 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:05:01.939480 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:05:01.939480 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:05:01.939480 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:05:01.939480 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:05:01.939480 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 18:05:01.939480 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:05:01.939480 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 17 18:05:01.939480 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:05:01.939480 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 495/992] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 17 18:05:01 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:05:01.942042 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8cf791-d994-45a6-ac7e-9fc62338e5d3 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:02.037382 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8cf791-d994-45a6-ac7e-9fc62338e5d3 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:02.075400 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7708df2d-b7ce-41ce-b447-fa789c1c8b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:02.076061 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7708df2d-b7ce-41ce-b447-fa789c1c8b2a None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:02.076338 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7708df2d-b7ce-41ce-b447-fa789c1c8b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:02.076608 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7708df2d-b7ce-41ce-b447-fa789c1c8b2a None admin] PATH_INFO: `/v3/services` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:02.077316 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7708df2d-b7ce-41ce-b447-fa789c1c8b2a None admin] RBAC: Adding query filter params (name=compute) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:05:02.077645 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7708df2d-b7ce-41ce-b447-fa789c1c8b2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:02.078999 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7708df2d-b7ce-41ce-b447-fa789c1c8b2a None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:02.088259 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 498/993] 10.222.0.65 () {56 vars in 1112 bytes} [Tue May 17 18:05:01 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:05:02.089480 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0761853-9215-4068-a754-8a9ee64749c8 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:02.185913 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0761853-9215-4068-a754-8a9ee64749c8 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:02.218075 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a64c6d-5c84-425e-81db-4468e5d53c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:02.218731 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a64c6d-5c84-425e-81db-4468e5d53c40 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:02.219007 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a64c6d-5c84-425e-81db-4468e5d53c40 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:02.219276 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a64c6d-5c84-425e-81db-4468e5d53c40 None admin] PATH_INFO: `/v3/services` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:02.220226 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a64c6d-5c84-425e-81db-4468e5d53c40 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:05:02.220333 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a64c6d-5c84-425e-81db-4468e5d53c40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:02.221637 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a64c6d-5c84-425e-81db-4468e5d53c40 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:02.221817 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29ca24-951c-4c16-b937-db5cd6bfe0ad None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:02.222126 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29ca24-951c-4c16-b937-db5cd6bfe0ad None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:02.222425 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29ca24-951c-4c16-b937-db5cd6bfe0ad None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:02.224049 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 499/994] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:05:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 18:05:02.226919 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 496/995] 10.222.0.65 () {56 vars in 1112 bytes} [Tue May 17 18:05:02 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:05:02.228141 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6d845-69f2-4e1a-b9f3-cb8231c0c47d None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:02.228416 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6d845-69f2-4e1a-b9f3-cb8231c0c47d None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:02.228684 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6d845-69f2-4e1a-b9f3-cb8231c0c47d None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:02.230114 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 500/996] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:05:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:05:02.230835 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e27586-7a05-4e50-9ead-e0cd5071ba62 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:02.231680 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e27586-7a05-4e50-9ead-e0cd5071ba62 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:02.231963 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e27586-7a05-4e50-9ead-e0cd5071ba62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:02.232511 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6d845-69f2-4e1a-b9f3-cb8231c0c47d None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:02.247801 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-a4e27586-7a05-4e50-9ead-e0cd5071ba62 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:05:02.248981 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-a4e27586-7a05-4e50-9ead-e0cd5071ba62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:05:02.312105 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 497/997] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:05:02 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:05:02.313722 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cdd805-a10b-4e80-81ff-17da834d2748 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:02.314005 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cdd805-a10b-4e80-81ff-17da834d2748 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:02.314354 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cdd805-a10b-4e80-81ff-17da834d2748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:02.329487 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6d845-69f2-4e1a-b9f3-cb8231c0c47d None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:02.329800 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-08cdd805-a10b-4e80-81ff-17da834d2748 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:05:02.330966 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-08cdd805-a10b-4e80-81ff-17da834d2748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:05:02.362493 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14acc1f-bd72-4c3e-a8ff-27c63354ed82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:02.363138 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14acc1f-bd72-4c3e-a8ff-27c63354ed82 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:02.363415 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14acc1f-bd72-4c3e-a8ff-27c63354ed82 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:02.363688 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14acc1f-bd72-4c3e-a8ff-27c63354ed82 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:02.364463 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14acc1f-bd72-4c3e-a8ff-27c63354ed82 None admin] RBAC: Adding query filter params (interface=public, service_id=e2d26f8ac335426ba6426724beecb759, region_id=RegionOne) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:05:02.364769 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14acc1f-bd72-4c3e-a8ff-27c63354ed82 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:02.366169 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14acc1f-bd72-4c3e-a8ff-27c63354ed82 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:02.370958 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 501/998] 10.222.0.65 () {56 vars in 1251 bytes} [Tue May 17 18:05:02 2022] GET /identity/v3/endpoints?service_id=e2d26f8ac335426ba6426724beecb759&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:05:02.372206 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14acc1f-bd72-4c3e-a8ff-27c63354ed82 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:02.399093 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 498/999] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:05:02 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:05:02.399916 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cdd805-a10b-4e80-81ff-17da834d2748 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:02.466594 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14acc1f-bd72-4c3e-a8ff-27c63354ed82 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:02.492350 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cdd805-a10b-4e80-81ff-17da834d2748 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:02.499042 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b87242-b18c-4f51-b825-f9576c7116e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:02.499819 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b87242-b18c-4f51-b825-f9576c7116e9 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:02.500098 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b87242-b18c-4f51-b825-f9576c7116e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:02.500370 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b87242-b18c-4f51-b825-f9576c7116e9 None admin] PATH_INFO: `/v3/services/image` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:02.501013 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b87242-b18c-4f51-b825-f9576c7116e9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:02.502400 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b87242-b18c-4f51-b825-f9576c7116e9 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:02.513593 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-c2b87242-b18c-4f51-b825-f9576c7116e9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 17 18:05:02.513593 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:05:02.513593 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 18:05:02.513593 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 18:05:02.513593 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 18:05:02.513593 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 18:05:02.513593 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 18:05:02.513593 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:05:02.513593 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 17 18:05:02.513593 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:05:02.513593 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 18:05:02.513593 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:05:02.513593 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:05:02.513593 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:05:02.513593 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:05:02.513593 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:05:02.513593 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:05:02.514666 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:05:02.514666 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:05:02.514666 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:05:02.514666 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:05:02.514666 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:05:02.514666 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:05:02.514666 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 18:05:02.514666 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 18:05:02.514666 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 18:05:02.514666 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 18:05:02.514666 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:05:02.514666 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:05:02.514666 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:05:02.514666 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:05:02.514666 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:05:02.514666 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:05:02.515595 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:05:02.515595 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:05:02.515595 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:05:02.515595 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:05:02.515595 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:05:02.515595 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:05:02.515595 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:05:02.515595 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:05:02.515595 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:05:02.515595 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:05:02.515595 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 18:05:02.515595 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:05:02.515595 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 17 18:05:02.515595 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:05:02.515595 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 502/1000] 10.222.0.65 () {56 vars in 1105 bytes} [Tue May 17 18:05:02 2022] GET /identity/v3/services/image => generated 86 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:05:02.516849 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b87242-b18c-4f51-b825-f9576c7116e9 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:02.527011 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5434bb-0811-40de-8b92-0b2a55d6d394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:02.527660 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5434bb-0811-40de-8b92-0b2a55d6d394 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:02.527960 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5434bb-0811-40de-8b92-0b2a55d6d394 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:02.528226 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5434bb-0811-40de-8b92-0b2a55d6d394 None admin] PATH_INFO: `/v3/services` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:02.528893 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5434bb-0811-40de-8b92-0b2a55d6d394 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:02.530275 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5434bb-0811-40de-8b92-0b2a55d6d394 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:02.545496 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 499/1001] 10.222.0.65 () {56 vars in 1087 bytes} [Tue May 17 18:05:02 2022] GET /identity/v3/services => generated 1727 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:05:02.545496 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5434bb-0811-40de-8b92-0b2a55d6d394 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:02.628242 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b87242-b18c-4f51-b825-f9576c7116e9 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:02.643084 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5434bb-0811-40de-8b92-0b2a55d6d394 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:02.663631 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cde8cf-e6ea-44c9-ac3b-6fbba09111c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:02.664449 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cde8cf-e6ea-44c9-ac3b-6fbba09111c1 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:02.664747 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cde8cf-e6ea-44c9-ac3b-6fbba09111c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:02.664999 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cde8cf-e6ea-44c9-ac3b-6fbba09111c1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:02.665680 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cde8cf-e6ea-44c9-ac3b-6fbba09111c1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:02.667085 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cde8cf-e6ea-44c9-ac3b-6fbba09111c1 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:02.677989 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98bbf5f-6703-4df9-9e4f-455dd22a8cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:02.678668 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98bbf5f-6703-4df9-9e4f-455dd22a8cbf None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:02.678924 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98bbf5f-6703-4df9-9e4f-455dd22a8cbf None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:02.679183 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98bbf5f-6703-4df9-9e4f-455dd22a8cbf None admin] PATH_INFO: `/v3/services` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:02.679885 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98bbf5f-6703-4df9-9e4f-455dd22a8cbf None admin] RBAC: Adding query filter params (name=image) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:05:02.680182 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-77cde8cf-e6ea-44c9-ac3b-6fbba09111c1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 18:05:02.680182 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:05:02.680182 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 18:05:02.680182 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 18:05:02.680182 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 18:05:02.680182 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 18:05:02.680182 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 18:05:02.680182 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:05:02.680182 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 18:05:02.680182 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:05:02.680182 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 18:05:02.680182 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:05:02.680182 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:05:02.680182 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:05:02.680182 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:05:02.680182 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:05:02.680182 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:05:02.681423 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:05:02.681423 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:05:02.681423 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:05:02.681423 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:05:02.681423 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:05:02.681423 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:05:02.681423 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 18:05:02.681423 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 18:05:02.681423 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 18:05:02.681423 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 18:05:02.681423 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:05:02.681423 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:05:02.681423 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:05:02.681423 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:05:02.681423 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:05:02.681423 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:05:02.682620 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:05:02.682620 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:05:02.682620 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:05:02.682620 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:05:02.682620 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:05:02.682620 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:05:02.682620 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:05:02.682620 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:05:02.682620 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:05:02.682620 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:05:02.682620 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 18:05:02.682620 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:05:02.682620 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 18:05:02.682620 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:05:02.684062 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98bbf5f-6703-4df9-9e4f-455dd22a8cbf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:02.684062 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98bbf5f-6703-4df9-9e4f-455dd22a8cbf None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:02.687064 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 503/1002] 10.222.0.65 () {56 vars in 1126 bytes} [Tue May 17 18:05:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:05:02.688604 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 500/1003] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:05:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:05:02.689597 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cde8cf-e6ea-44c9-ac3b-6fbba09111c1 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:02.695833 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98bbf5f-6703-4df9-9e4f-455dd22a8cbf None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:02.793926 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98bbf5f-6703-4df9-9e4f-455dd22a8cbf None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:02.796184 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cde8cf-e6ea-44c9-ac3b-6fbba09111c1 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:02.828758 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f299251-e384-4692-ac4e-feca01dabae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:02.829231 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b316426c-35a9-40de-ae97-b75491b9f0ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:02.829927 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316426c-35a9-40de-ae97-b75491b9f0ef None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:02.830205 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316426c-35a9-40de-ae97-b75491b9f0ef None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:02.830477 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316426c-35a9-40de-ae97-b75491b9f0ef None admin] PATH_INFO: `/v3/services` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:02.831176 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b316426c-35a9-40de-ae97-b75491b9f0ef None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:05:02.831476 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b316426c-35a9-40de-ae97-b75491b9f0ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:02.834103 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b316426c-35a9-40de-ae97-b75491b9f0ef None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:02.834740 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f299251-e384-4692-ac4e-feca01dabae4 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:02.834740 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f299251-e384-4692-ac4e-feca01dabae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:02.834740 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f299251-e384-4692-ac4e-feca01dabae4 None admin] PATH_INFO: `/v3/services` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:02.834740 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f299251-e384-4692-ac4e-feca01dabae4 None admin] RBAC: Adding query filter params (type=image) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:05:02.834740 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f299251-e384-4692-ac4e-feca01dabae4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:02.835804 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f299251-e384-4692-ac4e-feca01dabae4 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:02.839535 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 504/1004] 10.222.0.65 () {56 vars in 1122 bytes} [Tue May 17 18:05:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:05:02.845545 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 501/1005] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:05:02 2022] GET /identity/v3/services?type=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:05:02.845725 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b316426c-35a9-40de-ae97-b75491b9f0ef None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:02.959253 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b316426c-35a9-40de-ae97-b75491b9f0ef None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:02.993621 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edffd4a-fe1e-4c9b-bf43-75807b4523f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:02.994292 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edffd4a-fe1e-4c9b-bf43-75807b4523f2 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:02.994567 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edffd4a-fe1e-4c9b-bf43-75807b4523f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:02.994834 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edffd4a-fe1e-4c9b-bf43-75807b4523f2 None admin] PATH_INFO: `/v3/services` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:02.995541 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edffd4a-fe1e-4c9b-bf43-75807b4523f2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:05:02.995840 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edffd4a-fe1e-4c9b-bf43-75807b4523f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:02.997315 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edffd4a-fe1e-4c9b-bf43-75807b4523f2 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:03.005824 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 505/1006] 10.222.0.65 () {56 vars in 1122 bytes} [Tue May 17 18:05:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:05:03.008339 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f299251-e384-4692-ac4e-feca01dabae4 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:03.108982 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f299251-e384-4692-ac4e-feca01dabae4 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:03.141701 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc57b3-96c3-4c00-a6f2-7c845d90917b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:03.142351 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc57b3-96c3-4c00-a6f2-7c845d90917b None admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:03.142629 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc57b3-96c3-4c00-a6f2-7c845d90917b None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:03.142893 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc57b3-96c3-4c00-a6f2-7c845d90917b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:03.143623 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbc57b3-96c3-4c00-a6f2-7c845d90917b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:03.144981 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbc57b3-96c3-4c00-a6f2-7c845d90917b None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:03.165506 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 502/1007] 10.222.0.65 () {60 vars in 1144 bytes} [Tue May 17 18:05:03 2022] POST /identity/v3/endpoints => generated 325 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:05:04.820898 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910fe69c-92df-4591-848d-112ca457aad0 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:04.821421 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910fe69c-92df-4591-848d-112ca457aad0 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:04.821751 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910fe69c-92df-4591-848d-112ca457aad0 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:04.822885 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 506/1008] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:05:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:05:04.829103 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f61e5c-7d5a-4585-967a-d8dcb7b3d422 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:04.829627 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f61e5c-7d5a-4585-967a-d8dcb7b3d422 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:04.829718 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f61e5c-7d5a-4585-967a-d8dcb7b3d422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:04.846504 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-38f61e5c-7d5a-4585-967a-d8dcb7b3d422 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:05:04.847683 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-38f61e5c-7d5a-4585-967a-d8dcb7b3d422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:05:04.924303 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 503/1009] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:05:04 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:05:04.948918 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910fe69c-92df-4591-848d-112ca457aad0 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:05.049606 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910fe69c-92df-4591-848d-112ca457aad0 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:05.063018 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba67fb-3c28-4422-903d-529890aad83d None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:05.063305 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba67fb-3c28-4422-903d-529890aad83d None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:05.063580 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba67fb-3c28-4422-903d-529890aad83d None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:05.065186 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 504/1010] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:05:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:05:05.070692 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c8ce20-1582-4d0e-b204-e69e00f57c9e None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:05.071029 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c8ce20-1582-4d0e-b204-e69e00f57c9e None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:05.071252 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c8ce20-1582-4d0e-b204-e69e00f57c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:05.088296 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-a7c8ce20-1582-4d0e-b204-e69e00f57c9e None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:05:05.089592 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-a7c8ce20-1582-4d0e-b204-e69e00f57c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:05:05.089802 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db5d33b-f283-4eb9-a752-8b80d1c0f259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:05.091116 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5d33b-f283-4eb9-a752-8b80d1c0f259 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:05.091399 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5d33b-f283-4eb9-a752-8b80d1c0f259 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:05.091672 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5d33b-f283-4eb9-a752-8b80d1c0f259 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:05.092365 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db5d33b-f283-4eb9-a752-8b80d1c0f259 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:05.093756 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db5d33b-f283-4eb9-a752-8b80d1c0f259 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:05.105278 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-0db5d33b-f283-4eb9-a752-8b80d1c0f259 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 17 18:05:05.105278 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:05:05.105278 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 18:05:05.105278 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 18:05:05.105278 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 18:05:05.105278 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 18:05:05.105278 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 18:05:05.105278 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:05:05.105278 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 17 18:05:05.105278 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:05:05.105278 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 18:05:05.105278 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:05:05.105278 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:05:05.105278 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:05:05.105278 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:05:05.105278 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:05:05.105278 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:05:05.106310 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:05:05.106310 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:05:05.106310 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:05:05.106310 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:05:05.106310 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:05:05.106310 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:05:05.106310 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 18:05:05.106310 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 18:05:05.106310 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 18:05:05.106310 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 18:05:05.106310 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:05:05.106310 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:05:05.106310 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:05:05.106310 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:05:05.106310 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:05:05.106310 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:05:05.107302 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:05:05.107302 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:05:05.107302 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:05:05.107302 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:05:05.107302 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:05:05.107302 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:05:05.107302 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:05:05.107302 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:05:05.107302 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:05:05.107302 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:05:05.107302 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 18:05:05.107302 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:05:05.107302 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 17 18:05:05.107302 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:05:05.107302 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 507/1011] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 17 18:05:04 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:05:05.112377 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db5d33b-f283-4eb9-a752-8b80d1c0f259 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:05.159541 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 505/1012] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:05:05 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:05:05.182501 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c8ce20-1582-4d0e-b204-e69e00f57c9e None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:05.214677 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db5d33b-f283-4eb9-a752-8b80d1c0f259 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:05.248893 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7caa787-25ea-4458-8cbf-e32652686487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:05.249576 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7caa787-25ea-4458-8cbf-e32652686487 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:05.249853 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7caa787-25ea-4458-8cbf-e32652686487 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:05.250119 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7caa787-25ea-4458-8cbf-e32652686487 None admin] PATH_INFO: `/v3/services` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:05.250811 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7caa787-25ea-4458-8cbf-e32652686487 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:05:05.251108 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7caa787-25ea-4458-8cbf-e32652686487 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:05.252447 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7caa787-25ea-4458-8cbf-e32652686487 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:05.257249 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 508/1013] 10.222.0.65 () {56 vars in 1112 bytes} [Tue May 17 18:05:05 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:05:05.263689 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7caa787-25ea-4458-8cbf-e32652686487 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:05.289652 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c8ce20-1582-4d0e-b204-e69e00f57c9e None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:05.324255 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379a6d94-ba87-4788-bc5c-1557fa8dc55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:05.324848 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a6d94-ba87-4788-bc5c-1557fa8dc55a None admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:05.325121 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a6d94-ba87-4788-bc5c-1557fa8dc55a None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:05.325386 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a6d94-ba87-4788-bc5c-1557fa8dc55a None admin] PATH_INFO: `/v3/services` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:05.326124 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379a6d94-ba87-4788-bc5c-1557fa8dc55a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:05.327475 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379a6d94-ba87-4788-bc5c-1557fa8dc55a None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:05.342080 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 506/1014] 10.222.0.65 () {60 vars in 1141 bytes} [Tue May 17 18:05:05 2022] POST /identity/v3/services => generated 242 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:05:05.382606 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7caa787-25ea-4458-8cbf-e32652686487 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:05.391242 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584e176-b9a8-496f-a017-6430d5da15a6 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:05.391590 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584e176-b9a8-496f-a017-6430d5da15a6 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:05.391809 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584e176-b9a8-496f-a017-6430d5da15a6 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:05.393329 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 507/1015] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:05:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 18:05:05.398793 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef96cdd8-325d-40a1-8acf-6af5974d5aca None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:05.399097 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef96cdd8-325d-40a1-8acf-6af5974d5aca None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:05.399334 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef96cdd8-325d-40a1-8acf-6af5974d5aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:05.417292 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-ef96cdd8-325d-40a1-8acf-6af5974d5aca None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:05:05.419083 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-ef96cdd8-325d-40a1-8acf-6af5974d5aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:05:05.426071 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2526c9-79b4-496f-8e1e-cbca9fec101d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:05.426745 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2526c9-79b4-496f-8e1e-cbca9fec101d None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:05.427023 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2526c9-79b4-496f-8e1e-cbca9fec101d None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:05.427292 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2526c9-79b4-496f-8e1e-cbca9fec101d None admin] PATH_INFO: `/v3/services` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:05.428004 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2526c9-79b4-496f-8e1e-cbca9fec101d None admin] RBAC: Adding query filter params (type=compute) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:05:05.428320 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2526c9-79b4-496f-8e1e-cbca9fec101d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:05.429723 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2526c9-79b4-496f-8e1e-cbca9fec101d None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:05.435490 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 509/1016] 10.222.0.65 () {56 vars in 1112 bytes} [Tue May 17 18:05:05 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:05:05.441028 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2526c9-79b4-496f-8e1e-cbca9fec101d None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:05.489637 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 508/1017] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:05:05 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 18:05:05.513668 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef96cdd8-325d-40a1-8acf-6af5974d5aca None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:05.547734 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2526c9-79b4-496f-8e1e-cbca9fec101d None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:05.581409 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66624c4-a1e5-43e3-aa7c-259a71fea87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:05.582501 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66624c4-a1e5-43e3-aa7c-259a71fea87f None admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:05.582893 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66624c4-a1e5-43e3-aa7c-259a71fea87f None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:05.583173 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66624c4-a1e5-43e3-aa7c-259a71fea87f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:05.583903 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66624c4-a1e5-43e3-aa7c-259a71fea87f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:05.585264 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66624c4-a1e5-43e3-aa7c-259a71fea87f None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:05.603682 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 510/1018] 10.222.0.65 () {60 vars in 1144 bytes} [Tue May 17 18:05:05 2022] POST /identity/v3/endpoints => generated 334 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:05:05.615158 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef96cdd8-325d-40a1-8acf-6af5974d5aca None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:05.675002 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4d20da-f5ba-4e47-85fd-cf4adb879fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:05.675825 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d20da-f5ba-4e47-85fd-cf4adb879fad None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:05.676101 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d20da-f5ba-4e47-85fd-cf4adb879fad None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:05.676370 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4d20da-f5ba-4e47-85fd-cf4adb879fad None admin] PATH_INFO: `/v3/domains/default` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:05.678040 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4d20da-f5ba-4e47-85fd-cf4adb879fad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:05.679705 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4d20da-f5ba-4e47-85fd-cf4adb879fad None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:05.687237 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 509/1019] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:05:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:05:05.688444 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66624c4-a1e5-43e3-aa7c-259a71fea87f None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:05.791744 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66624c4-a1e5-43e3-aa7c-259a71fea87f None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:05.826665 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14ea149-4c03-46ea-b14c-422c92430c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:05.827422 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ea149-4c03-46ea-b14c-422c92430c32 None admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:05.827605 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ea149-4c03-46ea-b14c-422c92430c32 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:05.827871 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ea149-4c03-46ea-b14c-422c92430c32 None admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:05.828580 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14ea149-4c03-46ea-b14c-422c92430c32 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:05.834640 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14ea149-4c03-46ea-b14c-422c92430c32 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:05.864134 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 511/1020] 10.222.0.65 () {60 vars in 1141 bytes} [Tue May 17 18:05:05 2022] POST /identity/v3/projects => generated 311 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:05:07.575416 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67d2f4-73d0-40b1-b2ef-a405c1e3f6fb None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:07.575940 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67d2f4-73d0-40b1-b2ef-a405c1e3f6fb None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:07.575940 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67d2f4-73d0-40b1-b2ef-a405c1e3f6fb None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:07.577556 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 510/1021] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:05:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:05:07.582882 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb05ca5e-dcbb-45e2-8099-cbffab7e681b None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:07.583341 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb05ca5e-dcbb-45e2-8099-cbffab7e681b None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:07.583420 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb05ca5e-dcbb-45e2-8099-cbffab7e681b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:07.600003 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-cb05ca5e-dcbb-45e2-8099-cbffab7e681b None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:05:07.601161 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-cb05ca5e-dcbb-45e2-8099-cbffab7e681b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:05:07.665775 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 512/1022] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:05:07 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:05:07.688450 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac67d2f4-73d0-40b1-b2ef-a405c1e3f6fb None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:07.789481 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac67d2f4-73d0-40b1-b2ef-a405c1e3f6fb None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:07.821897 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9aba6-190e-460e-9c3e-0077ccce39d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:07.822675 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9aba6-190e-460e-9c3e-0077ccce39d6 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:07.822949 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9aba6-190e-460e-9c3e-0077ccce39d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:07.823216 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9aba6-190e-460e-9c3e-0077ccce39d6 None admin] PATH_INFO: `/v3/services/image` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:07.823850 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c9aba6-190e-460e-9c3e-0077ccce39d6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:07.825792 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c9aba6-190e-460e-9c3e-0077ccce39d6 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:07.840851 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-89c9aba6-190e-460e-9c3e-0077ccce39d6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 17 18:05:07.840851 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:05:07.840851 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 18:05:07.840851 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 18:05:07.840851 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 18:05:07.840851 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 18:05:07.840851 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 18:05:07.840851 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:05:07.840851 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 17 18:05:07.840851 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:05:07.840851 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 18:05:07.840851 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:05:07.840851 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:05:07.840851 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:05:07.840851 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:05:07.840851 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:05:07.840851 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:05:07.841850 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:05:07.841850 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:05:07.841850 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:05:07.841850 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:05:07.841850 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:05:07.841850 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:05:07.841850 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 18:05:07.841850 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 18:05:07.841850 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 18:05:07.841850 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 18:05:07.841850 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:05:07.841850 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:05:07.841850 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:05:07.841850 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:05:07.841850 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:05:07.841850 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:05:07.842697 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:05:07.842697 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:05:07.842697 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:05:07.842697 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:05:07.842697 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:05:07.842697 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:05:07.842697 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:05:07.842697 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:05:07.842697 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:05:07.842697 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:05:07.842697 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 18:05:07.842697 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:05:07.842697 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 17 18:05:07.842697 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:05:07.847921 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 511/1023] 10.222.0.65 () {56 vars in 1105 bytes} [Tue May 17 18:05:07 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:05:07.851133 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb05ca5e-dcbb-45e2-8099-cbffab7e681b None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:07.922986 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf1eeb-5c5c-4de6-bb1a-c67b746050d4 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:07.923244 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf1eeb-5c5c-4de6-bb1a-c67b746050d4 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:07.923526 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf1eeb-5c5c-4de6-bb1a-c67b746050d4 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:07.924879 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 512/1024] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:05:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 18:05:07.930333 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004c17e-3c4c-4179-9abc-4803f76d28e5 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:07.930615 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004c17e-3c4c-4179-9abc-4803f76d28e5 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:07.930887 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c004c17e-3c4c-4179-9abc-4803f76d28e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:07.949017 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-c004c17e-3c4c-4179-9abc-4803f76d28e5 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:05:07.950369 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb05ca5e-dcbb-45e2-8099-cbffab7e681b None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:07.951252 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-c004c17e-3c4c-4179-9abc-4803f76d28e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:05:07.985216 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9700b27-a8e6-4f6a-afd9-b3ac4faf4dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:07.986143 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9700b27-a8e6-4f6a-afd9-b3ac4faf4dfe None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:07.986423 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9700b27-a8e6-4f6a-afd9-b3ac4faf4dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:07.986694 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9700b27-a8e6-4f6a-afd9-b3ac4faf4dfe None admin] PATH_INFO: `/v3/services` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:07.987398 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9700b27-a8e6-4f6a-afd9-b3ac4faf4dfe None admin] RBAC: Adding query filter params (name=image) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:05:07.987700 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9700b27-a8e6-4f6a-afd9-b3ac4faf4dfe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:07.989060 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9700b27-a8e6-4f6a-afd9-b3ac4faf4dfe None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:07.995256 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 513/1025] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:05:07 2022] GET /identity/v3/services?name=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:05:07.999682 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9700b27-a8e6-4f6a-afd9-b3ac4faf4dfe None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:08.020266 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 513/1026] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:05:07 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 18:05:08.042889 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004c17e-3c4c-4179-9abc-4803f76d28e5 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:08.097367 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9700b27-a8e6-4f6a-afd9-b3ac4faf4dfe None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:08.132318 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd807a22-8f2b-4210-9f46-856aaf9e0e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:08.132971 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd807a22-8f2b-4210-9f46-856aaf9e0e5a None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:08.133246 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd807a22-8f2b-4210-9f46-856aaf9e0e5a None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:08.133549 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd807a22-8f2b-4210-9f46-856aaf9e0e5a None admin] PATH_INFO: `/v3/services` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:08.134245 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd807a22-8f2b-4210-9f46-856aaf9e0e5a None admin] RBAC: Adding query filter params (type=image) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:05:08.134546 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd807a22-8f2b-4210-9f46-856aaf9e0e5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:08.135897 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd807a22-8f2b-4210-9f46-856aaf9e0e5a None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:08.138817 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c004c17e-3c4c-4179-9abc-4803f76d28e5 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:08.141103 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 514/1027] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:05:07 2022] GET /identity/v3/services?type=image => generated 350 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:05:08.142325 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d9dcd-d53f-4b41-a68d-a02b1bc0a924 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:08.142694 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d9dcd-d53f-4b41-a68d-a02b1bc0a924 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:08.142866 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d9dcd-d53f-4b41-a68d-a02b1bc0a924 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:08.144175 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 515/1028] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:05:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:05:08.146694 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d9dcd-d53f-4b41-a68d-a02b1bc0a924 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:08.171315 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db2a358-bf31-4489-8707-a4d616f9eb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:08.172147 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db2a358-bf31-4489-8707-a4d616f9eb66 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:08.172423 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db2a358-bf31-4489-8707-a4d616f9eb66 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:08.172692 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db2a358-bf31-4489-8707-a4d616f9eb66 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:08.182224 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db2a358-bf31-4489-8707-a4d616f9eb66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:05:08.190732 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-9db2a358-bf31-4489-8707-a4d616f9eb66 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 18:05:08.190732 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:05:08.190732 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:05:08.190732 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:05:08.190732 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:05:08.190732 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:05:08.190732 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:05:08.190732 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:05:08.190732 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:05:08.190732 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:05:08.190732 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:05:08.190732 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:05:08.190732 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:05:08.190732 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:05:08.190732 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:05:08.190732 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:05:08.191834 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:05:08.191834 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:05:08.191834 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:05:08.191834 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:05:08.191834 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:05:08.191834 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:05:08.191834 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:05:08.191834 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:05:08.191834 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:05:08.191834 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:05:08.191834 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:05:08.191834 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:05:08.191834 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:05:08.191834 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:05:08.191834 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:05:08.191834 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:05:08.193182 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:05:08.193182 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:05:08.193182 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:05:08.193182 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:05:08.193182 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:05:08.193182 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:05:08.193182 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:05:08.193182 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:05:08.193182 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:05:08.193182 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:05:08.193182 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 18:05:08.193182 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:05:08.193880 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 514/1029] 10.222.0.65 () {56 vars in 1120 bytes} [Tue May 17 18:05:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:05:08.194843 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7c572-b2fa-4a9a-acc1-890583e5a912 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:08.195128 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7c572-b2fa-4a9a-acc1-890583e5a912 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:08.195406 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7c572-b2fa-4a9a-acc1-890583e5a912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:08.211726 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-2ab7c572-b2fa-4a9a-acc1-890583e5a912 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:05:08.212891 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-2ab7c572-b2fa-4a9a-acc1-890583e5a912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:05:08.242055 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d9dcd-d53f-4b41-a68d-a02b1bc0a924 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:08.274318 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 515/1030] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:05:08 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:05:08.274505 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f09347-cdfd-4af4-84cf-d9f491d701b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:08.275029 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f09347-cdfd-4af4-84cf-d9f491d701b9 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:08.275133 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab7c572-b2fa-4a9a-acc1-890583e5a912 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:08.275345 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f09347-cdfd-4af4-84cf-d9f491d701b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:08.275568 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f09347-cdfd-4af4-84cf-d9f491d701b9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:08.276338 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f09347-cdfd-4af4-84cf-d9f491d701b9 None admin] RBAC: Adding query filter params (interface=public, service_id=16fe0afc6f1e42cca7e1ef84a97109e3, region_id=RegionOne) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:05:08.276643 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f09347-cdfd-4af4-84cf-d9f491d701b9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:08.278042 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f09347-cdfd-4af4-84cf-d9f491d701b9 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:08.283105 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 516/1031] 10.222.0.65 () {56 vars in 1251 bytes} [Tue May 17 18:05:08 2022] GET /identity/v3/endpoints?service_id=16fe0afc6f1e42cca7e1ef84a97109e3&interface=public®ion_id=RegionOne => generated 194 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:05:08.288226 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f09347-cdfd-4af4-84cf-d9f491d701b9 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:08.366183 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab7c572-b2fa-4a9a-acc1-890583e5a912 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:08.382263 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f09347-cdfd-4af4-84cf-d9f491d701b9 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:08.398232 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b936ba-2216-4b16-9174-0b0c7d576aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:08.398880 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b936ba-2216-4b16-9174-0b0c7d576aa1 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:08.399156 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b936ba-2216-4b16-9174-0b0c7d576aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:08.399420 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b936ba-2216-4b16-9174-0b0c7d576aa1 None admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:08.400148 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b936ba-2216-4b16-9174-0b0c7d576aa1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:05:08.400444 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b936ba-2216-4b16-9174-0b0c7d576aa1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:08.401822 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b936ba-2216-4b16-9174-0b0c7d576aa1 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:08.409224 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 516/1032] 10.222.0.65 () {56 vars in 1115 bytes} [Tue May 17 18:05:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:05:08.410019 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b936ba-2216-4b16-9174-0b0c7d576aa1 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:08.417035 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e97772-1196-4a32-8211-6e7c1c232441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:08.417711 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e97772-1196-4a32-8211-6e7c1c232441 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:08.418000 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e97772-1196-4a32-8211-6e7c1c232441 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:08.418326 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e97772-1196-4a32-8211-6e7c1c232441 None admin] PATH_INFO: `/v3/services` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:08.419005 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e97772-1196-4a32-8211-6e7c1c232441 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:08.420373 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e97772-1196-4a32-8211-6e7c1c232441 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:08.426806 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 517/1033] 10.222.0.65 () {56 vars in 1087 bytes} [Tue May 17 18:05:08 2022] GET /identity/v3/services => generated 1957 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:05:08.428607 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e97772-1196-4a32-8211-6e7c1c232441 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:08.519132 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b936ba-2216-4b16-9174-0b0c7d576aa1 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:08.532468 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e97772-1196-4a32-8211-6e7c1c232441 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:08.554864 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aa9bd0-cac4-4ef0-ac06-f8d650cd13d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:08.555672 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa9bd0-cac4-4ef0-ac06-f8d650cd13d1 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:08.555946 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa9bd0-cac4-4ef0-ac06-f8d650cd13d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:08.556214 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa9bd0-cac4-4ef0-ac06-f8d650cd13d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:08.557442 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aa9bd0-cac4-4ef0-ac06-f8d650cd13d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:08.558986 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aa9bd0-cac4-4ef0-ac06-f8d650cd13d1 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:08.565344 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 517/1034] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:05:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:05:08.566518 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aa9bd0-cac4-4ef0-ac06-f8d650cd13d1 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:08.567893 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1989c861-63ac-48b3-acea-a211b3f53eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:08.568691 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989c861-63ac-48b3-acea-a211b3f53eb4 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:08.568967 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989c861-63ac-48b3-acea-a211b3f53eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:08.569253 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989c861-63ac-48b3-acea-a211b3f53eb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:08.580622 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1989c861-63ac-48b3-acea-a211b3f53eb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:08.582121 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1989c861-63ac-48b3-acea-a211b3f53eb4 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:08.600154 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-1989c861-63ac-48b3-acea-a211b3f53eb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:05:08.600154 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:05:08.600154 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:05:08.600154 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:05:08.600154 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:05:08.600154 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:05:08.600154 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:05:08.600154 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:05:08.600154 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:05:08.600154 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:05:08.600154 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:05:08.600154 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:05:08.600154 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:05:08.600154 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:05:08.600154 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:05:08.601600 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:05:08.601600 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:05:08.601600 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:05:08.601600 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:05:08.601600 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:05:08.601600 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:05:08.601600 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:05:08.601600 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:05:08.601600 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:05:08.601600 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:05:08.601600 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:05:08.601600 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:05:08.601600 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:05:08.601600 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:05:08.601600 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:05:08.601600 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:05:08.601600 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:05:08.603620 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:05:08.603620 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:05:08.603620 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:05:08.603620 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:05:08.603620 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 518/1035] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:05:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:05:08.607508 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1989c861-63ac-48b3-acea-a211b3f53eb4 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:08.672397 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aa9bd0-cac4-4ef0-ac06-f8d650cd13d1 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:08.705155 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1989c861-63ac-48b3-acea-a211b3f53eb4 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:08.705528 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b70a6bc-78b1-4f5d-9395-2bccd4ed9443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:08.706139 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b70a6bc-78b1-4f5d-9395-2bccd4ed9443 None admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:08.706420 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b70a6bc-78b1-4f5d-9395-2bccd4ed9443 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:08.706693 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b70a6bc-78b1-4f5d-9395-2bccd4ed9443 None admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:08.707400 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b70a6bc-78b1-4f5d-9395-2bccd4ed9443 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:08.708854 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b70a6bc-78b1-4f5d-9395-2bccd4ed9443 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:08.729001 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 518/1036] 10.222.0.65 () {60 vars in 1132 bytes} [Tue May 17 18:05:08 2022] POST /identity/v3/users => generated 285 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:05:08.750318 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c8d3d2-4055-4542-abb4-36ee6dbfd111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:08.751093 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8d3d2-4055-4542-abb4-36ee6dbfd111 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:08.751444 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8d3d2-4055-4542-abb4-36ee6dbfd111 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:08.751788 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8d3d2-4055-4542-abb4-36ee6dbfd111 None admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:08.752594 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c8d3d2-4055-4542-abb4-36ee6dbfd111 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:05:08.752968 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c8d3d2-4055-4542-abb4-36ee6dbfd111 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:08.754520 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c8d3d2-4055-4542-abb4-36ee6dbfd111 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:08.772813 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 519/1037] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:05:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:05:08.774260 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b70a6bc-78b1-4f5d-9395-2bccd4ed9443 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:08.884287 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b70a6bc-78b1-4f5d-9395-2bccd4ed9443 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:08.918848 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99551e10-094b-48dd-a244-1b9c8c9c0f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:08.919673 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99551e10-094b-48dd-a244-1b9c8c9c0f58 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:08.919924 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99551e10-094b-48dd-a244-1b9c8c9c0f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:08.920196 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99551e10-094b-48dd-a244-1b9c8c9c0f58 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:08.928091 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99551e10-094b-48dd-a244-1b9c8c9c0f58 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:08.929515 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99551e10-094b-48dd-a244-1b9c8c9c0f58 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:08.944407 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-99551e10-094b-48dd-a244-1b9c8c9c0f58 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 17 18:05:08.944407 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:05:08.944407 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:05:08.944407 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:05:08.944407 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:05:08.944407 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:05:08.944407 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:05:08.944407 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:05:08.944407 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:05:08.944407 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:05:08.944407 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:05:08.944407 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:05:08.944407 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 18:05:08.944407 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 18:05:08.944407 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 18:05:08.944407 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 18:05:08.945436 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:05:08.945436 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:05:08.945436 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 18:05:08.945436 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:05:08.945436 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 18:05:08.945436 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:05:08.945436 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:05:08.945436 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:05:08.945436 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:05:08.945436 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:05:08.945436 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:05:08.945436 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:05:08.945436 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:05:08.945436 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:05:08.945436 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:05:08.945436 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:05:08.945436 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:05:08.945436 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:05:08.946454 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:05:08.946454 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:05:08.946454 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 18:05:08.946454 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 18:05:08.946454 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 18:05:08.946454 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 18:05:08.946454 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 18:05:08.946454 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 18:05:08.946454 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 17 18:05:08.946454 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:05:08.946454 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 519/1038] 10.222.0.65 () {56 vars in 1093 bytes} [Tue May 17 18:05:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:05:08.952080 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c8d3d2-4055-4542-abb4-36ee6dbfd111 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:09.052348 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c8d3d2-4055-4542-abb4-36ee6dbfd111 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:09.084568 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f49b92-cf94-478b-80de-e14f9b2ea9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:09.085219 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f49b92-cf94-478b-80de-e14f9b2ea9fa None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:09.085521 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f49b92-cf94-478b-80de-e14f9b2ea9fa None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:09.085789 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f49b92-cf94-478b-80de-e14f9b2ea9fa None admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:09.086609 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f49b92-cf94-478b-80de-e14f9b2ea9fa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:05:09.086908 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f49b92-cf94-478b-80de-e14f9b2ea9fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:09.088309 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f49b92-cf94-478b-80de-e14f9b2ea9fa None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:09.109279 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 520/1039] 10.222.0.65 () {56 vars in 1133 bytes} [Tue May 17 18:05:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:05:09.110976 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99551e10-094b-48dd-a244-1b9c8c9c0f58 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:09.208689 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99551e10-094b-48dd-a244-1b9c8c9c0f58 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:09.240277 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c887fe-d93c-434d-a3fe-d8b605d3f9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:09.240916 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c887fe-d93c-434d-a3fe-d8b605d3f9f2 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:09.241193 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c887fe-d93c-434d-a3fe-d8b605d3f9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:09.241483 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c887fe-d93c-434d-a3fe-d8b605d3f9f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:09.308349 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c887fe-d93c-434d-a3fe-d8b605d3f9f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:09.310398 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c887fe-d93c-434d-a3fe-d8b605d3f9f2 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:09.402344 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 520/1040] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 17 18:05:09 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 18:05:09.407971 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f49b92-cf94-478b-80de-e14f9b2ea9fa None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:09.504614 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f49b92-cf94-478b-80de-e14f9b2ea9fa None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:09.536180 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d00974-603c-4cb6-9be7-968fd90626ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:09.536959 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d00974-603c-4cb6-9be7-968fd90626ed None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:09.537230 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d00974-603c-4cb6-9be7-968fd90626ed None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:09.537541 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d00974-603c-4cb6-9be7-968fd90626ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:09.548478 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d00974-603c-4cb6-9be7-968fd90626ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:09.550014 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d00974-603c-4cb6-9be7-968fd90626ed None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:09.569936 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-27d00974-603c-4cb6-9be7-968fd90626ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:05:09.569936 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:05:09.569936 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:05:09.569936 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:05:09.569936 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:05:09.569936 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:05:09.569936 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:05:09.569936 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:05:09.569936 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:05:09.569936 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:05:09.569936 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:05:09.569936 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:05:09.569936 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:05:09.569936 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:05:09.569936 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:05:09.570973 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:05:09.570973 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:05:09.570973 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:05:09.570973 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:05:09.570973 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:05:09.570973 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:05:09.570973 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:05:09.570973 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:05:09.570973 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:05:09.570973 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:05:09.570973 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:05:09.570973 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:05:09.570973 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:05:09.570973 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:05:09.570973 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:05:09.570973 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:05:09.570973 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:05:09.576386 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:05:09.576386 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:05:09.576386 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:05:09.576386 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:05:09.576386 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 521/1041] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:05:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:05:09.578140 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c887fe-d93c-434d-a3fe-d8b605d3f9f2 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:09.674400 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c887fe-d93c-434d-a3fe-d8b605d3f9f2 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:09.706307 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d57f1-d81a-495e-a2d1-fccc8af30445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:09.706957 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d57f1-d81a-495e-a2d1-fccc8af30445 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:09.707232 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d57f1-d81a-495e-a2d1-fccc8af30445 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:09.707499 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d57f1-d81a-495e-a2d1-fccc8af30445 None admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:09.708204 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d57f1-d81a-495e-a2d1-fccc8af30445 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:05:09.708501 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d57f1-d81a-495e-a2d1-fccc8af30445 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:09.709880 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d57f1-d81a-495e-a2d1-fccc8af30445 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:09.721161 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 521/1042] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:05:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:05:09.726459 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d00974-603c-4cb6-9be7-968fd90626ed None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:09.819126 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d00974-603c-4cb6-9be7-968fd90626ed None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:09.851922 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98674af5-1f12-48f2-816c-856077f50ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:09.852967 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98674af5-1f12-48f2-816c-856077f50ab5 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:09.853442 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98674af5-1f12-48f2-816c-856077f50ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:09.853918 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98674af5-1f12-48f2-816c-856077f50ab5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:09.861054 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98674af5-1f12-48f2-816c-856077f50ab5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:09.862703 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98674af5-1f12-48f2-816c-856077f50ab5 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:09.875995 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-98674af5-1f12-48f2-816c-856077f50ab5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:05:09.875995 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:05:09.875995 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:05:09.875995 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:05:09.875995 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:05:09.875995 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:05:09.875995 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:05:09.875995 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:05:09.875995 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:05:09.875995 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:05:09.875995 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:05:09.875995 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:05:09.875995 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 18:05:09.875995 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 18:05:09.875995 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 18:05:09.876876 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 18:05:09.876876 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:05:09.876876 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:05:09.876876 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:05:09.876876 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:05:09.876876 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:05:09.876876 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:05:09.876876 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:05:09.876876 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:05:09.876876 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:05:09.876876 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:05:09.876876 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:05:09.876876 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:05:09.876876 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:05:09.876876 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:05:09.876876 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:05:09.876876 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:05:09.877805 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 18:05:09.877805 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 18:05:09.877805 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 18:05:09.877805 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 18:05:09.877805 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 18:05:09.877805 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 18:05:09.877805 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:05:09.877805 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:05:09.883257 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 522/1043] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 17 18:05:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:05:09.884418 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d57f1-d81a-495e-a2d1-fccc8af30445 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:09.983947 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d57f1-d81a-495e-a2d1-fccc8af30445 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:10.016452 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b218b77-5268-4423-8a33-c8f76ae6dcaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:10.017106 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b218b77-5268-4423-8a33-c8f76ae6dcaa None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:10.017443 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b218b77-5268-4423-8a33-c8f76ae6dcaa None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:10.017744 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b218b77-5268-4423-8a33-c8f76ae6dcaa None admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:10.018520 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b218b77-5268-4423-8a33-c8f76ae6dcaa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:05:10.018825 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b218b77-5268-4423-8a33-c8f76ae6dcaa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:10.020241 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b218b77-5268-4423-8a33-c8f76ae6dcaa None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:10.032198 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 522/1044] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 17 18:05:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:05:10.038113 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98674af5-1f12-48f2-816c-856077f50ab5 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:10.134730 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98674af5-1f12-48f2-816c-856077f50ab5 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:10.166404 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1044fea0-fd09-48ac-b44b-f11443f999e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:10.167052 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044fea0-fd09-48ac-b44b-f11443f999e5 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:10.167331 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044fea0-fd09-48ac-b44b-f11443f999e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:10.167603 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044fea0-fd09-48ac-b44b-f11443f999e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:10.168958 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1044fea0-fd09-48ac-b44b-f11443f999e5 None admin] RBAC: Adding query filter params (role.id=389e932f10c643a2aa76b3a21351e061, scope.project.id=0cf165918c1f46cb96d4b54409862659, user.id=5b430b739cb54fc7911bc89f8ea2df72) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:05:10.169265 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1044fea0-fd09-48ac-b44b-f11443f999e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:10.170719 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1044fea0-fd09-48ac-b44b-f11443f999e5 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:10.181496 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 523/1045] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 17 18:05:10 2022] GET /identity/v3/role_assignments?user.id=5b430b739cb54fc7911bc89f8ea2df72&scope.project.id=0cf165918c1f46cb96d4b54409862659&role.id=389e932f10c643a2aa76b3a21351e061 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:05:10.664001 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ecd598-543a-420c-b8f1-59bebbcf4e3d None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:10.664347 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ecd598-543a-420c-b8f1-59bebbcf4e3d None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:10.664555 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ecd598-543a-420c-b8f1-59bebbcf4e3d None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:10.665980 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 523/1046] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:05:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:05:10.671070 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eade47-8991-430d-b60f-9679d6bc0cb1 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:10.671354 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eade47-8991-430d-b60f-9679d6bc0cb1 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:10.671621 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eade47-8991-430d-b60f-9679d6bc0cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:10.688478 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-40eade47-8991-430d-b60f-9679d6bc0cb1 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:05:10.689664 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-40eade47-8991-430d-b60f-9679d6bc0cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:05:10.752521 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 524/1047] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:05:10 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:05:10.775383 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ecd598-543a-420c-b8f1-59bebbcf4e3d None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:10.882902 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ecd598-543a-420c-b8f1-59bebbcf4e3d None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:10.916474 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c046c62-a00a-4c24-87a5-4ddba05671db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:10.917635 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c046c62-a00a-4c24-87a5-4ddba05671db None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:10.918627 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c046c62-a00a-4c24-87a5-4ddba05671db None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:10.919093 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c046c62-a00a-4c24-87a5-4ddba05671db None admin] PATH_INFO: `/v3/services/image` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:10.919941 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c046c62-a00a-4c24-87a5-4ddba05671db None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:10.921511 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c046c62-a00a-4c24-87a5-4ddba05671db None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:10.933080 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-7c046c62-a00a-4c24-87a5-4ddba05671db None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 17 18:05:10.933080 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:05:10.933080 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 18:05:10.933080 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 18:05:10.933080 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 18:05:10.933080 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 18:05:10.933080 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 18:05:10.933080 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:05:10.933080 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 17 18:05:10.933080 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:05:10.933080 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 18:05:10.933080 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:05:10.933080 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:05:10.933080 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:05:10.933080 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:05:10.933080 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:05:10.933080 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:05:10.934668 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:05:10.934668 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:05:10.934668 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:05:10.934668 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:05:10.934668 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:05:10.934668 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:05:10.934668 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 18:05:10.934668 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 18:05:10.934668 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 18:05:10.934668 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 18:05:10.934668 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:05:10.934668 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:05:10.934668 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:05:10.934668 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:05:10.934668 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:05:10.934668 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:05:10.935511 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:05:10.935511 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:05:10.935511 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:05:10.935511 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:05:10.935511 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:05:10.935511 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:05:10.935511 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:05:10.935511 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:05:10.935511 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:05:10.935511 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:05:10.935511 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 18:05:10.935511 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:05:10.935511 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 17 18:05:10.935511 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:05:10.938042 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 524/1048] 10.222.0.65 () {56 vars in 1105 bytes} [Tue May 17 18:05:10 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:05:10.944660 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eade47-8991-430d-b60f-9679d6bc0cb1 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:11.035927 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b8976-caf0-4703-abfd-993ea79d3c59 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:11.036254 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b8976-caf0-4703-abfd-993ea79d3c59 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:11.036490 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b8976-caf0-4703-abfd-993ea79d3c59 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:11.038015 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 525/1049] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:05:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:05:11.042665 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade1a31-2b2e-4078-aec4-4e2c4d26b968 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:11.042953 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade1a31-2b2e-4078-aec4-4e2c4d26b968 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:11.043774 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade1a31-2b2e-4078-aec4-4e2c4d26b968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:11.044230 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eade47-8991-430d-b60f-9679d6bc0cb1 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:11.060500 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-5ade1a31-2b2e-4078-aec4-4e2c4d26b968 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:05:11.061702 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-5ade1a31-2b2e-4078-aec4-4e2c4d26b968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:05:11.077332 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c3857-caec-4b40-8f88-07d612dca418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:11.078017 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c3857-caec-4b40-8f88-07d612dca418 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:11.078293 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c3857-caec-4b40-8f88-07d612dca418 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:11.078563 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c3857-caec-4b40-8f88-07d612dca418 None admin] PATH_INFO: `/v3/services` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:11.079258 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6c3857-caec-4b40-8f88-07d612dca418 None admin] RBAC: Adding query filter params (name=image) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:05:11.079563 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6c3857-caec-4b40-8f88-07d612dca418 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:11.080915 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6c3857-caec-4b40-8f88-07d612dca418 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:11.085817 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 525/1050] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:05:10 2022] GET /identity/v3/services?name=image => generated 122 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:05:11.092331 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c3857-caec-4b40-8f88-07d612dca418 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:11.129498 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 526/1051] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:05:11 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 18:05:11.150728 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade1a31-2b2e-4078-aec4-4e2c4d26b968 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:11.192377 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c3857-caec-4b40-8f88-07d612dca418 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:11.227698 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6445207-49e1-46bc-a737-37f7ef90497c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:11.228666 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6445207-49e1-46bc-a737-37f7ef90497c None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:11.229274 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6445207-49e1-46bc-a737-37f7ef90497c None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:11.230107 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6445207-49e1-46bc-a737-37f7ef90497c None admin] PATH_INFO: `/v3/services` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:11.231852 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6445207-49e1-46bc-a737-37f7ef90497c None admin] RBAC: Adding query filter params (type=image) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:05:11.232332 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6445207-49e1-46bc-a737-37f7ef90497c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:11.234307 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6445207-49e1-46bc-a737-37f7ef90497c None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:11.240552 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 526/1052] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:05:11 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:05:11.246354 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6445207-49e1-46bc-a737-37f7ef90497c None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:11.247519 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade1a31-2b2e-4078-aec4-4e2c4d26b968 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:11.284641 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da40be-b336-4d7c-92a7-21c241d4bba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:11.285444 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da40be-b336-4d7c-92a7-21c241d4bba5 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:11.286076 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da40be-b336-4d7c-92a7-21c241d4bba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:11.286076 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da40be-b336-4d7c-92a7-21c241d4bba5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:11.297051 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81da40be-b336-4d7c-92a7-21c241d4bba5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:05:11.304622 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-81da40be-b336-4d7c-92a7-21c241d4bba5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:05:11.304622 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:05:11.304622 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:05:11.304622 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:05:11.304622 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:05:11.304622 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:05:11.304622 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:05:11.304622 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:05:11.304622 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:05:11.304622 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:05:11.304622 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:05:11.304622 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:05:11.304622 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:05:11.304622 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:05:11.304622 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:05:11.304622 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:05:11.305740 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:05:11.305740 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:05:11.305740 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:05:11.305740 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:05:11.305740 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:05:11.305740 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:05:11.305740 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:05:11.305740 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:05:11.305740 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:05:11.305740 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:05:11.305740 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:05:11.305740 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:05:11.305740 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:05:11.305740 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:05:11.305740 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:05:11.305740 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:05:11.306580 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:05:11.306580 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:05:11.306580 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:05:11.306580 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:05:11.306580 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:05:11.306580 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:05:11.306580 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:05:11.306580 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:05:11.306580 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:05:11.306580 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:05:11.306580 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:05:11.306580 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:05:11.306580 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 527/1053] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 17 18:05:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:05:11.311761 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da40be-b336-4d7c-92a7-21c241d4bba5 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:11.358348 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6445207-49e1-46bc-a737-37f7ef90497c None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:11.392472 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e42d8c-e85e-471c-8ba1-ffb8b0911801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:11.393485 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e42d8c-e85e-471c-8ba1-ffb8b0911801 None admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:11.393968 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e42d8c-e85e-471c-8ba1-ffb8b0911801 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:11.394424 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e42d8c-e85e-471c-8ba1-ffb8b0911801 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:11.395326 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e42d8c-e85e-471c-8ba1-ffb8b0911801 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:11.396841 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e42d8c-e85e-471c-8ba1-ffb8b0911801 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:11.408464 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da40be-b336-4d7c-92a7-21c241d4bba5 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:11.420018 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 527/1054] 10.222.0.65 () {60 vars in 1144 bytes} [Tue May 17 18:05:11 2022] POST /identity/v3/endpoints => generated 327 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:05:11.451333 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f68198-15dc-494a-b66d-02d8b85ce5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:11.451924 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f68198-15dc-494a-b66d-02d8b85ce5cd None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:11.452200 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f68198-15dc-494a-b66d-02d8b85ce5cd None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:11.452470 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f68198-15dc-494a-b66d-02d8b85ce5cd None admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:11.453232 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f68198-15dc-494a-b66d-02d8b85ce5cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:05:11.453573 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f68198-15dc-494a-b66d-02d8b85ce5cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:11.455053 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f68198-15dc-494a-b66d-02d8b85ce5cd None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:11.470056 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 528/1055] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 17 18:05:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:05:11.471882 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e42d8c-e85e-471c-8ba1-ffb8b0911801 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:11.579410 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e42d8c-e85e-471c-8ba1-ffb8b0911801 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:11.622499 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01924b65-8d3d-4220-8629-020c52cd10f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:11.623665 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01924b65-8d3d-4220-8629-020c52cd10f5 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:11.623991 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01924b65-8d3d-4220-8629-020c52cd10f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:11.624263 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01924b65-8d3d-4220-8629-020c52cd10f5 None admin] PATH_INFO: `/v3/users/3717543a6fd941bab90af05941379d7a` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:11.640386 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01924b65-8d3d-4220-8629-020c52cd10f5 None admin] RBAC: Authorizing `identity:get_user(user_id=3717543a6fd941bab90af05941379d7a)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:11.641865 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01924b65-8d3d-4220-8629-020c52cd10f5 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:11.643565 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 528/1056] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 17 18:05:11 2022] GET /identity/v3/users/3717543a6fd941bab90af05941379d7a => generated 285 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:05:11.649369 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f68198-15dc-494a-b66d-02d8b85ce5cd None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:11.744146 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f68198-15dc-494a-b66d-02d8b85ce5cd None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:11.775757 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c98f00-9191-4d52-8ec3-e4c45cc930af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:11.776478 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c98f00-9191-4d52-8ec3-e4c45cc930af None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:11.776666 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c98f00-9191-4d52-8ec3-e4c45cc930af None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:11.776931 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c98f00-9191-4d52-8ec3-e4c45cc930af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:11.847285 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c98f00-9191-4d52-8ec3-e4c45cc930af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:11.848740 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c98f00-9191-4d52-8ec3-e4c45cc930af None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:11.946904 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 529/1057] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 17 18:05:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 18:05:11.953977 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01924b65-8d3d-4220-8629-020c52cd10f5 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:12.050076 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01924b65-8d3d-4220-8629-020c52cd10f5 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:12.082033 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679f4a57-1951-459e-8dc2-9ab8d9a75b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:12.082874 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f4a57-1951-459e-8dc2-9ab8d9a75b4c None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:12.083150 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f4a57-1951-459e-8dc2-9ab8d9a75b4c None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:12.083425 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f4a57-1951-459e-8dc2-9ab8d9a75b4c None admin] PATH_INFO: `/v3/projects/e3bd7fa4ec594d188daee72f6489137f` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:12.084580 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679f4a57-1951-459e-8dc2-9ab8d9a75b4c None admin] RBAC: Authorizing `identity:get_project(project_id=e3bd7fa4ec594d188daee72f6489137f)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:12.086039 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679f4a57-1951-459e-8dc2-9ab8d9a75b4c None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:12.088073 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 529/1058] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 17 18:05:11 2022] GET /identity/v3/projects/e3bd7fa4ec594d188daee72f6489137f => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:05:12.094201 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c98f00-9191-4d52-8ec3-e4c45cc930af None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:12.189797 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c98f00-9191-4d52-8ec3-e4c45cc930af None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:12.224790 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d9ebe4-757f-47a3-891b-c9cef6e8d83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:12.225500 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9ebe4-757f-47a3-891b-c9cef6e8d83e None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:12.225766 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9ebe4-757f-47a3-891b-c9cef6e8d83e None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:12.226036 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9ebe4-757f-47a3-891b-c9cef6e8d83e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:12.226884 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d9ebe4-757f-47a3-891b-c9cef6e8d83e None admin] RBAC: Adding query filter params (role.id=332c8d70fd0f41e2beea20aaead5daa5, scope.project.id=e3bd7fa4ec594d188daee72f6489137f, user.id=3717543a6fd941bab90af05941379d7a) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:05:12.227191 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d9ebe4-757f-47a3-891b-c9cef6e8d83e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:12.228658 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d9ebe4-757f-47a3-891b-c9cef6e8d83e None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:12.241497 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 530/1059] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 17 18:05:12 2022] GET /identity/v3/role_assignments?user.id=3717543a6fd941bab90af05941379d7a&scope.project.id=e3bd7fa4ec594d188daee72f6489137f&role.id=332c8d70fd0f41e2beea20aaead5daa5 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:05:12.408171 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6927336-1a46-4235-ba98-1a124c3aa047 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:12.408542 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6927336-1a46-4235-ba98-1a124c3aa047 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:12.408737 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6927336-1a46-4235-ba98-1a124c3aa047 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:12.410364 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 530/1060] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:05:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:05:12.416037 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214257ae-d16f-46ed-8397-0c57c47db8dc None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:12.416327 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214257ae-d16f-46ed-8397-0c57c47db8dc None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:12.416662 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214257ae-d16f-46ed-8397-0c57c47db8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:12.434412 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-214257ae-d16f-46ed-8397-0c57c47db8dc None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:05:12.435578 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-214257ae-d16f-46ed-8397-0c57c47db8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:05:12.501509 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 531/1061] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:05:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:05:12.522126 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6927336-1a46-4235-ba98-1a124c3aa047 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:12.623056 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6927336-1a46-4235-ba98-1a124c3aa047 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:12.655811 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19f3b50-5ad8-4e2b-9de5-9693e75eafb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:12.656609 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f3b50-5ad8-4e2b-9de5-9693e75eafb3 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:12.656889 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f3b50-5ad8-4e2b-9de5-9693e75eafb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:12.657162 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f3b50-5ad8-4e2b-9de5-9693e75eafb3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:12.667164 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19f3b50-5ad8-4e2b-9de5-9693e75eafb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:05:12.675313 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-d19f3b50-5ad8-4e2b-9de5-9693e75eafb3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 18:05:12.675313 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:05:12.675313 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:05:12.675313 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:05:12.675313 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:05:12.675313 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:05:12.675313 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:05:12.675313 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:05:12.675313 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:05:12.675313 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:05:12.675313 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:05:12.675313 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:05:12.675313 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:05:12.675313 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:05:12.675313 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:05:12.675313 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:05:12.676246 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:05:12.676246 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:05:12.676246 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:05:12.676246 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:05:12.676246 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:05:12.676246 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:05:12.676246 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:05:12.676246 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:05:12.676246 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:05:12.676246 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:05:12.676246 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:05:12.676246 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:05:12.676246 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:05:12.676246 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:05:12.676246 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:05:12.676246 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:05:12.677091 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:05:12.677091 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:05:12.677091 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:05:12.677091 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:05:12.677091 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:05:12.677091 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:05:12.677091 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:05:12.677091 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:05:12.677091 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:05:12.677091 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:05:12.677091 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 18:05:12.677091 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:05:12.681399 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 531/1062] 10.222.0.65 () {56 vars in 1120 bytes} [Tue May 17 18:05:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:05:12.682588 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214257ae-d16f-46ed-8397-0c57c47db8dc None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:12.779244 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214257ae-d16f-46ed-8397-0c57c47db8dc None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:12.811480 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02919abc-215e-4adb-8cbe-a53f7c40929b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:12.812139 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02919abc-215e-4adb-8cbe-a53f7c40929b None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:12.812420 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02919abc-215e-4adb-8cbe-a53f7c40929b None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:12.812696 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02919abc-215e-4adb-8cbe-a53f7c40929b None admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:12.813499 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02919abc-215e-4adb-8cbe-a53f7c40929b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:05:12.813813 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02919abc-215e-4adb-8cbe-a53f7c40929b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:12.815208 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02919abc-215e-4adb-8cbe-a53f7c40929b None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:12.832935 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 532/1063] 10.222.0.65 () {56 vars in 1115 bytes} [Tue May 17 18:05:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:05:12.835910 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19f3b50-5ad8-4e2b-9de5-9693e75eafb3 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:12.933190 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19f3b50-5ad8-4e2b-9de5-9693e75eafb3 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:12.966336 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42010e6-4132-41d1-bd00-64beb4246f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:12.967114 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42010e6-4132-41d1-bd00-64beb4246f6d None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:12.967399 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42010e6-4132-41d1-bd00-64beb4246f6d None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:12.967669 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42010e6-4132-41d1-bd00-64beb4246f6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:12.978101 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42010e6-4132-41d1-bd00-64beb4246f6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:12.979533 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42010e6-4132-41d1-bd00-64beb4246f6d None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:12.996683 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-f42010e6-4132-41d1-bd00-64beb4246f6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:05:12.996683 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:05:12.996683 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:05:12.996683 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:05:12.996683 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:05:12.996683 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:05:12.996683 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:05:12.996683 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:05:12.996683 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:05:12.996683 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:05:12.996683 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:05:12.996683 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:05:12.996683 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:05:12.996683 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:05:12.996683 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:05:12.997853 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:05:12.997853 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:05:12.997853 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:05:12.997853 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:05:12.997853 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:05:12.997853 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:05:12.997853 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:05:12.997853 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:05:12.997853 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:05:12.997853 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:05:12.997853 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:05:12.997853 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:05:12.997853 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:05:12.997853 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:05:12.997853 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:05:12.997853 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:05:12.997853 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:05:12.998780 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:05:12.998780 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:05:12.998780 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:05:12.998780 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:05:12.999408 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 532/1064] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:05:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:05:13.003736 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02919abc-215e-4adb-8cbe-a53f7c40929b None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:13.099664 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02919abc-215e-4adb-8cbe-a53f7c40929b None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:13.131631 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf05e61-b9da-4408-b738-e47ee5dfb6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:13.132292 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf05e61-b9da-4408-b738-e47ee5dfb6bc None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:13.132568 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf05e61-b9da-4408-b738-e47ee5dfb6bc None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:13.133069 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf05e61-b9da-4408-b738-e47ee5dfb6bc None admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:13.134268 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf05e61-b9da-4408-b738-e47ee5dfb6bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:05:13.134573 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf05e61-b9da-4408-b738-e47ee5dfb6bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:13.135945 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf05e61-b9da-4408-b738-e47ee5dfb6bc None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:13.148238 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 533/1065] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:05:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:05:13.153639 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42010e6-4132-41d1-bd00-64beb4246f6d None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:13.250125 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42010e6-4132-41d1-bd00-64beb4246f6d None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:13.282046 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a361b8-d2c5-44c1-b0a1-331b80b3ae78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:13.282835 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a361b8-d2c5-44c1-b0a1-331b80b3ae78 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:13.283110 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a361b8-d2c5-44c1-b0a1-331b80b3ae78 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:13.283376 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a361b8-d2c5-44c1-b0a1-331b80b3ae78 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:13.290727 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a361b8-d2c5-44c1-b0a1-331b80b3ae78 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:13.292169 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a361b8-d2c5-44c1-b0a1-331b80b3ae78 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:13.306123 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-50a361b8-d2c5-44c1-b0a1-331b80b3ae78 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 17 18:05:13.306123 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:05:13.306123 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:05:13.306123 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:05:13.306123 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:05:13.306123 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:05:13.306123 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:05:13.306123 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:05:13.306123 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:05:13.306123 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:05:13.306123 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:05:13.306123 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:05:13.306123 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 18:05:13.306123 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 18:05:13.306123 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 18:05:13.306123 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 18:05:13.307123 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:05:13.307123 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:05:13.307123 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 18:05:13.307123 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:05:13.307123 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 18:05:13.307123 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:05:13.307123 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:05:13.307123 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:05:13.307123 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:05:13.307123 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:05:13.307123 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:05:13.307123 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:05:13.307123 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:05:13.307123 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:05:13.307123 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:05:13.307123 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:05:13.307123 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:05:13.307123 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:05:13.308135 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:05:13.308135 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:05:13.308135 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 18:05:13.308135 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 18:05:13.308135 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 18:05:13.308135 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 18:05:13.308135 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 18:05:13.308135 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 18:05:13.308135 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 17 18:05:13.308135 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:05:13.309420 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 533/1066] 10.222.0.65 () {56 vars in 1093 bytes} [Tue May 17 18:05:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:05:13.313231 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf05e61-b9da-4408-b738-e47ee5dfb6bc None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:13.410695 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf05e61-b9da-4408-b738-e47ee5dfb6bc None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:13.444872 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df854b20-f647-45c5-b5f5-11c9e7bdfba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:13.445562 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df854b20-f647-45c5-b5f5-11c9e7bdfba2 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:13.445843 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df854b20-f647-45c5-b5f5-11c9e7bdfba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:13.446113 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df854b20-f647-45c5-b5f5-11c9e7bdfba2 None admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:13.446952 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df854b20-f647-45c5-b5f5-11c9e7bdfba2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:05:13.447260 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df854b20-f647-45c5-b5f5-11c9e7bdfba2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:13.448679 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df854b20-f647-45c5-b5f5-11c9e7bdfba2 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:13.470465 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 534/1067] 10.222.0.65 () {56 vars in 1133 bytes} [Tue May 17 18:05:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:05:13.472245 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a361b8-d2c5-44c1-b0a1-331b80b3ae78 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:13.571342 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a361b8-d2c5-44c1-b0a1-331b80b3ae78 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:13.602853 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b36cab-6c64-4690-acbf-02309c58ecdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:13.603631 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b36cab-6c64-4690-acbf-02309c58ecdf None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:13.603906 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b36cab-6c64-4690-acbf-02309c58ecdf None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:13.604180 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b36cab-6c64-4690-acbf-02309c58ecdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:13.614595 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b36cab-6c64-4690-acbf-02309c58ecdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:13.616093 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b36cab-6c64-4690-acbf-02309c58ecdf None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:13.633106 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-c4b36cab-6c64-4690-acbf-02309c58ecdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:05:13.633106 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:05:13.633106 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:05:13.633106 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:05:13.633106 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:05:13.633106 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:05:13.633106 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:05:13.633106 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:05:13.633106 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:05:13.633106 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:05:13.633106 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:05:13.633106 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:05:13.633106 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:05:13.633106 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:05:13.633106 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:05:13.634188 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:05:13.634188 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:05:13.634188 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:05:13.634188 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:05:13.634188 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:05:13.634188 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:05:13.634188 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:05:13.634188 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:05:13.634188 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:05:13.634188 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:05:13.634188 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:05:13.634188 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:05:13.634188 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:05:13.634188 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:05:13.634188 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:05:13.634188 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:05:13.634188 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:05:13.640194 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:05:13.640194 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:05:13.640194 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:05:13.640194 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:05:13.640194 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 534/1068] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:05:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:05:13.641982 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df854b20-f647-45c5-b5f5-11c9e7bdfba2 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:13.664520 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c636c-7157-44e8-8281-523a95d54b14 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:13.664809 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c636c-7157-44e8-8281-523a95d54b14 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:13.665065 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c636c-7157-44e8-8281-523a95d54b14 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:13.666572 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 535/1069] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:05:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 18:05:13.671194 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702fd641-081c-4734-adc2-bbec3e5fff6f None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:13.671474 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702fd641-081c-4734-adc2-bbec3e5fff6f None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:13.671747 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702fd641-081c-4734-adc2-bbec3e5fff6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:13.688366 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-702fd641-081c-4734-adc2-bbec3e5fff6f None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:05:13.689555 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-702fd641-081c-4734-adc2-bbec3e5fff6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:05:13.739502 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df854b20-f647-45c5-b5f5-11c9e7bdfba2 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:13.753110 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 536/1070] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:05:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 18:05:13.772946 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131bd65-337e-49a5-bb9b-d4b25efd5060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:13.773894 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131bd65-337e-49a5-bb9b-d4b25efd5060 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:13.774683 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131bd65-337e-49a5-bb9b-d4b25efd5060 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:13.775109 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131bd65-337e-49a5-bb9b-d4b25efd5060 None admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:13.775550 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702fd641-081c-4734-adc2-bbec3e5fff6f None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:13.776154 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a131bd65-337e-49a5-bb9b-d4b25efd5060 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:05:13.776603 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a131bd65-337e-49a5-bb9b-d4b25efd5060 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:13.779219 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a131bd65-337e-49a5-bb9b-d4b25efd5060 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:13.797822 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 535/1071] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:05:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:05:13.800148 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131bd65-337e-49a5-bb9b-d4b25efd5060 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:13.877867 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702fd641-081c-4734-adc2-bbec3e5fff6f None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:13.911235 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d89868-f163-4b8a-8154-f78047c7e4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:13.911879 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d89868-f163-4b8a-8154-f78047c7e4b8 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:13.912153 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d89868-f163-4b8a-8154-f78047c7e4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:13.912422 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d89868-f163-4b8a-8154-f78047c7e4b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:13.913334 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131bd65-337e-49a5-bb9b-d4b25efd5060 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:13.948433 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f38e39e-419f-4247-aea9-d2a34c3d8d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:13.949776 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f38e39e-419f-4247-aea9-d2a34c3d8d60 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:13.950085 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f38e39e-419f-4247-aea9-d2a34c3d8d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:13.950384 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f38e39e-419f-4247-aea9-d2a34c3d8d60 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:13.958629 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f38e39e-419f-4247-aea9-d2a34c3d8d60 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:13.960092 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f38e39e-419f-4247-aea9-d2a34c3d8d60 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:13.975516 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-1f38e39e-419f-4247-aea9-d2a34c3d8d60 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:05:13.975516 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:05:13.975516 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:05:13.975516 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:05:13.975516 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:05:13.975516 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:05:13.975516 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:05:13.975516 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:05:13.975516 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:05:13.975516 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:05:13.975516 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:05:13.975516 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:05:13.975516 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 18:05:13.975516 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 18:05:13.975516 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 18:05:13.976619 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 18:05:13.976619 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:05:13.976619 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:05:13.976619 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:05:13.976619 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:05:13.976619 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:05:13.976619 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:05:13.976619 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:05:13.976619 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:05:13.976619 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:05:13.976619 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:05:13.976619 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:05:13.976619 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:05:13.976619 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:05:13.976619 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:05:13.976619 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:05:13.976619 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:05:13.977851 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 18:05:13.977851 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 18:05:13.977851 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 18:05:13.977851 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 18:05:13.977851 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 18:05:13.977851 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 18:05:13.977851 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:05:13.977851 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:05:13.981773 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 536/1072] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 17 18:05:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:05:13.982638 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f38e39e-419f-4247-aea9-d2a34c3d8d60 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:13.991855 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d89868-f163-4b8a-8154-f78047c7e4b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:13.993819 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d89868-f163-4b8a-8154-f78047c7e4b8 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:14.090809 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f38e39e-419f-4247-aea9-d2a34c3d8d60 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:14.100920 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 537/1073] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 17 18:05:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 17 18:05:14.106438 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d89868-f163-4b8a-8154-f78047c7e4b8 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:14.131908 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b75f4e-60db-49e0-9517-cb132521f1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:14.132737 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b75f4e-60db-49e0-9517-cb132521f1b3 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:14.133072 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b75f4e-60db-49e0-9517-cb132521f1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:14.133412 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b75f4e-60db-49e0-9517-cb132521f1b3 None admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:14.134656 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b75f4e-60db-49e0-9517-cb132521f1b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:05:14.134963 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b75f4e-60db-49e0-9517-cb132521f1b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:14.136393 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b75f4e-60db-49e0-9517-cb132521f1b3 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:14.148663 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 537/1074] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 17 18:05:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:05:14.154926 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b75f4e-60db-49e0-9517-cb132521f1b3 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:14.220355 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d89868-f163-4b8a-8154-f78047c7e4b8 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:14.268194 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b75f4e-60db-49e0-9517-cb132521f1b3 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:14.270559 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c8c218-b107-48b0-9b70-3e8424bef817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:14.271602 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8c218-b107-48b0-9b70-3e8424bef817 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:14.272107 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8c218-b107-48b0-9b70-3e8424bef817 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:14.272583 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8c218-b107-48b0-9b70-3e8424bef817 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:14.285179 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c8c218-b107-48b0-9b70-3e8424bef817 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:14.287672 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c8c218-b107-48b0-9b70-3e8424bef817 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:14.308545 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-31c8c218-b107-48b0-9b70-3e8424bef817 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:05:14.308545 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:05:14.308545 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:05:14.308545 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:05:14.308545 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:05:14.308545 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:05:14.308545 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:05:14.308545 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:05:14.308545 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:05:14.308545 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:05:14.308545 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:05:14.308545 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:05:14.308545 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:05:14.308545 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:05:14.308545 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:05:14.310115 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:05:14.310115 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:05:14.310115 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:05:14.310115 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:05:14.310115 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:05:14.310115 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:05:14.310115 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:05:14.310115 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:05:14.310115 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:05:14.310115 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:05:14.310115 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:05:14.310115 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:05:14.310115 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:05:14.310115 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:05:14.310115 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:05:14.310115 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:05:14.310115 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:05:14.311005 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:05:14.311005 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:05:14.311005 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:05:14.311005 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:05:14.311234 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f7bd1e-ffe0-4f20-a844-6fd7b6c50e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:14.311234 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7bd1e-ffe0-4f20-a844-6fd7b6c50e25 None admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:14.311234 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7bd1e-ffe0-4f20-a844-6fd7b6c50e25 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:14.311444 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 538/1075] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:05:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:05:14.311525 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f7bd1e-ffe0-4f20-a844-6fd7b6c50e25 None admin] PATH_INFO: `/v3/projects/0cf165918c1f46cb96d4b54409862659/users/5b430b739cb54fc7911bc89f8ea2df72/roles/389e932f10c643a2aa76b3a21351e061` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:14.314279 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f7bd1e-ffe0-4f20-a844-6fd7b6c50e25 None admin] RBAC: Authorizing `identity:create_grant(project_id=0cf165918c1f46cb96d4b54409862659, user_id=5b430b739cb54fc7911bc89f8ea2df72, role_id=389e932f10c643a2aa76b3a21351e061)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:14.317083 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c8c218-b107-48b0-9b70-3e8424bef817 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:14.318110 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f7bd1e-ffe0-4f20-a844-6fd7b6c50e25 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:14.334401 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 538/1076] 10.222.0.65 () {58 vars in 1439 bytes} [Tue May 17 18:05:14 2022] PUT /identity/v3/projects/0cf165918c1f46cb96d4b54409862659/users/5b430b739cb54fc7911bc89f8ea2df72/roles/389e932f10c643a2aa76b3a21351e061 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:05:14.446306 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c8c218-b107-48b0-9b70-3e8424bef817 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:14.455690 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6721652c-91eb-4ed9-9a61-a5980fc3043e None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:14.456031 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6721652c-91eb-4ed9-9a61-a5980fc3043e None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:14.456252 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6721652c-91eb-4ed9-9a61-a5980fc3043e None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:14.457886 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 539/1077] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:05:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 18:05:14.463454 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc636d-1acf-40da-8710-6a8cd086329b None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:14.463799 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc636d-1acf-40da-8710-6a8cd086329b None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:14.464014 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc636d-1acf-40da-8710-6a8cd086329b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:14.481443 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-74dc636d-1acf-40da-8710-6a8cd086329b None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:05:14.482825 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-74dc636d-1acf-40da-8710-6a8cd086329b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:05:14.482933 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231de872-41f4-496f-b4b8-531d249c1b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:14.483500 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231de872-41f4-496f-b4b8-531d249c1b7a None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:14.483779 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231de872-41f4-496f-b4b8-531d249c1b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:14.484051 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231de872-41f4-496f-b4b8-531d249c1b7a None admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:14.484782 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231de872-41f4-496f-b4b8-531d249c1b7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:05:14.485087 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231de872-41f4-496f-b4b8-531d249c1b7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:14.486594 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231de872-41f4-496f-b4b8-531d249c1b7a None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:14.499239 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 539/1078] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:05:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:05:14.571970 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 540/1079] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:05:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 18:05:14.595889 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231de872-41f4-496f-b4b8-531d249c1b7a None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:14.697328 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231de872-41f4-496f-b4b8-531d249c1b7a None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:14.732945 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe9759-767d-467f-bfde-c87d87871cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:14.733819 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe9759-767d-467f-bfde-c87d87871cf1 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:14.734105 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe9759-767d-467f-bfde-c87d87871cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:14.734382 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe9759-767d-467f-bfde-c87d87871cf1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:14.744632 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fe9759-767d-467f-bfde-c87d87871cf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:05:14.752407 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-f6fe9759-767d-467f-bfde-c87d87871cf1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:05:14.752407 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:05:14.752407 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:05:14.752407 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:05:14.752407 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:05:14.752407 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:05:14.752407 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:05:14.752407 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:05:14.752407 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:05:14.752407 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:05:14.752407 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:05:14.752407 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:05:14.752407 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:05:14.752407 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:05:14.752407 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:05:14.752407 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:05:14.753569 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:05:14.753569 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:05:14.753569 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:05:14.753569 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:05:14.753569 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:05:14.753569 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:05:14.753569 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:05:14.753569 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:05:14.753569 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:05:14.753569 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:05:14.753569 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:05:14.753569 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:05:14.753569 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:05:14.753569 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:05:14.753569 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:05:14.753569 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:05:14.754550 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:05:14.754550 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:05:14.754550 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:05:14.754550 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:05:14.754550 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:05:14.754550 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:05:14.754550 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:05:14.754550 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:05:14.754550 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:05:14.754550 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:05:14.754550 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:05:14.754550 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:05:14.754550 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 540/1080] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 17 18:05:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:05:14.759615 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc636d-1acf-40da-8710-6a8cd086329b None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:14.861290 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc636d-1acf-40da-8710-6a8cd086329b None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:14.894028 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c23a0c9-eabc-4c5f-91f7-75a3c5e666f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:14.894684 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23a0c9-eabc-4c5f-91f7-75a3c5e666f7 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:14.894960 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23a0c9-eabc-4c5f-91f7-75a3c5e666f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:14.895231 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23a0c9-eabc-4c5f-91f7-75a3c5e666f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:14.895965 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c23a0c9-eabc-4c5f-91f7-75a3c5e666f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:05:14.896266 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c23a0c9-eabc-4c5f-91f7-75a3c5e666f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:14.897655 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c23a0c9-eabc-4c5f-91f7-75a3c5e666f7 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:14.905383 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 541/1081] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 17 18:05:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:05:14.912354 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe9759-767d-467f-bfde-c87d87871cf1 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:15.007655 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe9759-767d-467f-bfde-c87d87871cf1 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:15.039723 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c767db90-3bb5-42dc-b30f-ac11685d8eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:15.040578 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767db90-3bb5-42dc-b30f-ac11685d8eb0 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:15.040858 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767db90-3bb5-42dc-b30f-ac11685d8eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:15.041133 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767db90-3bb5-42dc-b30f-ac11685d8eb0 None admin] PATH_INFO: `/v3/users/3717543a6fd941bab90af05941379d7a` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:15.042344 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c767db90-3bb5-42dc-b30f-ac11685d8eb0 None admin] RBAC: Authorizing `identity:get_user(user_id=3717543a6fd941bab90af05941379d7a)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:15.044372 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c767db90-3bb5-42dc-b30f-ac11685d8eb0 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:15.046039 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 541/1082] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 17 18:05:14 2022] GET /identity/v3/users/3717543a6fd941bab90af05941379d7a => generated 285 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:05:15.051556 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c23a0c9-eabc-4c5f-91f7-75a3c5e666f7 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:15.146739 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c23a0c9-eabc-4c5f-91f7-75a3c5e666f7 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:15.179636 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6012bf89-7ad7-41c5-b30e-17bc34423ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:15.180481 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6012bf89-7ad7-41c5-b30e-17bc34423ad6 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:15.180761 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6012bf89-7ad7-41c5-b30e-17bc34423ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:15.181033 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6012bf89-7ad7-41c5-b30e-17bc34423ad6 None admin] PATH_INFO: `/v3/projects/e3bd7fa4ec594d188daee72f6489137f` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:15.182229 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6012bf89-7ad7-41c5-b30e-17bc34423ad6 None admin] RBAC: Authorizing `identity:get_project(project_id=e3bd7fa4ec594d188daee72f6489137f)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:15.183711 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6012bf89-7ad7-41c5-b30e-17bc34423ad6 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:15.185589 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 542/1083] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 17 18:05:15 2022] GET /identity/v3/projects/e3bd7fa4ec594d188daee72f6489137f => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:05:15.191225 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c767db90-3bb5-42dc-b30f-ac11685d8eb0 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:15.287804 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c767db90-3bb5-42dc-b30f-ac11685d8eb0 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:15.318744 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f3292-d5d6-4881-886d-0e3ed25c49b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:15.319609 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f3292-d5d6-4881-886d-0e3ed25c49b4 None admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:15.319884 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f3292-d5d6-4881-886d-0e3ed25c49b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:15.320156 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f3292-d5d6-4881-886d-0e3ed25c49b4 None admin] PATH_INFO: `/v3/projects/e3bd7fa4ec594d188daee72f6489137f/users/3717543a6fd941bab90af05941379d7a/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:15.322104 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9f3292-d5d6-4881-886d-0e3ed25c49b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=e3bd7fa4ec594d188daee72f6489137f, user_id=3717543a6fd941bab90af05941379d7a, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:15.323518 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9f3292-d5d6-4881-886d-0e3ed25c49b4 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:15.336198 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 542/1084] 10.222.0.65 () {58 vars in 1439 bytes} [Tue May 17 18:05:15 2022] PUT /identity/v3/projects/e3bd7fa4ec594d188daee72f6489137f/users/3717543a6fd941bab90af05941379d7a/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:05:16.596055 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4889be-3ebf-4322-9b88-8ce2eb4c8a1f None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:16.596583 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4889be-3ebf-4322-9b88-8ce2eb4c8a1f None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:16.596583 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4889be-3ebf-4322-9b88-8ce2eb4c8a1f None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:16.598119 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 543/1085] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:05:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:05:16.603202 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95647c-a4da-4ebb-972a-7b84d6ffa50e None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:16.603588 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95647c-a4da-4ebb-972a-7b84d6ffa50e None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:16.603855 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf95647c-a4da-4ebb-972a-7b84d6ffa50e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:16.620747 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-cf95647c-a4da-4ebb-972a-7b84d6ffa50e None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:05:16.621951 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-cf95647c-a4da-4ebb-972a-7b84d6ffa50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:05:16.683799 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 543/1086] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:05:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:05:16.707280 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4889be-3ebf-4322-9b88-8ce2eb4c8a1f None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:16.801179 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4889be-3ebf-4322-9b88-8ce2eb4c8a1f None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:16.832748 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea4696-d5f2-4609-85c6-113801392cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:16.833576 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea4696-d5f2-4609-85c6-113801392cfd None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:16.833859 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea4696-d5f2-4609-85c6-113801392cfd None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:16.834558 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea4696-d5f2-4609-85c6-113801392cfd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:16.844389 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faea4696-d5f2-4609-85c6-113801392cfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:05:16.852523 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-faea4696-d5f2-4609-85c6-113801392cfd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 18:05:16.852523 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:05:16.852523 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:05:16.852523 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:05:16.852523 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:05:16.852523 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:05:16.852523 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:05:16.852523 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:05:16.852523 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:05:16.852523 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:05:16.852523 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:05:16.852523 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:05:16.852523 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:05:16.852523 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:05:16.852523 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:05:16.852523 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:05:16.853637 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:05:16.853637 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:05:16.853637 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:05:16.853637 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:05:16.853637 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:05:16.853637 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:05:16.853637 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:05:16.853637 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:05:16.853637 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:05:16.853637 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:05:16.853637 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:05:16.853637 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:05:16.853637 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:05:16.853637 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:05:16.853637 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:05:16.853637 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:05:16.854512 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:05:16.854512 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:05:16.854512 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:05:16.854512 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:05:16.854512 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:05:16.854512 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:05:16.854512 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:05:16.854512 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:05:16.854512 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:05:16.854512 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:05:16.854512 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 18:05:16.854512 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:05:16.854512 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 544/1087] 10.222.0.65 () {56 vars in 1120 bytes} [Tue May 17 18:05:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:05:16.861068 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf95647c-a4da-4ebb-972a-7b84d6ffa50e None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:16.954715 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf95647c-a4da-4ebb-972a-7b84d6ffa50e None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:16.986325 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8f2d0-ca48-4f2c-bb65-85482d11bd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:16.986976 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8f2d0-ca48-4f2c-bb65-85482d11bd85 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:16.987250 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8f2d0-ca48-4f2c-bb65-85482d11bd85 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:16.987518 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8f2d0-ca48-4f2c-bb65-85482d11bd85 None admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:16.988250 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8f2d0-ca48-4f2c-bb65-85482d11bd85 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:05:16.988552 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8f2d0-ca48-4f2c-bb65-85482d11bd85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:16.989939 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8f2d0-ca48-4f2c-bb65-85482d11bd85 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:16.998848 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 544/1088] 10.222.0.65 () {56 vars in 1115 bytes} [Tue May 17 18:05:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:05:17.004426 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea4696-d5f2-4609-85c6-113801392cfd None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:17.097436 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea4696-d5f2-4609-85c6-113801392cfd None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:17.129607 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734fc294-a6fb-4c2e-822b-04b8db0c7bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:17.130390 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734fc294-a6fb-4c2e-822b-04b8db0c7bb3 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:17.130664 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734fc294-a6fb-4c2e-822b-04b8db0c7bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:17.130939 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734fc294-a6fb-4c2e-822b-04b8db0c7bb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:17.140566 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734fc294-a6fb-4c2e-822b-04b8db0c7bb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:17.142038 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734fc294-a6fb-4c2e-822b-04b8db0c7bb3 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:17.159127 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-734fc294-a6fb-4c2e-822b-04b8db0c7bb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:05:17.159127 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:05:17.159127 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:05:17.159127 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:05:17.159127 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:05:17.159127 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:05:17.159127 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:05:17.159127 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:05:17.159127 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:05:17.159127 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:05:17.159127 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:05:17.159127 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:05:17.159127 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:05:17.159127 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:05:17.159127 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:05:17.160184 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:05:17.160184 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:05:17.160184 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:05:17.160184 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:05:17.160184 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:05:17.160184 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:05:17.160184 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:05:17.160184 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:05:17.160184 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:05:17.160184 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:05:17.160184 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:05:17.160184 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:05:17.160184 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:05:17.160184 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:05:17.160184 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:05:17.160184 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:05:17.160184 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:05:17.161100 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:05:17.161100 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:05:17.161100 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:05:17.161100 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:05:17.161100 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 545/1089] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:05:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:05:17.166019 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8f2d0-ca48-4f2c-bb65-85482d11bd85 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:17.259343 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8f2d0-ca48-4f2c-bb65-85482d11bd85 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:17.290798 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb08ca4-d44b-474a-9611-23ed3a6254af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:17.291436 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb08ca4-d44b-474a-9611-23ed3a6254af None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:17.291710 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb08ca4-d44b-474a-9611-23ed3a6254af None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:17.291979 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb08ca4-d44b-474a-9611-23ed3a6254af None admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:17.292687 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb08ca4-d44b-474a-9611-23ed3a6254af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:05:17.293596 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb08ca4-d44b-474a-9611-23ed3a6254af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:17.294938 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb08ca4-d44b-474a-9611-23ed3a6254af None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:17.305970 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 545/1090] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:05:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:05:17.311530 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734fc294-a6fb-4c2e-822b-04b8db0c7bb3 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:17.411007 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734fc294-a6fb-4c2e-822b-04b8db0c7bb3 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:17.442277 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25114fbe-ca4f-454e-8e58-0c15801e42ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:17.443311 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25114fbe-ca4f-454e-8e58-0c15801e42ce None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:17.443584 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25114fbe-ca4f-454e-8e58-0c15801e42ce None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:17.443851 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25114fbe-ca4f-454e-8e58-0c15801e42ce None admin] PATH_INFO: `/v3/users/nova` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:17.451533 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25114fbe-ca4f-454e-8e58-0c15801e42ce None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:17.452955 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25114fbe-ca4f-454e-8e58-0c15801e42ce None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:17.466246 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-25114fbe-ca4f-454e-8e58-0c15801e42ce None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 17 18:05:17.466246 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:05:17.466246 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:05:17.466246 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:05:17.466246 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:05:17.466246 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:05:17.466246 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:05:17.466246 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:05:17.466246 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:05:17.466246 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:05:17.466246 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:05:17.466246 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:05:17.466246 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 18:05:17.466246 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 18:05:17.466246 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 18:05:17.466246 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 18:05:17.467204 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:05:17.467204 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:05:17.467204 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 18:05:17.467204 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:05:17.467204 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 18:05:17.467204 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:05:17.467204 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:05:17.467204 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:05:17.467204 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:05:17.467204 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:05:17.467204 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:05:17.467204 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:05:17.467204 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:05:17.467204 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:05:17.467204 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:05:17.467204 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:05:17.467204 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:05:17.467204 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:05:17.468540 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:05:17.468540 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:05:17.468540 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 18:05:17.468540 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 18:05:17.468540 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 18:05:17.468540 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 18:05:17.468540 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 18:05:17.468540 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 18:05:17.468540 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 17 18:05:17.468540 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:05:17.468540 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 546/1091] 10.222.0.65 () {56 vars in 1093 bytes} [Tue May 17 18:05:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:05:17.473035 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb08ca4-d44b-474a-9611-23ed3a6254af None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:17.519279 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e9b54-2973-4543-8224-594b83884b17 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:17.519559 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e9b54-2973-4543-8224-594b83884b17 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:17.519833 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e9b54-2973-4543-8224-594b83884b17 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:17.521184 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 547/1092] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:05:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 18:05:17.526098 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f7fbda-f057-4aac-9da1-0bff7c5fc037 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:17.526376 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f7fbda-f057-4aac-9da1-0bff7c5fc037 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:17.526641 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f7fbda-f057-4aac-9da1-0bff7c5fc037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:17.542572 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-e2f7fbda-f057-4aac-9da1-0bff7c5fc037 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:05:17.544225 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-e2f7fbda-f057-4aac-9da1-0bff7c5fc037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:05:17.568279 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb08ca4-d44b-474a-9611-23ed3a6254af None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:17.600016 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c6bfb-dd70-4b82-8282-ec49e3954943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:17.600673 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c6bfb-dd70-4b82-8282-ec49e3954943 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:17.600954 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c6bfb-dd70-4b82-8282-ec49e3954943 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:17.601229 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c6bfb-dd70-4b82-8282-ec49e3954943 None admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:17.602101 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7c6bfb-dd70-4b82-8282-ec49e3954943 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:05:17.602415 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7c6bfb-dd70-4b82-8282-ec49e3954943 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:17.603835 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7c6bfb-dd70-4b82-8282-ec49e3954943 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:17.608163 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 548/1093] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:05:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 18:05:17.621688 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 546/1094] 10.222.0.65 () {56 vars in 1133 bytes} [Tue May 17 18:05:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:05:17.627084 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f7fbda-f057-4aac-9da1-0bff7c5fc037 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:17.631819 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c6bfb-dd70-4b82-8282-ec49e3954943 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:17.717954 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f7fbda-f057-4aac-9da1-0bff7c5fc037 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:17.722983 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c6bfb-dd70-4b82-8282-ec49e3954943 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:17.749679 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d59f79e-471e-49ff-93fc-3b06f28d7f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:17.750311 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59f79e-471e-49ff-93fc-3b06f28d7f51 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:17.750584 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59f79e-471e-49ff-93fc-3b06f28d7f51 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:17.750850 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59f79e-471e-49ff-93fc-3b06f28d7f51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:17.755089 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b508c83f-3e00-4b9b-babf-2b33ee7d5f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:17.755847 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508c83f-3e00-4b9b-babf-2b33ee7d5f24 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:17.756121 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508c83f-3e00-4b9b-babf-2b33ee7d5f24 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:17.756389 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508c83f-3e00-4b9b-babf-2b33ee7d5f24 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:17.765920 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b508c83f-3e00-4b9b-babf-2b33ee7d5f24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:05:17.773344 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-b508c83f-3e00-4b9b-babf-2b33ee7d5f24 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:05:17.773344 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:05:17.773344 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:05:17.773344 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:05:17.773344 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:05:17.773344 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:05:17.773344 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:05:17.773344 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:05:17.773344 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:05:17.773344 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:05:17.773344 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:05:17.773344 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:05:17.773344 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:05:17.773344 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:05:17.773344 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:05:17.773344 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:05:17.774456 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:05:17.774456 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:05:17.774456 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:05:17.774456 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:05:17.774456 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:05:17.774456 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:05:17.774456 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:05:17.774456 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:05:17.774456 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:05:17.774456 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:05:17.774456 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:05:17.774456 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:05:17.774456 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:05:17.774456 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:05:17.774456 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:05:17.774456 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:05:17.775511 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:05:17.775511 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:05:17.775511 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:05:17.775511 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:05:17.775511 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:05:17.775511 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:05:17.775511 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:05:17.775511 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:05:17.775511 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:05:17.775511 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:05:17.775511 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:05:17.775511 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:05:17.775511 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 547/1095] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 17 18:05:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:05:17.780317 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b508c83f-3e00-4b9b-babf-2b33ee7d5f24 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:17.818111 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d59f79e-471e-49ff-93fc-3b06f28d7f51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:17.819541 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d59f79e-471e-49ff-93fc-3b06f28d7f51 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:17.876889 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b508c83f-3e00-4b9b-babf-2b33ee7d5f24 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:17.907977 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e0ffc-9936-4f63-b527-57cb856b37e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:17.908620 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e0ffc-9936-4f63-b527-57cb856b37e5 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:17.908893 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e0ffc-9936-4f63-b527-57cb856b37e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:17.909160 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e0ffc-9936-4f63-b527-57cb856b37e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:17.909914 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e0ffc-9936-4f63-b527-57cb856b37e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:05:17.910212 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e0ffc-9936-4f63-b527-57cb856b37e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:17.911567 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7e0ffc-9936-4f63-b527-57cb856b37e5 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:17.913338 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 549/1096] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 17 18:05:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 18:05:17.919209 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d59f79e-471e-49ff-93fc-3b06f28d7f51 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:17.928219 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 548/1097] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 17 18:05:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:05:17.929166 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e0ffc-9936-4f63-b527-57cb856b37e5 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:18.011631 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d59f79e-471e-49ff-93fc-3b06f28d7f51 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:18.021160 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7e0ffc-9936-4f63-b527-57cb856b37e5 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:18.043531 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b22851-83f3-4d3b-9730-41ed15f058d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:18.044306 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b22851-83f3-4d3b-9730-41ed15f058d7 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:18.044588 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b22851-83f3-4d3b-9730-41ed15f058d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:18.044862 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b22851-83f3-4d3b-9730-41ed15f058d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:18.051728 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512794a2-6699-449f-aae3-b1586b0b7af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:18.052570 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512794a2-6699-449f-aae3-b1586b0b7af6 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:18.052841 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512794a2-6699-449f-aae3-b1586b0b7af6 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:18.053106 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512794a2-6699-449f-aae3-b1586b0b7af6 None admin] PATH_INFO: `/v3/users/3717543a6fd941bab90af05941379d7a` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:18.054299 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512794a2-6699-449f-aae3-b1586b0b7af6 None admin] RBAC: Authorizing `identity:get_user(user_id=3717543a6fd941bab90af05941379d7a)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:18.054440 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b22851-83f3-4d3b-9730-41ed15f058d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:18.055727 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512794a2-6699-449f-aae3-b1586b0b7af6 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:18.055831 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b22851-83f3-4d3b-9730-41ed15f058d7 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:18.062637 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 549/1098] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 17 18:05:17 2022] GET /identity/v3/users/3717543a6fd941bab90af05941379d7a => generated 285 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:05:18.063393 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512794a2-6699-449f-aae3-b1586b0b7af6 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:18.073842 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-63b22851-83f3-4d3b-9730-41ed15f058d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:05:18.073842 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:05:18.073842 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:05:18.073842 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:05:18.073842 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:05:18.073842 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:05:18.073842 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:05:18.073842 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:05:18.073842 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:05:18.073842 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:05:18.073842 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:05:18.073842 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:05:18.073842 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:05:18.073842 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:05:18.073842 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:05:18.075568 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:05:18.075568 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:05:18.075568 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:05:18.075568 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:05:18.075568 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:05:18.075568 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:05:18.075568 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:05:18.075568 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:05:18.075568 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:05:18.075568 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:05:18.075568 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:05:18.075568 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:05:18.075568 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:05:18.075568 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:05:18.075568 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:05:18.075568 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:05:18.075568 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:05:18.076759 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:05:18.076759 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:05:18.076759 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:05:18.076759 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:05:18.076759 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 550/1099] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:05:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:05:18.081093 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b22851-83f3-4d3b-9730-41ed15f058d7 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:18.158552 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512794a2-6699-449f-aae3-b1586b0b7af6 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:18.173369 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b22851-83f3-4d3b-9730-41ed15f058d7 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:18.190079 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36258ac0-85b0-45ac-b35f-3632d7c8d02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:18.190713 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36258ac0-85b0-45ac-b35f-3632d7c8d02f None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:18.190993 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36258ac0-85b0-45ac-b35f-3632d7c8d02f None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:18.191268 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36258ac0-85b0-45ac-b35f-3632d7c8d02f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:18.205821 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9eed8-93fe-4631-80d6-a1bef9a4d5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:18.206461 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9eed8-93fe-4631-80d6-a1bef9a4d5cd None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:18.206735 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9eed8-93fe-4631-80d6-a1bef9a4d5cd None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:18.207002 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9eed8-93fe-4631-80d6-a1bef9a4d5cd None admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:18.207699 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa9eed8-93fe-4631-80d6-a1bef9a4d5cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:05:18.207994 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa9eed8-93fe-4631-80d6-a1bef9a4d5cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:18.209338 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa9eed8-93fe-4631-80d6-a1bef9a4d5cd None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:18.220153 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 551/1100] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:05:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:05:18.225439 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9eed8-93fe-4631-80d6-a1bef9a4d5cd None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:18.255628 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36258ac0-85b0-45ac-b35f-3632d7c8d02f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:18.257065 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36258ac0-85b0-45ac-b35f-3632d7c8d02f None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:18.316321 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9eed8-93fe-4631-80d6-a1bef9a4d5cd None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:18.347057 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba7f547-3d6b-49fb-bd2c-f72a354ad2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:18.347820 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7f547-3d6b-49fb-bd2c-f72a354ad2bc None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:18.348100 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7f547-3d6b-49fb-bd2c-f72a354ad2bc None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:18.348315 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 550/1101] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 17 18:05:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 17 18:05:18.348416 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7f547-3d6b-49fb-bd2c-f72a354ad2bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:18.353648 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36258ac0-85b0-45ac-b35f-3632d7c8d02f None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:18.354837 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba7f547-3d6b-49fb-bd2c-f72a354ad2bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:18.356778 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba7f547-3d6b-49fb-bd2c-f72a354ad2bc None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:18.370358 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-fba7f547-3d6b-49fb-bd2c-f72a354ad2bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:05:18.370358 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:05:18.370358 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:05:18.370358 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:05:18.370358 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:05:18.370358 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:05:18.370358 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:05:18.370358 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:05:18.370358 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:05:18.370358 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:05:18.370358 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:05:18.370358 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:05:18.370358 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 18:05:18.370358 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 18:05:18.370358 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 18:05:18.371849 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 18:05:18.371849 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:05:18.371849 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:05:18.371849 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:05:18.371849 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:05:18.371849 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:05:18.371849 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:05:18.371849 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:05:18.371849 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:05:18.371849 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:05:18.371849 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:05:18.371849 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:05:18.371849 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:05:18.371849 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:05:18.371849 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:05:18.371849 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:05:18.371849 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:05:18.372759 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 18:05:18.372759 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 18:05:18.372759 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 18:05:18.372759 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 18:05:18.372759 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 18:05:18.372759 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 18:05:18.372759 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:05:18.372759 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:05:18.372759 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 552/1102] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 17 18:05:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:05:18.377790 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba7f547-3d6b-49fb-bd2c-f72a354ad2bc None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:18.446490 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36258ac0-85b0-45ac-b35f-3632d7c8d02f None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:18.468439 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba7f547-3d6b-49fb-bd2c-f72a354ad2bc None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:18.477348 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c11000-c85f-4e1b-8f54-d4d941413890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:18.478211 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c11000-c85f-4e1b-8f54-d4d941413890 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:18.478489 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c11000-c85f-4e1b-8f54-d4d941413890 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:18.478761 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c11000-c85f-4e1b-8f54-d4d941413890 None admin] PATH_INFO: `/v3/projects/e3bd7fa4ec594d188daee72f6489137f` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:18.479909 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c11000-c85f-4e1b-8f54-d4d941413890 None admin] RBAC: Authorizing `identity:get_project(project_id=e3bd7fa4ec594d188daee72f6489137f)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:18.481913 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c11000-c85f-4e1b-8f54-d4d941413890 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:18.483592 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 551/1103] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 17 18:05:18 2022] GET /identity/v3/projects/e3bd7fa4ec594d188daee72f6489137f => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:05:18.489538 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c11000-c85f-4e1b-8f54-d4d941413890 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:18.501116 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549afba1-fab0-4bc9-9919-fcd7f7380113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:18.501795 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549afba1-fab0-4bc9-9919-fcd7f7380113 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:18.502077 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549afba1-fab0-4bc9-9919-fcd7f7380113 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:18.502348 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549afba1-fab0-4bc9-9919-fcd7f7380113 None admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:18.503128 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549afba1-fab0-4bc9-9919-fcd7f7380113 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:05:18.503434 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549afba1-fab0-4bc9-9919-fcd7f7380113 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:18.504846 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549afba1-fab0-4bc9-9919-fcd7f7380113 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:18.516380 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 553/1104] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 17 18:05:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:05:18.522648 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549afba1-fab0-4bc9-9919-fcd7f7380113 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:18.589049 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c11000-c85f-4e1b-8f54-d4d941413890 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:18.617892 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549afba1-fab0-4bc9-9919-fcd7f7380113 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:18.623708 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd6a54-6f0c-45be-a6d1-3c54608c9ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:18.624357 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd6a54-6f0c-45be-a6d1-3c54608c9ffc None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:18.624629 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd6a54-6f0c-45be-a6d1-3c54608c9ffc None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:18.624899 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd6a54-6f0c-45be-a6d1-3c54608c9ffc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:18.625740 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdd6a54-6f0c-45be-a6d1-3c54608c9ffc None admin] RBAC: Adding query filter params (role.id=332c8d70fd0f41e2beea20aaead5daa5, scope.project.id=e3bd7fa4ec594d188daee72f6489137f, user.id=3717543a6fd941bab90af05941379d7a) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:05:18.626065 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdd6a54-6f0c-45be-a6d1-3c54608c9ffc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:18.627464 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdd6a54-6f0c-45be-a6d1-3c54608c9ffc None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:18.633195 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 552/1105] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 17 18:05:18 2022] GET /identity/v3/role_assignments?user.id=3717543a6fd941bab90af05941379d7a&scope.project.id=e3bd7fa4ec594d188daee72f6489137f&role.id=332c8d70fd0f41e2beea20aaead5daa5 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:05:18.649829 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d26334-431c-435b-b27e-293b57cb1376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:18.650502 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d26334-431c-435b-b27e-293b57cb1376 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:18.650782 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d26334-431c-435b-b27e-293b57cb1376 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:18.651056 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d26334-431c-435b-b27e-293b57cb1376 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:18.651906 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d26334-431c-435b-b27e-293b57cb1376 None admin] RBAC: Adding query filter params (role.id=389e932f10c643a2aa76b3a21351e061, scope.project.id=0cf165918c1f46cb96d4b54409862659, user.id=5b430b739cb54fc7911bc89f8ea2df72) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:05:18.652722 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d26334-431c-435b-b27e-293b57cb1376 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:18.654213 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d26334-431c-435b-b27e-293b57cb1376 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:18.660827 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 554/1106] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 17 18:05:18 2022] GET /identity/v3/role_assignments?user.id=5b430b739cb54fc7911bc89f8ea2df72&scope.project.id=0cf165918c1f46cb96d4b54409862659&role.id=389e932f10c643a2aa76b3a21351e061 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:05:20.873133 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4fbcc-04aa-4f8c-84d2-51f670ee54ff None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:20.873631 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4fbcc-04aa-4f8c-84d2-51f670ee54ff None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:20.873734 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4fbcc-04aa-4f8c-84d2-51f670ee54ff None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:20.875039 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 553/1107] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:05:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:05:20.880166 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bba1bf-12f2-4247-9e29-bc68b5354da4 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:20.880599 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bba1bf-12f2-4247-9e29-bc68b5354da4 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:20.880723 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bba1bf-12f2-4247-9e29-bc68b5354da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:20.897284 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-02bba1bf-12f2-4247-9e29-bc68b5354da4 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:05:20.898536 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-02bba1bf-12f2-4247-9e29-bc68b5354da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:05:20.971340 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 555/1108] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:05:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:05:20.996493 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4fbcc-04aa-4f8c-84d2-51f670ee54ff None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:21.092496 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4fbcc-04aa-4f8c-84d2-51f670ee54ff None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:21.123979 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9dab3a-6584-435e-8223-1e032f1611ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:21.124745 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9dab3a-6584-435e-8223-1e032f1611ac None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:21.125024 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9dab3a-6584-435e-8223-1e032f1611ac None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:21.125304 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9dab3a-6584-435e-8223-1e032f1611ac None admin] PATH_INFO: `/v3/domains/default` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:21.126554 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9dab3a-6584-435e-8223-1e032f1611ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:21.128027 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9dab3a-6584-435e-8223-1e032f1611ac None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:21.129978 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 554/1109] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:05:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:05:21.136350 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bba1bf-12f2-4247-9e29-bc68b5354da4 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:21.241711 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bba1bf-12f2-4247-9e29-bc68b5354da4 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:21.274318 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d474020b-d002-4063-aedb-952de539b911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:21.274962 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474020b-d002-4063-aedb-952de539b911 None admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:21.275235 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474020b-d002-4063-aedb-952de539b911 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:21.275503 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474020b-d002-4063-aedb-952de539b911 None admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:21.276195 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d474020b-d002-4063-aedb-952de539b911 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:21.277634 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d474020b-d002-4063-aedb-952de539b911 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:21.296113 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 556/1110] 10.222.0.65 () {60 vars in 1132 bytes} [Tue May 17 18:05:21 2022] POST /identity/v3/users => generated 286 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:05:23.519136 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e806f51-5dcd-49ff-b0b8-8918ee787af3 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:23.519694 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e806f51-5dcd-49ff-b0b8-8918ee787af3 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:23.519694 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e806f51-5dcd-49ff-b0b8-8918ee787af3 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:23.521010 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 555/1111] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:05:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:05:23.526307 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c617a9-66b8-49b8-aa01-079afaeccf5b None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:23.526725 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c617a9-66b8-49b8-aa01-079afaeccf5b None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:23.526865 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c617a9-66b8-49b8-aa01-079afaeccf5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:23.543586 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-00c617a9-66b8-49b8-aa01-079afaeccf5b None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:05:23.544768 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-00c617a9-66b8-49b8-aa01-079afaeccf5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:05:23.607244 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 557/1112] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:05:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:05:23.631143 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e806f51-5dcd-49ff-b0b8-8918ee787af3 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:23.724521 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e806f51-5dcd-49ff-b0b8-8918ee787af3 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:23.755812 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8d17c-2faa-4074-8fdf-34cd4157f26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:23.756635 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8d17c-2faa-4074-8fdf-34cd4157f26b None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:23.756909 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8d17c-2faa-4074-8fdf-34cd4157f26b None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:23.757177 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8d17c-2faa-4074-8fdf-34cd4157f26b None admin] PATH_INFO: `/v3/roles/c3b3265cd6364fbcb22a731040b7b47a` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:23.758643 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f8d17c-2faa-4074-8fdf-34cd4157f26b None admin] RBAC: Authorizing `identity:get_role(role_id=c3b3265cd6364fbcb22a731040b7b47a)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:23.759982 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f8d17c-2faa-4074-8fdf-34cd4157f26b None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:23.761322 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 556/1113] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 17 18:05:23 2022] GET /identity/v3/roles/c3b3265cd6364fbcb22a731040b7b47a => generated 223 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:05:23.767557 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c617a9-66b8-49b8-aa01-079afaeccf5b None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:23.859187 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c617a9-66b8-49b8-aa01-079afaeccf5b None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:23.891528 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048bc77-7658-438b-8cc6-683dc8d58fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:23.892382 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048bc77-7658-438b-8cc6-683dc8d58fac None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:23.892662 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048bc77-7658-438b-8cc6-683dc8d58fac None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:23.892937 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1048bc77-7658-438b-8cc6-683dc8d58fac None admin] PATH_INFO: `/v3/users/8a11e982345645c8bd1d56461be22a99` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:23.905178 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1048bc77-7658-438b-8cc6-683dc8d58fac None admin] RBAC: Authorizing `identity:get_user(user_id=8a11e982345645c8bd1d56461be22a99)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:23.906654 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1048bc77-7658-438b-8cc6-683dc8d58fac None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:23.908283 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 558/1114] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 17 18:05:23 2022] GET /identity/v3/users/8a11e982345645c8bd1d56461be22a99 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:05:23.914001 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8d17c-2faa-4074-8fdf-34cd4157f26b None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:24.005194 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8d17c-2faa-4074-8fdf-34cd4157f26b None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:24.036453 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90279dcd-e879-490b-adb2-d47feb05924e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:24.037070 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90279dcd-e879-490b-adb2-d47feb05924e None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:24.037343 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90279dcd-e879-490b-adb2-d47feb05924e None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:24.037643 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90279dcd-e879-490b-adb2-d47feb05924e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:24.099828 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90279dcd-e879-490b-adb2-d47feb05924e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:24.101182 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90279dcd-e879-490b-adb2-d47feb05924e None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:24.192322 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 557/1115] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 17 18:05:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 18:05:24.198321 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048bc77-7658-438b-8cc6-683dc8d58fac None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:24.289163 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1048bc77-7658-438b-8cc6-683dc8d58fac None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:24.321690 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3328fb76-82af-48ef-8b84-d0b4c15a8d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:24.322521 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328fb76-82af-48ef-8b84-d0b4c15a8d88 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:24.322795 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328fb76-82af-48ef-8b84-d0b4c15a8d88 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:24.323061 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328fb76-82af-48ef-8b84-d0b4c15a8d88 None admin] PATH_INFO: `/v3/projects/e3bd7fa4ec594d188daee72f6489137f` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:24.324360 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3328fb76-82af-48ef-8b84-d0b4c15a8d88 None admin] RBAC: Authorizing `identity:get_project(project_id=e3bd7fa4ec594d188daee72f6489137f)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:24.325806 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3328fb76-82af-48ef-8b84-d0b4c15a8d88 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:24.327452 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 559/1116] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 17 18:05:24 2022] GET /identity/v3/projects/e3bd7fa4ec594d188daee72f6489137f => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:05:24.333334 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90279dcd-e879-490b-adb2-d47feb05924e None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:24.424648 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90279dcd-e879-490b-adb2-d47feb05924e None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:24.456851 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece5b261-ec7b-4b4e-a601-f1b89b87ca05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:24.457499 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5b261-ec7b-4b4e-a601-f1b89b87ca05 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:24.457784 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5b261-ec7b-4b4e-a601-f1b89b87ca05 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:24.458053 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5b261-ec7b-4b4e-a601-f1b89b87ca05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:24.458870 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece5b261-ec7b-4b4e-a601-f1b89b87ca05 None admin] RBAC: Adding query filter params (role.id=c3b3265cd6364fbcb22a731040b7b47a, scope.project.id=e3bd7fa4ec594d188daee72f6489137f, user.id=8a11e982345645c8bd1d56461be22a99) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:05:24.459177 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece5b261-ec7b-4b4e-a601-f1b89b87ca05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:24.460579 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece5b261-ec7b-4b4e-a601-f1b89b87ca05 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:24.465792 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 558/1117] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 17 18:05:24 2022] GET /identity/v3/role_assignments?user.id=8a11e982345645c8bd1d56461be22a99&scope.project.id=e3bd7fa4ec594d188daee72f6489137f&role.id=c3b3265cd6364fbcb22a731040b7b47a => generated 259 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:05:26.647767 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3f8b0-96d7-4a56-9797-9c72080e3975 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:26.648324 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3f8b0-96d7-4a56-9797-9c72080e3975 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:26.648324 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc3f8b0-96d7-4a56-9797-9c72080e3975 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:26.649691 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 560/1118] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:05:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 18:05:26.655535 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2442b12d-f7a4-404a-bef8-34809221cc72 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:26.655927 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2442b12d-f7a4-404a-bef8-34809221cc72 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:26.656085 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2442b12d-f7a4-404a-bef8-34809221cc72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:26.672365 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-2442b12d-f7a4-404a-bef8-34809221cc72 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:05:26.673586 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-2442b12d-f7a4-404a-bef8-34809221cc72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:05:26.738126 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 559/1119] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:05:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:05:26.763567 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3f8b0-96d7-4a56-9797-9c72080e3975 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:26.862940 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc3f8b0-96d7-4a56-9797-9c72080e3975 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:26.895724 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d4318c-3b0e-4251-a7ad-17871acd9f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:26.896552 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d4318c-3b0e-4251-a7ad-17871acd9f96 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:26.896832 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d4318c-3b0e-4251-a7ad-17871acd9f96 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:26.897103 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d4318c-3b0e-4251-a7ad-17871acd9f96 None admin] PATH_INFO: `/v3/roles/c3b3265cd6364fbcb22a731040b7b47a` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:26.898644 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d4318c-3b0e-4251-a7ad-17871acd9f96 None admin] RBAC: Authorizing `identity:get_role(role_id=c3b3265cd6364fbcb22a731040b7b47a)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:26.899959 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d4318c-3b0e-4251-a7ad-17871acd9f96 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:26.901349 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 561/1120] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 17 18:05:26 2022] GET /identity/v3/roles/c3b3265cd6364fbcb22a731040b7b47a => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:05:26.907770 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2442b12d-f7a4-404a-bef8-34809221cc72 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:26.999979 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2442b12d-f7a4-404a-bef8-34809221cc72 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:27.034607 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9a188-b5ea-4816-b3cd-47050b003e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:27.035457 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9a188-b5ea-4816-b3cd-47050b003e7a None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:27.035734 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9a188-b5ea-4816-b3cd-47050b003e7a None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:27.036032 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9a188-b5ea-4816-b3cd-47050b003e7a None admin] PATH_INFO: `/v3/users/8a11e982345645c8bd1d56461be22a99` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:27.037197 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e9a188-b5ea-4816-b3cd-47050b003e7a None admin] RBAC: Authorizing `identity:get_user(user_id=8a11e982345645c8bd1d56461be22a99)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:27.038653 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e9a188-b5ea-4816-b3cd-47050b003e7a None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:27.040264 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 560/1121] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 17 18:05:26 2022] GET /identity/v3/users/8a11e982345645c8bd1d56461be22a99 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:05:27.045978 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d4318c-3b0e-4251-a7ad-17871acd9f96 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:27.146177 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d4318c-3b0e-4251-a7ad-17871acd9f96 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:27.178458 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf55293-6b29-42a4-9b64-1a0306d6d809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:27.179217 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf55293-6b29-42a4-9b64-1a0306d6d809 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:27.179494 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf55293-6b29-42a4-9b64-1a0306d6d809 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:27.179766 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf55293-6b29-42a4-9b64-1a0306d6d809 None admin] PATH_INFO: `/v3/projects/e3bd7fa4ec594d188daee72f6489137f` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:27.180940 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf55293-6b29-42a4-9b64-1a0306d6d809 None admin] RBAC: Authorizing `identity:get_project(project_id=e3bd7fa4ec594d188daee72f6489137f)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:27.182392 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf55293-6b29-42a4-9b64-1a0306d6d809 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:27.184578 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 562/1122] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 17 18:05:27 2022] GET /identity/v3/projects/e3bd7fa4ec594d188daee72f6489137f => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:05:27.190538 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9a188-b5ea-4816-b3cd-47050b003e7a None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:27.282690 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9a188-b5ea-4816-b3cd-47050b003e7a None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:27.314428 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10798b99-968d-44d8-82db-a3cb99b01c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:27.315275 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10798b99-968d-44d8-82db-a3cb99b01c4b None admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:27.315544 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10798b99-968d-44d8-82db-a3cb99b01c4b None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:27.315807 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10798b99-968d-44d8-82db-a3cb99b01c4b None admin] PATH_INFO: `/v3/projects/e3bd7fa4ec594d188daee72f6489137f/users/8a11e982345645c8bd1d56461be22a99/roles/c3b3265cd6364fbcb22a731040b7b47a` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:27.318308 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10798b99-968d-44d8-82db-a3cb99b01c4b None admin] RBAC: Authorizing `identity:create_grant(project_id=e3bd7fa4ec594d188daee72f6489137f, user_id=8a11e982345645c8bd1d56461be22a99, role_id=c3b3265cd6364fbcb22a731040b7b47a)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:27.319710 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10798b99-968d-44d8-82db-a3cb99b01c4b None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:27.331648 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 561/1123] 10.222.0.65 () {58 vars in 1439 bytes} [Tue May 17 18:05:27 2022] PUT /identity/v3/projects/e3bd7fa4ec594d188daee72f6489137f/users/8a11e982345645c8bd1d56461be22a99/roles/c3b3265cd6364fbcb22a731040b7b47a => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:05:29.528525 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af86eba3-5deb-435c-af5c-405acb320207 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:29.529058 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af86eba3-5deb-435c-af5c-405acb320207 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:29.529058 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af86eba3-5deb-435c-af5c-405acb320207 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:29.530464 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 563/1124] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:05:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 18:05:29.535704 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef930c5-8c4f-4816-96a9-28016d179cb5 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:29.536087 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef930c5-8c4f-4816-96a9-28016d179cb5 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:29.536258 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef930c5-8c4f-4816-96a9-28016d179cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:29.552883 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-bef930c5-8c4f-4816-96a9-28016d179cb5 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:05:29.554093 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-bef930c5-8c4f-4816-96a9-28016d179cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:05:29.616265 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 562/1125] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:05:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:05:29.639641 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af86eba3-5deb-435c-af5c-405acb320207 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:29.734582 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af86eba3-5deb-435c-af5c-405acb320207 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:29.765982 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae2395-e748-406d-a061-ff840e9c38ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:29.766813 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae2395-e748-406d-a061-ff840e9c38ec None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:29.767088 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae2395-e748-406d-a061-ff840e9c38ec None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:29.767356 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae2395-e748-406d-a061-ff840e9c38ec None admin] PATH_INFO: `/v3/roles/c3b3265cd6364fbcb22a731040b7b47a` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:29.768802 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dae2395-e748-406d-a061-ff840e9c38ec None admin] RBAC: Authorizing `identity:get_role(role_id=c3b3265cd6364fbcb22a731040b7b47a)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:29.770186 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dae2395-e748-406d-a061-ff840e9c38ec None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:29.771528 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 564/1126] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 17 18:05:29 2022] GET /identity/v3/roles/c3b3265cd6364fbcb22a731040b7b47a => generated 223 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:05:29.777330 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef930c5-8c4f-4816-96a9-28016d179cb5 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:29.872932 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef930c5-8c4f-4816-96a9-28016d179cb5 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:29.906275 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33050d3d-7e4b-450d-ac8e-16d99a47f298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:29.907127 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33050d3d-7e4b-450d-ac8e-16d99a47f298 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:29.907401 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33050d3d-7e4b-450d-ac8e-16d99a47f298 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:29.907668 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33050d3d-7e4b-450d-ac8e-16d99a47f298 None admin] PATH_INFO: `/v3/users/8a11e982345645c8bd1d56461be22a99` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:29.908815 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33050d3d-7e4b-450d-ac8e-16d99a47f298 None admin] RBAC: Authorizing `identity:get_user(user_id=8a11e982345645c8bd1d56461be22a99)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:29.910246 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33050d3d-7e4b-450d-ac8e-16d99a47f298 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:29.911855 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 563/1127] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 17 18:05:29 2022] GET /identity/v3/users/8a11e982345645c8bd1d56461be22a99 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:05:29.917796 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae2395-e748-406d-a061-ff840e9c38ec None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:30.010373 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae2395-e748-406d-a061-ff840e9c38ec None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:30.042048 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57797f-42af-4d82-a1ad-52753b13f24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:30.042669 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57797f-42af-4d82-a1ad-52753b13f24b None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:30.042943 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57797f-42af-4d82-a1ad-52753b13f24b None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:30.043210 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57797f-42af-4d82-a1ad-52753b13f24b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:30.105376 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad57797f-42af-4d82-a1ad-52753b13f24b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:30.106775 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad57797f-42af-4d82-a1ad-52753b13f24b None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:30.196667 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 565/1128] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 17 18:05:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 18:05:30.202353 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33050d3d-7e4b-450d-ac8e-16d99a47f298 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:30.293861 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33050d3d-7e4b-450d-ac8e-16d99a47f298 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:30.325319 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392b635e-07d3-4688-9d74-e2899b076271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:30.326182 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b635e-07d3-4688-9d74-e2899b076271 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:30.326457 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b635e-07d3-4688-9d74-e2899b076271 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:30.326722 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392b635e-07d3-4688-9d74-e2899b076271 None admin] PATH_INFO: `/v3/projects/e3bd7fa4ec594d188daee72f6489137f` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:30.327865 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392b635e-07d3-4688-9d74-e2899b076271 None admin] RBAC: Authorizing `identity:get_project(project_id=e3bd7fa4ec594d188daee72f6489137f)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:30.329265 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392b635e-07d3-4688-9d74-e2899b076271 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:30.330930 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 564/1129] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 17 18:05:30 2022] GET /identity/v3/projects/e3bd7fa4ec594d188daee72f6489137f => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:05:30.336647 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57797f-42af-4d82-a1ad-52753b13f24b None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:30.428497 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57797f-42af-4d82-a1ad-52753b13f24b None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:30.460234 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0d4ad8-b163-4b3e-bc45-db978d693631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:30.460860 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d4ad8-b163-4b3e-bc45-db978d693631 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:30.461137 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d4ad8-b163-4b3e-bc45-db978d693631 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:30.461407 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0d4ad8-b163-4b3e-bc45-db978d693631 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:30.462254 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0d4ad8-b163-4b3e-bc45-db978d693631 None admin] RBAC: Adding query filter params (role.id=c3b3265cd6364fbcb22a731040b7b47a, scope.project.id=e3bd7fa4ec594d188daee72f6489137f, user.id=8a11e982345645c8bd1d56461be22a99) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:05:30.462563 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0d4ad8-b163-4b3e-bc45-db978d693631 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:30.463968 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0d4ad8-b163-4b3e-bc45-db978d693631 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:30.469554 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 566/1130] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 17 18:05:30 2022] GET /identity/v3/role_assignments?user.id=8a11e982345645c8bd1d56461be22a99&scope.project.id=e3bd7fa4ec594d188daee72f6489137f&role.id=c3b3265cd6364fbcb22a731040b7b47a => generated 608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:05:32.655539 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c822f0-928c-4d4a-9a60-a7224bd055ef None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:32.656112 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c822f0-928c-4d4a-9a60-a7224bd055ef None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:32.656112 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c822f0-928c-4d4a-9a60-a7224bd055ef None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:32.657421 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 565/1131] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:05:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:05:32.662846 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a512b7-7304-470c-a34e-97021d05ead7 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:32.663236 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a512b7-7304-470c-a34e-97021d05ead7 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:32.663394 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a512b7-7304-470c-a34e-97021d05ead7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:32.679415 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-33a512b7-7304-470c-a34e-97021d05ead7 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:05:32.680567 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-33a512b7-7304-470c-a34e-97021d05ead7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:05:32.742005 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 567/1132] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:05:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:05:32.764928 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c822f0-928c-4d4a-9a60-a7224bd055ef None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:32.861439 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c822f0-928c-4d4a-9a60-a7224bd055ef None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:32.894157 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efd26d3-3061-453a-98fa-2c887860cd9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:32.894928 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd26d3-3061-453a-98fa-2c887860cd9f None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:32.895203 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd26d3-3061-453a-98fa-2c887860cd9f None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:32.895474 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd26d3-3061-453a-98fa-2c887860cd9f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:32.896617 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efd26d3-3061-453a-98fa-2c887860cd9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:32.898084 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efd26d3-3061-453a-98fa-2c887860cd9f None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:32.899672 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 566/1133] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:05:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:05:32.905603 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a512b7-7304-470c-a34e-97021d05ead7 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:32.996564 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a512b7-7304-470c-a34e-97021d05ead7 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:33.028813 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b5824-b17a-4692-9f9a-22db43882fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:33.029477 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b5824-b17a-4692-9f9a-22db43882fd8 None admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:33.029751 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b5824-b17a-4692-9f9a-22db43882fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:33.030017 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b5824-b17a-4692-9f9a-22db43882fd8 None admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:33.030730 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1b5824-b17a-4692-9f9a-22db43882fd8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:33.032135 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1b5824-b17a-4692-9f9a-22db43882fd8 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:33.064429 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 568/1134] 10.222.0.65 () {60 vars in 1141 bytes} [Tue May 17 18:05:32 2022] POST /identity/v3/projects => generated 311 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:05:35.271986 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cbb4bd-8a69-4f77-822b-185045c649e9 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:35.272518 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cbb4bd-8a69-4f77-822b-185045c649e9 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:35.272518 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cbb4bd-8a69-4f77-822b-185045c649e9 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:35.273901 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 567/1135] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:05:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:05:35.279512 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db70bc-d84d-40e7-947d-32cf0f14d152 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:35.279920 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db70bc-d84d-40e7-947d-32cf0f14d152 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:35.280063 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db70bc-d84d-40e7-947d-32cf0f14d152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:35.296683 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-36db70bc-d84d-40e7-947d-32cf0f14d152 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:05:35.297894 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-36db70bc-d84d-40e7-947d-32cf0f14d152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:05:35.359246 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 569/1136] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:05:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:05:35.383595 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cbb4bd-8a69-4f77-822b-185045c649e9 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:35.476720 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cbb4bd-8a69-4f77-822b-185045c649e9 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:35.508352 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e5fdf-dbd2-4080-b0c0-39b90ce91c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:35.509097 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e5fdf-dbd2-4080-b0c0-39b90ce91c51 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:35.509368 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e5fdf-dbd2-4080-b0c0-39b90ce91c51 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:35.509664 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e5fdf-dbd2-4080-b0c0-39b90ce91c51 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:35.510797 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4e5fdf-dbd2-4080-b0c0-39b90ce91c51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:35.512219 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4e5fdf-dbd2-4080-b0c0-39b90ce91c51 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:35.513795 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 568/1137] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:05:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:05:35.519419 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db70bc-d84d-40e7-947d-32cf0f14d152 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:35.610799 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db70bc-d84d-40e7-947d-32cf0f14d152 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:35.642058 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e0484-3827-4430-8b2c-50fa51c27f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:35.642699 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e0484-3827-4430-8b2c-50fa51c27f08 None admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:35.642976 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e0484-3827-4430-8b2c-50fa51c27f08 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:35.643247 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e0484-3827-4430-8b2c-50fa51c27f08 None admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:35.643936 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4e0484-3827-4430-8b2c-50fa51c27f08 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:35.645346 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4e0484-3827-4430-8b2c-50fa51c27f08 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:35.663579 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 570/1138] 10.222.0.65 () {60 vars in 1132 bytes} [Tue May 17 18:05:35 2022] POST /identity/v3/users => generated 286 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:05:37.887995 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed8ace6-5bb6-49de-9599-c849be563384 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:37.888523 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed8ace6-5bb6-49de-9599-c849be563384 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:37.888523 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed8ace6-5bb6-49de-9599-c849be563384 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:37.889930 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 569/1139] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:05:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:05:37.895417 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917102ef-ad18-4b3b-8ac5-4d6168ac5431 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:37.895812 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917102ef-ad18-4b3b-8ac5-4d6168ac5431 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:37.895965 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917102ef-ad18-4b3b-8ac5-4d6168ac5431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:37.912433 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-917102ef-ad18-4b3b-8ac5-4d6168ac5431 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:05:37.913644 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-917102ef-ad18-4b3b-8ac5-4d6168ac5431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:05:37.976245 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 571/1140] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:05:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:05:37.999998 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed8ace6-5bb6-49de-9599-c849be563384 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:38.095549 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed8ace6-5bb6-49de-9599-c849be563384 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:38.127173 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25eb7f3-5a47-4bae-9bbf-a476040bf0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:38.127937 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25eb7f3-5a47-4bae-9bbf-a476040bf0fa None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:38.128215 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25eb7f3-5a47-4bae-9bbf-a476040bf0fa None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:38.128487 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25eb7f3-5a47-4bae-9bbf-a476040bf0fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:38.138152 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25eb7f3-5a47-4bae-9bbf-a476040bf0fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:05:38.145698 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-e25eb7f3-5a47-4bae-9bbf-a476040bf0fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:05:38.145698 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:05:38.145698 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:05:38.145698 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:05:38.145698 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:05:38.145698 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:05:38.145698 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:05:38.145698 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:05:38.145698 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:05:38.145698 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:05:38.145698 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:05:38.145698 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:05:38.145698 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:05:38.145698 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:05:38.145698 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:05:38.145698 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:05:38.146775 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:05:38.146775 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:05:38.146775 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:05:38.146775 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:05:38.146775 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:05:38.146775 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:05:38.146775 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:05:38.146775 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:05:38.146775 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:05:38.146775 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:05:38.146775 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:05:38.146775 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:05:38.146775 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:05:38.146775 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:05:38.146775 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:05:38.146775 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:05:38.147665 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:05:38.147665 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:05:38.147665 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:05:38.147665 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:05:38.147665 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:05:38.147665 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:05:38.147665 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:05:38.147665 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:05:38.147665 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:05:38.147665 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:05:38.147665 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:05:38.147665 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:05:38.147665 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 570/1141] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 17 18:05:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:05:38.153200 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917102ef-ad18-4b3b-8ac5-4d6168ac5431 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:38.247755 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917102ef-ad18-4b3b-8ac5-4d6168ac5431 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:38.279328 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c267e-3981-4c06-9199-c4a793d476a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:38.279972 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c267e-3981-4c06-9199-c4a793d476a1 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:38.280250 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c267e-3981-4c06-9199-c4a793d476a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:38.280519 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c267e-3981-4c06-9199-c4a793d476a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:38.281250 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048c267e-3981-4c06-9199-c4a793d476a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:05:38.281577 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048c267e-3981-4c06-9199-c4a793d476a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:38.282931 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048c267e-3981-4c06-9199-c4a793d476a1 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:38.290495 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 572/1142] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 17 18:05:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:05:38.296732 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25eb7f3-5a47-4bae-9bbf-a476040bf0fa None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:38.388098 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25eb7f3-5a47-4bae-9bbf-a476040bf0fa None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:38.418803 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e11385-13df-4820-bcbc-3c370795bfec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:38.419633 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e11385-13df-4820-bcbc-3c370795bfec None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:38.419908 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e11385-13df-4820-bcbc-3c370795bfec None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:38.420174 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e11385-13df-4820-bcbc-3c370795bfec None admin] PATH_INFO: `/v3/users/259e1466ce294a228ca51d735d8d1691` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:38.432247 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e11385-13df-4820-bcbc-3c370795bfec None admin] RBAC: Authorizing `identity:get_user(user_id=259e1466ce294a228ca51d735d8d1691)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:38.434225 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e11385-13df-4820-bcbc-3c370795bfec None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:38.435804 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 571/1143] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 17 18:05:38 2022] GET /identity/v3/users/259e1466ce294a228ca51d735d8d1691 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:05:38.441294 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c267e-3981-4c06-9199-c4a793d476a1 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:38.533420 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c267e-3981-4c06-9199-c4a793d476a1 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:38.564911 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1915e856-33a7-4c78-b4f0-63c6dc27ef3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:38.565557 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915e856-33a7-4c78-b4f0-63c6dc27ef3d None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:38.565838 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915e856-33a7-4c78-b4f0-63c6dc27ef3d None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:38.566112 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915e856-33a7-4c78-b4f0-63c6dc27ef3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:38.627971 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1915e856-33a7-4c78-b4f0-63c6dc27ef3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:38.629063 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1915e856-33a7-4c78-b4f0-63c6dc27ef3d None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:38.721610 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 573/1144] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 17 18:05:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 18:05:38.727343 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e11385-13df-4820-bcbc-3c370795bfec None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:38.818529 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e11385-13df-4820-bcbc-3c370795bfec None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:38.850596 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a8dd2b-4065-4535-80c0-3e795f366a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:38.851430 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8dd2b-4065-4535-80c0-3e795f366a9c None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:38.851706 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8dd2b-4065-4535-80c0-3e795f366a9c None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:38.851978 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8dd2b-4065-4535-80c0-3e795f366a9c None admin] PATH_INFO: `/v3/projects/b6daa48e3ef14cc3a9aad6db6dcb12bb` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:38.853122 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a8dd2b-4065-4535-80c0-3e795f366a9c None admin] RBAC: Authorizing `identity:get_project(project_id=b6daa48e3ef14cc3a9aad6db6dcb12bb)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:38.854568 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a8dd2b-4065-4535-80c0-3e795f366a9c None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:38.856246 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 572/1145] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 17 18:05:38 2022] GET /identity/v3/projects/b6daa48e3ef14cc3a9aad6db6dcb12bb => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:05:38.862178 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1915e856-33a7-4c78-b4f0-63c6dc27ef3d None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:38.954358 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1915e856-33a7-4c78-b4f0-63c6dc27ef3d None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:38.985124 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05045555-0ce6-466f-a468-0f2f128715f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:38.985725 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05045555-0ce6-466f-a468-0f2f128715f7 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:38.986001 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05045555-0ce6-466f-a468-0f2f128715f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:38.986275 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05045555-0ce6-466f-a468-0f2f128715f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:38.987094 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05045555-0ce6-466f-a468-0f2f128715f7 None admin] RBAC: Adding query filter params (role.id=332c8d70fd0f41e2beea20aaead5daa5, scope.project.id=b6daa48e3ef14cc3a9aad6db6dcb12bb, user.id=259e1466ce294a228ca51d735d8d1691) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:05:38.987399 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05045555-0ce6-466f-a468-0f2f128715f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:38.988812 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05045555-0ce6-466f-a468-0f2f128715f7 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:38.993985 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 574/1146] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 17 18:05:38 2022] GET /identity/v3/role_assignments?user.id=259e1466ce294a228ca51d735d8d1691&scope.project.id=b6daa48e3ef14cc3a9aad6db6dcb12bb&role.id=332c8d70fd0f41e2beea20aaead5daa5 => generated 259 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:05:41.167951 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b85533-efeb-4c17-9381-2f2672ff82dc None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:41.168468 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b85533-efeb-4c17-9381-2f2672ff82dc None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:41.168575 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b85533-efeb-4c17-9381-2f2672ff82dc None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:41.169896 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 573/1147] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:05:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:05:41.174949 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ce294-52b5-4e22-a7b8-d9a1c7dec18a None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:41.175371 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ce294-52b5-4e22-a7b8-d9a1c7dec18a None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:41.175479 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ce294-52b5-4e22-a7b8-d9a1c7dec18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:41.191983 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-9e4ce294-52b5-4e22-a7b8-d9a1c7dec18a None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:05:41.193394 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-9e4ce294-52b5-4e22-a7b8-d9a1c7dec18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:05:41.254310 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 575/1148] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:05:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:05:41.276772 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b85533-efeb-4c17-9381-2f2672ff82dc None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:41.372211 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b85533-efeb-4c17-9381-2f2672ff82dc None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:41.403957 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f005811-f272-4c35-be95-0f9c61976f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:41.404724 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f005811-f272-4c35-be95-0f9c61976f80 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:41.405004 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f005811-f272-4c35-be95-0f9c61976f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:41.405276 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f005811-f272-4c35-be95-0f9c61976f80 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:41.414843 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f005811-f272-4c35-be95-0f9c61976f80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:05:41.422490 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-7f005811-f272-4c35-be95-0f9c61976f80 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:05:41.422490 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:05:41.422490 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:05:41.422490 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:05:41.422490 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:05:41.422490 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:05:41.422490 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:05:41.422490 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:05:41.422490 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:05:41.422490 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:05:41.422490 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:05:41.422490 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:05:41.422490 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:05:41.422490 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:05:41.422490 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:05:41.422490 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:05:41.423566 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:05:41.423566 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:05:41.423566 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:05:41.423566 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:05:41.423566 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:05:41.423566 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:05:41.423566 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:05:41.423566 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:05:41.423566 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:05:41.423566 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:05:41.423566 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:05:41.423566 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:05:41.423566 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:05:41.423566 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:05:41.423566 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:05:41.423566 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:05:41.424766 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:05:41.424766 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:05:41.424766 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:05:41.424766 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:05:41.424766 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:05:41.424766 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:05:41.424766 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:05:41.424766 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:05:41.424766 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:05:41.424766 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:05:41.424766 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:05:41.424766 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:05:41.424766 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 574/1149] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 17 18:05:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:05:41.429487 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ce294-52b5-4e22-a7b8-d9a1c7dec18a None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:41.521100 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ce294-52b5-4e22-a7b8-d9a1c7dec18a None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:41.552196 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72c1f0-4f7a-42aa-a828-2c49cf25f12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:41.552836 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72c1f0-4f7a-42aa-a828-2c49cf25f12b None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:41.553111 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72c1f0-4f7a-42aa-a828-2c49cf25f12b None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:41.553380 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72c1f0-4f7a-42aa-a828-2c49cf25f12b None admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:41.554140 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d72c1f0-4f7a-42aa-a828-2c49cf25f12b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:05:41.554436 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d72c1f0-4f7a-42aa-a828-2c49cf25f12b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:41.555786 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d72c1f0-4f7a-42aa-a828-2c49cf25f12b None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:41.563342 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 576/1150] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 17 18:05:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:05:41.569181 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f005811-f272-4c35-be95-0f9c61976f80 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:41.663339 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f005811-f272-4c35-be95-0f9c61976f80 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:41.694875 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522ab8d-bf18-4711-a422-97009d5d9b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:41.695654 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522ab8d-bf18-4711-a422-97009d5d9b35 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:41.695934 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522ab8d-bf18-4711-a422-97009d5d9b35 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:41.696206 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522ab8d-bf18-4711-a422-97009d5d9b35 None admin] PATH_INFO: `/v3/users/259e1466ce294a228ca51d735d8d1691` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:41.697374 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b522ab8d-bf18-4711-a422-97009d5d9b35 None admin] RBAC: Authorizing `identity:get_user(user_id=259e1466ce294a228ca51d735d8d1691)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:41.699359 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b522ab8d-bf18-4711-a422-97009d5d9b35 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:41.700959 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 575/1151] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 17 18:05:41 2022] GET /identity/v3/users/259e1466ce294a228ca51d735d8d1691 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:05:41.706541 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72c1f0-4f7a-42aa-a828-2c49cf25f12b None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:41.799612 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72c1f0-4f7a-42aa-a828-2c49cf25f12b None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:41.831114 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cabc90-ae31-419f-ba37-29f00f61e294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:41.831950 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cabc90-ae31-419f-ba37-29f00f61e294 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:41.832235 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cabc90-ae31-419f-ba37-29f00f61e294 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:41.832509 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cabc90-ae31-419f-ba37-29f00f61e294 None admin] PATH_INFO: `/v3/projects/b6daa48e3ef14cc3a9aad6db6dcb12bb` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:41.833716 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cabc90-ae31-419f-ba37-29f00f61e294 None admin] RBAC: Authorizing `identity:get_project(project_id=b6daa48e3ef14cc3a9aad6db6dcb12bb)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:41.835149 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cabc90-ae31-419f-ba37-29f00f61e294 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:41.836805 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 577/1152] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 17 18:05:41 2022] GET /identity/v3/projects/b6daa48e3ef14cc3a9aad6db6dcb12bb => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:05:41.842948 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522ab8d-bf18-4711-a422-97009d5d9b35 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:41.941896 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522ab8d-bf18-4711-a422-97009d5d9b35 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:41.974697 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1766bd-88cd-4fbd-add9-8a74f617b753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:41.975508 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1766bd-88cd-4fbd-add9-8a74f617b753 None admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:41.975789 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1766bd-88cd-4fbd-add9-8a74f617b753 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:41.976066 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1766bd-88cd-4fbd-add9-8a74f617b753 None admin] PATH_INFO: `/v3/projects/b6daa48e3ef14cc3a9aad6db6dcb12bb/users/259e1466ce294a228ca51d735d8d1691/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:41.978030 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1766bd-88cd-4fbd-add9-8a74f617b753 None admin] RBAC: Authorizing `identity:create_grant(project_id=b6daa48e3ef14cc3a9aad6db6dcb12bb, user_id=259e1466ce294a228ca51d735d8d1691, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:41.979491 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1766bd-88cd-4fbd-add9-8a74f617b753 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:41.992590 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 576/1153] 10.222.0.65 () {58 vars in 1439 bytes} [Tue May 17 18:05:41 2022] PUT /identity/v3/projects/b6daa48e3ef14cc3a9aad6db6dcb12bb/users/259e1466ce294a228ca51d735d8d1691/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:05:44.174601 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef55b2aa-68d4-46da-afa5-1c0e24f4c9d3 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:44.175112 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef55b2aa-68d4-46da-afa5-1c0e24f4c9d3 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:44.175206 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef55b2aa-68d4-46da-afa5-1c0e24f4c9d3 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:44.176506 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 578/1154] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:05:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:05:44.181763 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc29dbc-8c90-43fa-9ae6-ae8f9bec46b2 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:44.182184 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc29dbc-8c90-43fa-9ae6-ae8f9bec46b2 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:44.182316 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc29dbc-8c90-43fa-9ae6-ae8f9bec46b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:44.198813 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-1cc29dbc-8c90-43fa-9ae6-ae8f9bec46b2 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:05:44.200004 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-1cc29dbc-8c90-43fa-9ae6-ae8f9bec46b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:05:44.261894 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 577/1155] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:05:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:05:44.285289 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef55b2aa-68d4-46da-afa5-1c0e24f4c9d3 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:44.381091 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef55b2aa-68d4-46da-afa5-1c0e24f4c9d3 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:44.412216 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10834b-36bc-4735-aa4c-648291a754f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:44.412982 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10834b-36bc-4735-aa4c-648291a754f6 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:44.413262 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10834b-36bc-4735-aa4c-648291a754f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:44.413563 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10834b-36bc-4735-aa4c-648291a754f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:44.424253 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b10834b-36bc-4735-aa4c-648291a754f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:05:44.431840 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-2b10834b-36bc-4735-aa4c-648291a754f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:05:44.431840 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:05:44.431840 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:05:44.431840 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:05:44.431840 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:05:44.431840 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:05:44.431840 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:05:44.431840 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:05:44.431840 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:05:44.431840 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:05:44.431840 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:05:44.431840 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:05:44.431840 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:05:44.431840 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:05:44.431840 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:05:44.431840 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:05:44.433417 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:05:44.433417 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:05:44.433417 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:05:44.433417 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:05:44.433417 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:05:44.433417 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:05:44.433417 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:05:44.433417 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:05:44.433417 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:05:44.433417 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:05:44.433417 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:05:44.433417 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:05:44.433417 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:05:44.433417 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:05:44.433417 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:05:44.433417 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:05:44.434337 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:05:44.434337 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:05:44.434337 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:05:44.434337 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:05:44.434337 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:05:44.434337 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:05:44.434337 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:05:44.434337 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:05:44.434337 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:05:44.434337 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:05:44.434337 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:05:44.434337 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:05:44.434337 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 579/1156] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 17 18:05:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:05:44.439210 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc29dbc-8c90-43fa-9ae6-ae8f9bec46b2 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:44.531645 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc29dbc-8c90-43fa-9ae6-ae8f9bec46b2 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:44.563364 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ed61b-bc1b-4df9-a064-ddb0ff3552ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:44.564003 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ed61b-bc1b-4df9-a064-ddb0ff3552ef None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:44.564277 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ed61b-bc1b-4df9-a064-ddb0ff3552ef None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:44.564545 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ed61b-bc1b-4df9-a064-ddb0ff3552ef None admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:44.565268 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7ed61b-bc1b-4df9-a064-ddb0ff3552ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:05:44.565595 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7ed61b-bc1b-4df9-a064-ddb0ff3552ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:44.566941 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7ed61b-bc1b-4df9-a064-ddb0ff3552ef None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:44.574736 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 578/1157] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 17 18:05:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:05:44.580526 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10834b-36bc-4735-aa4c-648291a754f6 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:44.673506 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10834b-36bc-4735-aa4c-648291a754f6 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:44.705358 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb487fca-2f82-49ed-8f7d-2bfacba068f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:44.706165 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb487fca-2f82-49ed-8f7d-2bfacba068f1 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:44.706446 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb487fca-2f82-49ed-8f7d-2bfacba068f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:44.706720 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb487fca-2f82-49ed-8f7d-2bfacba068f1 None admin] PATH_INFO: `/v3/users/259e1466ce294a228ca51d735d8d1691` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:44.707898 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb487fca-2f82-49ed-8f7d-2bfacba068f1 None admin] RBAC: Authorizing `identity:get_user(user_id=259e1466ce294a228ca51d735d8d1691)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:44.709320 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb487fca-2f82-49ed-8f7d-2bfacba068f1 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:44.710933 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 580/1158] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 17 18:05:44 2022] GET /identity/v3/users/259e1466ce294a228ca51d735d8d1691 => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:05:44.716452 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ed61b-bc1b-4df9-a064-ddb0ff3552ef None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:44.809417 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ed61b-bc1b-4df9-a064-ddb0ff3552ef None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:44.840897 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79919b56-2c7c-4c65-8620-65deb498af56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:44.841559 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79919b56-2c7c-4c65-8620-65deb498af56 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:44.841839 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79919b56-2c7c-4c65-8620-65deb498af56 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:44.842111 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79919b56-2c7c-4c65-8620-65deb498af56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:44.904538 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79919b56-2c7c-4c65-8620-65deb498af56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:44.905993 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79919b56-2c7c-4c65-8620-65deb498af56 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:44.997188 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 579/1159] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 17 18:05:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 18:05:45.003036 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb487fca-2f82-49ed-8f7d-2bfacba068f1 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:45.095971 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb487fca-2f82-49ed-8f7d-2bfacba068f1 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:45.127461 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d17a876-4bb3-44bc-8e8d-d6b008d55eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:45.128290 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17a876-4bb3-44bc-8e8d-d6b008d55eb0 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:45.128570 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17a876-4bb3-44bc-8e8d-d6b008d55eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:45.128844 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17a876-4bb3-44bc-8e8d-d6b008d55eb0 None admin] PATH_INFO: `/v3/projects/b6daa48e3ef14cc3a9aad6db6dcb12bb` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:45.130030 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d17a876-4bb3-44bc-8e8d-d6b008d55eb0 None admin] RBAC: Authorizing `identity:get_project(project_id=b6daa48e3ef14cc3a9aad6db6dcb12bb)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:45.131445 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d17a876-4bb3-44bc-8e8d-d6b008d55eb0 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:45.133120 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 581/1160] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 17 18:05:45 2022] GET /identity/v3/projects/b6daa48e3ef14cc3a9aad6db6dcb12bb => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:05:45.140801 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79919b56-2c7c-4c65-8620-65deb498af56 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:45.234543 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79919b56-2c7c-4c65-8620-65deb498af56 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:45.266337 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9925b7a-1d6b-4a36-9448-17698f65ffcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:45.266918 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9925b7a-1d6b-4a36-9448-17698f65ffcc None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:45.267192 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9925b7a-1d6b-4a36-9448-17698f65ffcc None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:45.267461 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9925b7a-1d6b-4a36-9448-17698f65ffcc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:45.268276 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9925b7a-1d6b-4a36-9448-17698f65ffcc None admin] RBAC: Adding query filter params (role.id=332c8d70fd0f41e2beea20aaead5daa5, scope.project.id=b6daa48e3ef14cc3a9aad6db6dcb12bb, user.id=259e1466ce294a228ca51d735d8d1691) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:05:45.268583 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9925b7a-1d6b-4a36-9448-17698f65ffcc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:45.270036 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9925b7a-1d6b-4a36-9448-17698f65ffcc None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:45.275572 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 580/1161] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 17 18:05:45 2022] GET /identity/v3/role_assignments?user.id=259e1466ce294a228ca51d735d8d1691&scope.project.id=b6daa48e3ef14cc3a9aad6db6dcb12bb&role.id=332c8d70fd0f41e2beea20aaead5daa5 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:05:47.520349 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318d111-18ff-421f-822a-27029194d5b2 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:47.520884 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318d111-18ff-421f-822a-27029194d5b2 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:47.520884 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318d111-18ff-421f-822a-27029194d5b2 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:47.522403 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 582/1162] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:05:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:05:47.528187 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ab38b-8e07-4462-b70b-c8532fb555ee None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:47.528578 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ab38b-8e07-4462-b70b-c8532fb555ee None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:47.528728 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ab38b-8e07-4462-b70b-c8532fb555ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:47.544813 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-8e4ab38b-8e07-4462-b70b-c8532fb555ee None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:05:47.546004 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-8e4ab38b-8e07-4462-b70b-c8532fb555ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:05:47.607763 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 581/1163] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:05:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:05:47.629556 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0318d111-18ff-421f-822a-27029194d5b2 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:47.723129 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0318d111-18ff-421f-822a-27029194d5b2 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:47.754776 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f1edc-242b-4af5-a4ec-c9e361cadf8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:47.755392 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f1edc-242b-4af5-a4ec-c9e361cadf8e None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:47.755666 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f1edc-242b-4af5-a4ec-c9e361cadf8e None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:47.755932 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f1edc-242b-4af5-a4ec-c9e361cadf8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:47.816707 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6f1edc-242b-4af5-a4ec-c9e361cadf8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:47.818358 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6f1edc-242b-4af5-a4ec-c9e361cadf8e None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:47.909204 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 583/1164] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 17 18:05:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 18:05:47.915037 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4ab38b-8e07-4462-b70b-c8532fb555ee None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:48.006553 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4ab38b-8e07-4462-b70b-c8532fb555ee None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:48.038362 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86f109c-47d8-4568-8fa1-d2769936dfa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:48.039139 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f109c-47d8-4568-8fa1-d2769936dfa0 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:48.039419 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f109c-47d8-4568-8fa1-d2769936dfa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:48.039695 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86f109c-47d8-4568-8fa1-d2769936dfa0 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:48.046899 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86f109c-47d8-4568-8fa1-d2769936dfa0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:48.048334 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86f109c-47d8-4568-8fa1-d2769936dfa0 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:48.062143 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-b86f109c-47d8-4568-8fa1-d2769936dfa0 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 17 18:05:48.062143 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:05:48.062143 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 17 18:05:48.062143 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 17 18:05:48.062143 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 18:05:48.062143 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 18:05:48.062143 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 18:05:48.062143 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 18:05:48.062143 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 17 18:05:48.062143 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:05:48.062143 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 18:05:48.062143 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:05:48.062143 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:05:48.062143 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:05:48.062143 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:05:48.062143 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:05:48.062143 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:05:48.063333 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:05:48.063333 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:05:48.063333 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:05:48.063333 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:05:48.063333 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:05:48.063333 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:05:48.063333 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:05:48.063333 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:05:48.063333 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:05:48.063333 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:05:48.063333 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:05:48.063333 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:05:48.063333 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:05:48.063333 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:05:48.063333 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:05:48.063333 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:05:48.064455 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:05:48.064455 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:05:48.064455 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:05:48.064455 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:05:48.064455 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:05:48.064455 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:05:48.064455 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:05:48.064455 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:05:48.064455 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:05:48.064455 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:05:48.064455 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 17 18:05:48.064455 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:05:48.064455 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 17 18:05:48.064455 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:05:48.064455 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 582/1165] 10.222.0.65 () {56 vars in 1117 bytes} [Tue May 17 18:05:47 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:05:48.069427 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f1edc-242b-4af5-a4ec-c9e361cadf8e None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:48.160862 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f1edc-242b-4af5-a4ec-c9e361cadf8e None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:48.192541 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe86bd-7d99-46c9-a69e-88dae79a550b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:48.193443 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe86bd-7d99-46c9-a69e-88dae79a550b None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:48.193761 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe86bd-7d99-46c9-a69e-88dae79a550b None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:48.194037 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe86bd-7d99-46c9-a69e-88dae79a550b None admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:48.194744 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fe86bd-7d99-46c9-a69e-88dae79a550b None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:05:48.195050 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fe86bd-7d99-46c9-a69e-88dae79a550b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:48.196399 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fe86bd-7d99-46c9-a69e-88dae79a550b None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:48.203846 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 584/1166] 10.222.0.65 () {56 vars in 1115 bytes} [Tue May 17 18:05:48 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:05:50.426742 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daadc961-0435-4f9c-9c89-7ec7eefb3863 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:50.427331 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daadc961-0435-4f9c-9c89-7ec7eefb3863 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:50.427331 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daadc961-0435-4f9c-9c89-7ec7eefb3863 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:50.428651 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 583/1167] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:05:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:05:50.434356 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b151b-8f92-4ee6-afad-81f50226738f None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:50.434774 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b151b-8f92-4ee6-afad-81f50226738f None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:50.434921 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b151b-8f92-4ee6-afad-81f50226738f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:50.452573 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-396b151b-8f92-4ee6-afad-81f50226738f None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:05:50.453776 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-396b151b-8f92-4ee6-afad-81f50226738f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:05:50.516153 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 585/1168] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:05:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:05:50.538493 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daadc961-0435-4f9c-9c89-7ec7eefb3863 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:50.634223 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daadc961-0435-4f9c-9c89-7ec7eefb3863 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:50.664865 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a9c5ce-fa6e-44a0-addc-aa5ab91d2258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:50.665516 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9c5ce-fa6e-44a0-addc-aa5ab91d2258 None admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:50.665795 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9c5ce-fa6e-44a0-addc-aa5ab91d2258 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:50.666065 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a9c5ce-fa6e-44a0-addc-aa5ab91d2258 None admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:50.667301 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a9c5ce-fa6e-44a0-addc-aa5ab91d2258 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:50.668642 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a9c5ce-fa6e-44a0-addc-aa5ab91d2258 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:50.683179 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 584/1169] 10.222.0.65 () {60 vars in 1138 bytes} [Tue May 17 18:05:50 2022] POST /identity/v3/domains => generated 267 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:05:52.903754 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d21ebe-159e-44db-b398-465fed83b567 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:52.904270 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d21ebe-159e-44db-b398-465fed83b567 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:52.904368 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d21ebe-159e-44db-b398-465fed83b567 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:52.905693 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 586/1170] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:05:52.910776 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c10ff2-bd0c-4520-8d80-2f8d3db8ad11 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:52.911186 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c10ff2-bd0c-4520-8d80-2f8d3db8ad11 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:52.911322 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c10ff2-bd0c-4520-8d80-2f8d3db8ad11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:52.927979 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-07c10ff2-bd0c-4520-8d80-2f8d3db8ad11 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:05:52.929147 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-07c10ff2-bd0c-4520-8d80-2f8d3db8ad11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:05:52.991473 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 585/1171] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:05:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:05:53.015062 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d21ebe-159e-44db-b398-465fed83b567 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:53.108556 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d21ebe-159e-44db-b398-465fed83b567 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:53.140241 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252019c-10b8-4a55-9ec2-6143a7efc5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:53.141135 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252019c-10b8-4a55-9ec2-6143a7efc5a2 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:53.141414 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252019c-10b8-4a55-9ec2-6143a7efc5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:53.141728 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252019c-10b8-4a55-9ec2-6143a7efc5a2 None admin] PATH_INFO: `/v3/domains/0c64b0a3abef46dbb14c4adc265925be` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:53.152116 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8252019c-10b8-4a55-9ec2-6143a7efc5a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=0c64b0a3abef46dbb14c4adc265925be)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:53.153583 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8252019c-10b8-4a55-9ec2-6143a7efc5a2 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:53.155175 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 587/1172] 10.222.0.65 () {56 vars in 1183 bytes} [Tue May 17 18:05:53 2022] GET /identity/v3/domains/0c64b0a3abef46dbb14c4adc265925be => generated 267 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:05:53.160907 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c10ff2-bd0c-4520-8d80-2f8d3db8ad11 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:53.258440 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c10ff2-bd0c-4520-8d80-2f8d3db8ad11 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:53.289975 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb163c3d-1e44-4363-a958-4379f5acd8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:53.290614 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb163c3d-1e44-4363-a958-4379f5acd8ba None admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:53.290890 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb163c3d-1e44-4363-a958-4379f5acd8ba None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:53.291158 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb163c3d-1e44-4363-a958-4379f5acd8ba None admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:53.292430 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb163c3d-1e44-4363-a958-4379f5acd8ba None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:53.293872 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb163c3d-1e44-4363-a958-4379f5acd8ba None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:53.317131 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 586/1173] 10.222.0.65 () {60 vars in 1141 bytes} [Tue May 17 18:05:53 2022] POST /identity/v3/projects => generated 361 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:05:55.581708 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5fa8b-de20-4a6a-9f03-3d55b6028ddb None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:55.582266 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5fa8b-de20-4a6a-9f03-3d55b6028ddb None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:55.582266 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5fa8b-de20-4a6a-9f03-3d55b6028ddb None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:55.583617 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 588/1174] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:05:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:05:55.589649 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ecbd1-d136-4e2c-900a-ab1e8d1d0cc1 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:55.590027 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ecbd1-d136-4e2c-900a-ab1e8d1d0cc1 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:55.590197 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ecbd1-d136-4e2c-900a-ab1e8d1d0cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:55.606858 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-5f3ecbd1-d136-4e2c-900a-ab1e8d1d0cc1 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:05:55.608015 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-5f3ecbd1-d136-4e2c-900a-ab1e8d1d0cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:05:55.670048 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 587/1175] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:05:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:05:55.694977 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5fa8b-de20-4a6a-9f03-3d55b6028ddb None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:55.789892 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5fa8b-de20-4a6a-9f03-3d55b6028ddb None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:55.821765 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d64cd-3a40-4b8a-8d16-e5814797117f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:55.822597 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d64cd-3a40-4b8a-8d16-e5814797117f None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:55.822912 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d64cd-3a40-4b8a-8d16-e5814797117f None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:55.823182 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d64cd-3a40-4b8a-8d16-e5814797117f None admin] PATH_INFO: `/v3/domains/0c64b0a3abef46dbb14c4adc265925be` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:55.824332 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062d64cd-3a40-4b8a-8d16-e5814797117f None admin] RBAC: Authorizing `identity:get_domain(domain_id=0c64b0a3abef46dbb14c4adc265925be)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:55.825774 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062d64cd-3a40-4b8a-8d16-e5814797117f None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:55.827339 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 589/1176] 10.222.0.65 () {56 vars in 1183 bytes} [Tue May 17 18:05:55 2022] GET /identity/v3/domains/0c64b0a3abef46dbb14c4adc265925be => generated 267 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:05:55.833067 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3ecbd1-d136-4e2c-900a-ab1e8d1d0cc1 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:55.924509 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3ecbd1-d136-4e2c-900a-ab1e8d1d0cc1 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:55.956112 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e1db9-23b6-4aab-a29a-cc8c634f8523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:55.956765 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e1db9-23b6-4aab-a29a-cc8c634f8523 None admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:55.957038 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e1db9-23b6-4aab-a29a-cc8c634f8523 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:55.957307 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e1db9-23b6-4aab-a29a-cc8c634f8523 None admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:55.958025 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8e1db9-23b6-4aab-a29a-cc8c634f8523 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:55.959426 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8e1db9-23b6-4aab-a29a-cc8c634f8523 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:55.978531 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 588/1177] 10.222.0.65 () {60 vars in 1132 bytes} [Tue May 17 18:05:55 2022] POST /identity/v3/users => generated 311 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:05:58.246205 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1598990-3d55-48bc-94d8-3a9640cf82d8 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:58.246760 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1598990-3d55-48bc-94d8-3a9640cf82d8 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:58.246760 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1598990-3d55-48bc-94d8-3a9640cf82d8 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:58.248079 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 590/1178] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:05:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:05:58.253327 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d879dea-b6c9-4b3a-bf17-0b24b92a1cff None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:58.253785 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d879dea-b6c9-4b3a-bf17-0b24b92a1cff None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:58.253912 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d879dea-b6c9-4b3a-bf17-0b24b92a1cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:58.270072 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-1d879dea-b6c9-4b3a-bf17-0b24b92a1cff None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:05:58.271250 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-1d879dea-b6c9-4b3a-bf17-0b24b92a1cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:05:58.340902 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 589/1179] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:05:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:05:58.364578 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1598990-3d55-48bc-94d8-3a9640cf82d8 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:58.458090 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1598990-3d55-48bc-94d8-3a9640cf82d8 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:58.489189 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef16a7-bbbf-4711-a4d2-14968a782866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:58.489983 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef16a7-bbbf-4711-a4d2-14968a782866 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:58.490258 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef16a7-bbbf-4711-a4d2-14968a782866 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:58.490523 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ef16a7-bbbf-4711-a4d2-14968a782866 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:58.500355 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ef16a7-bbbf-4711-a4d2-14968a782866 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:05:58.507725 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-f3ef16a7-bbbf-4711-a4d2-14968a782866 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:05:58.507725 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:05:58.507725 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:05:58.507725 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:05:58.507725 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:05:58.507725 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:05:58.507725 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:05:58.507725 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:05:58.507725 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:05:58.507725 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:05:58.507725 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:05:58.507725 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:05:58.507725 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:05:58.507725 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:05:58.507725 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:05:58.507725 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:05:58.508887 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:05:58.508887 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:05:58.508887 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:05:58.508887 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:05:58.508887 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:05:58.508887 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:05:58.508887 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:05:58.508887 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:05:58.508887 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:05:58.508887 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:05:58.508887 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:05:58.508887 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:05:58.508887 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:05:58.508887 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:05:58.508887 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:05:58.508887 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:05:58.510015 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:05:58.510015 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:05:58.510015 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:05:58.510015 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:05:58.510015 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:05:58.510015 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:05:58.510015 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:05:58.510015 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:05:58.510015 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:05:58.510015 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:05:58.510015 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:05:58.510015 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:05:58.510015 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 591/1180] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 17 18:05:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:05:58.514753 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d879dea-b6c9-4b3a-bf17-0b24b92a1cff None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:58.607272 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d879dea-b6c9-4b3a-bf17-0b24b92a1cff None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:58.638313 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26df877-638f-47ef-a72f-df69da7700d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:58.638960 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26df877-638f-47ef-a72f-df69da7700d0 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:58.639239 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26df877-638f-47ef-a72f-df69da7700d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:58.639512 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26df877-638f-47ef-a72f-df69da7700d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:58.640245 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26df877-638f-47ef-a72f-df69da7700d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:05:58.640547 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26df877-638f-47ef-a72f-df69da7700d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:58.641933 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26df877-638f-47ef-a72f-df69da7700d0 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:58.649576 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 590/1181] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 17 18:05:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:05:58.655570 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef16a7-bbbf-4711-a4d2-14968a782866 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:58.747348 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ef16a7-bbbf-4711-a4d2-14968a782866 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:58.779058 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d50dba-e57e-4fc0-a43d-d9f660af53d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:58.779844 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d50dba-e57e-4fc0-a43d-d9f660af53d5 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:58.780119 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d50dba-e57e-4fc0-a43d-d9f660af53d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:58.780385 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d50dba-e57e-4fc0-a43d-d9f660af53d5 None admin] PATH_INFO: `/v3/users/0c56507df4274d2a99f29a7a18e383f2` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:58.792422 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d50dba-e57e-4fc0-a43d-d9f660af53d5 None admin] RBAC: Authorizing `identity:get_user(user_id=0c56507df4274d2a99f29a7a18e383f2)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:58.793872 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d50dba-e57e-4fc0-a43d-d9f660af53d5 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:58.795453 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 592/1182] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 17 18:05:58 2022] GET /identity/v3/users/0c56507df4274d2a99f29a7a18e383f2 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:05:58.801028 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26df877-638f-47ef-a72f-df69da7700d0 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:58.894007 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26df877-638f-47ef-a72f-df69da7700d0 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:58.925356 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309295ae-b59b-4812-bb5f-0ed377642baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:58.926011 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309295ae-b59b-4812-bb5f-0ed377642baa None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:58.926286 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309295ae-b59b-4812-bb5f-0ed377642baa None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:58.926556 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309295ae-b59b-4812-bb5f-0ed377642baa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:58.989522 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309295ae-b59b-4812-bb5f-0ed377642baa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:58.990970 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309295ae-b59b-4812-bb5f-0ed377642baa None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:59.082085 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 591/1183] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 17 18:05:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 18:05:59.087803 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d50dba-e57e-4fc0-a43d-d9f660af53d5 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:59.179883 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d50dba-e57e-4fc0-a43d-d9f660af53d5 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:59.212201 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7496a4-0d9f-4586-904b-8b5b5acc0a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:59.213022 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7496a4-0d9f-4586-904b-8b5b5acc0a30 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:59.214076 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7496a4-0d9f-4586-904b-8b5b5acc0a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:59.214405 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7496a4-0d9f-4586-904b-8b5b5acc0a30 None admin] PATH_INFO: `/v3/projects/e106e710fd7d4929b0b920c82dceed4e` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:59.215662 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7496a4-0d9f-4586-904b-8b5b5acc0a30 None admin] RBAC: Authorizing `identity:get_project(project_id=e106e710fd7d4929b0b920c82dceed4e)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:59.217078 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7496a4-0d9f-4586-904b-8b5b5acc0a30 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:59.218772 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 593/1184] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 17 18:05:59 2022] GET /identity/v3/projects/e106e710fd7d4929b0b920c82dceed4e => generated 361 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:05:59.224719 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309295ae-b59b-4812-bb5f-0ed377642baa None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:59.319984 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309295ae-b59b-4812-bb5f-0ed377642baa None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:59.351553 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29523d9b-8dfc-4032-9c0a-25d093ec8e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:59.352136 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29523d9b-8dfc-4032-9c0a-25d093ec8e1b None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:59.352413 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29523d9b-8dfc-4032-9c0a-25d093ec8e1b None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:59.352685 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29523d9b-8dfc-4032-9c0a-25d093ec8e1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:59.353524 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29523d9b-8dfc-4032-9c0a-25d093ec8e1b None admin] RBAC: Adding query filter params (role.id=332c8d70fd0f41e2beea20aaead5daa5, scope.project.id=e106e710fd7d4929b0b920c82dceed4e, user.id=0c56507df4274d2a99f29a7a18e383f2) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:05:59.353833 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29523d9b-8dfc-4032-9c0a-25d093ec8e1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:59.355265 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29523d9b-8dfc-4032-9c0a-25d093ec8e1b None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:59.360442 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 592/1185] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 17 18:05:59 2022] GET /identity/v3/role_assignments?user.id=0c56507df4274d2a99f29a7a18e383f2&scope.project.id=e106e710fd7d4929b0b920c82dceed4e&role.id=332c8d70fd0f41e2beea20aaead5daa5 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:06:01.501860 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4fdcc-70d2-40a2-9ebe-9e1a81d39725 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:06:01.502391 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4fdcc-70d2-40a2-9ebe-9e1a81d39725 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:06:01.502391 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b4fdcc-70d2-40a2-9ebe-9e1a81d39725 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:06:01.503737 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 594/1186] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:06:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:06:01.509129 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f2150-000f-4535-a41f-f4034e52f146 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:06:01.509572 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f2150-000f-4535-a41f-f4034e52f146 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:06:01.509700 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f2150-000f-4535-a41f-f4034e52f146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:06:01.526310 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-e43f2150-000f-4535-a41f-f4034e52f146 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:06:01.527489 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-e43f2150-000f-4535-a41f-f4034e52f146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:06:01.589292 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 593/1187] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:06:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:06:01.611219 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b4fdcc-70d2-40a2-9ebe-9e1a81d39725 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:06:01.704990 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b4fdcc-70d2-40a2-9ebe-9e1a81d39725 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:06:01.735950 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd1ed0-f579-4bff-a348-08ba72d98d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:06:01.736706 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd1ed0-f579-4bff-a348-08ba72d98d3d None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:06:01.736978 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd1ed0-f579-4bff-a348-08ba72d98d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:06:01.737241 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd1ed0-f579-4bff-a348-08ba72d98d3d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:06:01.747128 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbd1ed0-f579-4bff-a348-08ba72d98d3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:06:01.754572 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-8fbd1ed0-f579-4bff-a348-08ba72d98d3d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:06:01.754572 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:06:01.754572 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:06:01.754572 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:06:01.754572 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:06:01.754572 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:06:01.754572 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:06:01.754572 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:06:01.754572 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:06:01.754572 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:06:01.754572 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:06:01.754572 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:06:01.754572 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:06:01.754572 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:06:01.754572 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:06:01.754572 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:06:01.755697 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:06:01.755697 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:06:01.755697 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:06:01.755697 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:06:01.755697 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:06:01.755697 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:06:01.755697 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:06:01.755697 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:06:01.755697 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:06:01.755697 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:06:01.755697 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:06:01.755697 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:06:01.755697 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:06:01.755697 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:06:01.755697 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:06:01.755697 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:06:01.756590 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:06:01.756590 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:06:01.756590 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:06:01.756590 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:06:01.756590 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:06:01.756590 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:06:01.756590 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:06:01.756590 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:06:01.756590 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:06:01.756590 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:06:01.756590 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:06:01.756590 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:06:01.756590 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 595/1188] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 17 18:06:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:06:01.761421 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f2150-000f-4535-a41f-f4034e52f146 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:06:01.852137 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f2150-000f-4535-a41f-f4034e52f146 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:06:01.883091 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d221efc3-c6c6-429e-8b29-06ca679fab1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:06:01.883735 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d221efc3-c6c6-429e-8b29-06ca679fab1d None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:06:01.884093 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d221efc3-c6c6-429e-8b29-06ca679fab1d None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:06:01.884365 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d221efc3-c6c6-429e-8b29-06ca679fab1d None admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:06:01.885625 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d221efc3-c6c6-429e-8b29-06ca679fab1d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:06:01.885921 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d221efc3-c6c6-429e-8b29-06ca679fab1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:06:01.887265 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d221efc3-c6c6-429e-8b29-06ca679fab1d None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:06:01.894805 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 594/1189] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 17 18:06:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:06:01.900543 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd1ed0-f579-4bff-a348-08ba72d98d3d None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:06:01.993549 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd1ed0-f579-4bff-a348-08ba72d98d3d None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:06:02.024722 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd0cac-d505-47f8-ac31-e0df231d86b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:06:02.025528 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd0cac-d505-47f8-ac31-e0df231d86b7 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:06:02.026364 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd0cac-d505-47f8-ac31-e0df231d86b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:06:02.026635 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd0cac-d505-47f8-ac31-e0df231d86b7 None admin] PATH_INFO: `/v3/users/0c56507df4274d2a99f29a7a18e383f2` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:06:02.027807 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbd0cac-d505-47f8-ac31-e0df231d86b7 None admin] RBAC: Authorizing `identity:get_user(user_id=0c56507df4274d2a99f29a7a18e383f2)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:06:02.029231 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbd0cac-d505-47f8-ac31-e0df231d86b7 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:06:02.030828 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 596/1190] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 17 18:06:01 2022] GET /identity/v3/users/0c56507df4274d2a99f29a7a18e383f2 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:06:02.036238 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d221efc3-c6c6-429e-8b29-06ca679fab1d None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:06:02.128528 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d221efc3-c6c6-429e-8b29-06ca679fab1d None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:06:02.159294 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b602f6-8368-43cf-aa06-2858efaf1274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:06:02.160121 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b602f6-8368-43cf-aa06-2858efaf1274 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:06:02.160395 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b602f6-8368-43cf-aa06-2858efaf1274 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:06:02.160661 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b602f6-8368-43cf-aa06-2858efaf1274 None admin] PATH_INFO: `/v3/projects/e106e710fd7d4929b0b920c82dceed4e` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:06:02.161820 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b602f6-8368-43cf-aa06-2858efaf1274 None admin] RBAC: Authorizing `identity:get_project(project_id=e106e710fd7d4929b0b920c82dceed4e)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:06:02.163215 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b602f6-8368-43cf-aa06-2858efaf1274 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:06:02.164847 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 595/1191] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 17 18:06:02 2022] GET /identity/v3/projects/e106e710fd7d4929b0b920c82dceed4e => generated 361 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:06:02.170543 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd0cac-d505-47f8-ac31-e0df231d86b7 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:06:02.263049 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd0cac-d505-47f8-ac31-e0df231d86b7 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:06:02.293741 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd0927-1863-464a-bb29-206e883476d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:06:02.294551 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd0927-1863-464a-bb29-206e883476d9 None admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:06:02.294830 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd0927-1863-464a-bb29-206e883476d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:06:02.295097 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd0927-1863-464a-bb29-206e883476d9 None admin] PATH_INFO: `/v3/projects/e106e710fd7d4929b0b920c82dceed4e/users/0c56507df4274d2a99f29a7a18e383f2/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:06:02.297014 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dd0927-1863-464a-bb29-206e883476d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=e106e710fd7d4929b0b920c82dceed4e, user_id=0c56507df4274d2a99f29a7a18e383f2, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:06:02.298458 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dd0927-1863-464a-bb29-206e883476d9 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:06:02.310646 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 597/1192] 10.222.0.65 () {58 vars in 1439 bytes} [Tue May 17 18:06:02 2022] PUT /identity/v3/projects/e106e710fd7d4929b0b920c82dceed4e/users/0c56507df4274d2a99f29a7a18e383f2/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:06:04.462892 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfccc24-0c14-4303-a7e6-6981e73f5e69 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:06:04.463958 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfccc24-0c14-4303-a7e6-6981e73f5e69 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:06:04.463958 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfccc24-0c14-4303-a7e6-6981e73f5e69 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:06:04.465331 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 596/1193] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:06:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:06:04.470504 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445aa60a-3fb7-41b1-91e8-2f7a980b8200 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:06:04.470892 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445aa60a-3fb7-41b1-91e8-2f7a980b8200 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:06:04.471042 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445aa60a-3fb7-41b1-91e8-2f7a980b8200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:06:04.487110 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-445aa60a-3fb7-41b1-91e8-2f7a980b8200 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:06:04.488265 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-445aa60a-3fb7-41b1-91e8-2f7a980b8200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:06:04.549540 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 598/1194] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:06:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:06:04.572730 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfccc24-0c14-4303-a7e6-6981e73f5e69 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:06:04.667611 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfccc24-0c14-4303-a7e6-6981e73f5e69 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:06:04.699283 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c016106-e6b1-4eb7-9dd1-e51114b76ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:06:04.700034 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c016106-e6b1-4eb7-9dd1-e51114b76ff1 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:06:04.700308 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c016106-e6b1-4eb7-9dd1-e51114b76ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:06:04.700576 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c016106-e6b1-4eb7-9dd1-e51114b76ff1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:06:04.710401 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c016106-e6b1-4eb7-9dd1-e51114b76ff1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:06:04.717818 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-0c016106-e6b1-4eb7-9dd1-e51114b76ff1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:06:04.717818 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:06:04.717818 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:06:04.717818 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:06:04.717818 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:06:04.717818 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:06:04.717818 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:06:04.717818 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:06:04.717818 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:06:04.717818 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:06:04.717818 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:06:04.717818 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:06:04.717818 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:06:04.717818 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:06:04.717818 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:06:04.717818 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:06:04.718919 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:06:04.718919 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:06:04.718919 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:06:04.718919 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:06:04.718919 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:06:04.718919 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:06:04.718919 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:06:04.718919 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:06:04.718919 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:06:04.718919 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:06:04.718919 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:06:04.718919 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:06:04.718919 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:06:04.718919 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:06:04.718919 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:06:04.718919 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:06:04.720139 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:06:04.720139 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:06:04.720139 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:06:04.720139 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:06:04.720139 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:06:04.720139 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:06:04.720139 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:06:04.720139 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:06:04.720139 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:06:04.720139 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:06:04.720139 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:06:04.720139 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:06:04.720139 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 597/1195] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 17 18:06:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:06:04.724671 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445aa60a-3fb7-41b1-91e8-2f7a980b8200 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:06:04.824647 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445aa60a-3fb7-41b1-91e8-2f7a980b8200 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:06:04.856476 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0479000-6442-47c2-bfc4-d9673f45b6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:06:04.857130 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0479000-6442-47c2-bfc4-d9673f45b6d8 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:06:04.857405 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0479000-6442-47c2-bfc4-d9673f45b6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:06:04.857766 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0479000-6442-47c2-bfc4-d9673f45b6d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:06:04.858502 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0479000-6442-47c2-bfc4-d9673f45b6d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:06:04.858801 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0479000-6442-47c2-bfc4-d9673f45b6d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:06:04.860168 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0479000-6442-47c2-bfc4-d9673f45b6d8 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:06:04.867825 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 599/1196] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 17 18:06:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:06:04.874096 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c016106-e6b1-4eb7-9dd1-e51114b76ff1 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:06:04.967158 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c016106-e6b1-4eb7-9dd1-e51114b76ff1 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:06:04.999374 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107fa19-4b5c-4584-9244-db038903eaf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:06:05.000159 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107fa19-4b5c-4584-9244-db038903eaf6 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:06:05.000439 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107fa19-4b5c-4584-9244-db038903eaf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:06:05.000713 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107fa19-4b5c-4584-9244-db038903eaf6 None admin] PATH_INFO: `/v3/users/0c56507df4274d2a99f29a7a18e383f2` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:06:05.001910 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8107fa19-4b5c-4584-9244-db038903eaf6 None admin] RBAC: Authorizing `identity:get_user(user_id=0c56507df4274d2a99f29a7a18e383f2)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:06:05.003333 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8107fa19-4b5c-4584-9244-db038903eaf6 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:06:05.004925 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 598/1197] 10.222.0.65 () {56 vars in 1177 bytes} [Tue May 17 18:06:04 2022] GET /identity/v3/users/0c56507df4274d2a99f29a7a18e383f2 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:06:05.010465 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0479000-6442-47c2-bfc4-d9673f45b6d8 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:06:05.104032 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0479000-6442-47c2-bfc4-d9673f45b6d8 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:06:05.137048 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5007fb-d0d9-479e-9e31-48728c4930ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:06:05.137724 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5007fb-d0d9-479e-9e31-48728c4930ed None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:06:05.138000 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5007fb-d0d9-479e-9e31-48728c4930ed None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:06:05.138270 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5007fb-d0d9-479e-9e31-48728c4930ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:06:05.203975 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5007fb-d0d9-479e-9e31-48728c4930ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:06:05.205408 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5007fb-d0d9-479e-9e31-48728c4930ed None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:06:05.295191 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 600/1198] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 17 18:06:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 18:06:05.300963 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107fa19-4b5c-4584-9244-db038903eaf6 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:06:05.396815 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107fa19-4b5c-4584-9244-db038903eaf6 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:06:05.427635 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e84af14-494b-45f6-9d3f-0ccd594c93cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:06:05.428463 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e84af14-494b-45f6-9d3f-0ccd594c93cb None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:06:05.428739 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e84af14-494b-45f6-9d3f-0ccd594c93cb None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:06:05.429011 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e84af14-494b-45f6-9d3f-0ccd594c93cb None admin] PATH_INFO: `/v3/projects/e106e710fd7d4929b0b920c82dceed4e` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:06:05.430186 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e84af14-494b-45f6-9d3f-0ccd594c93cb None admin] RBAC: Authorizing `identity:get_project(project_id=e106e710fd7d4929b0b920c82dceed4e)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:06:05.431598 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e84af14-494b-45f6-9d3f-0ccd594c93cb None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:06:05.434006 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 599/1199] 10.222.0.65 () {56 vars in 1186 bytes} [Tue May 17 18:06:05 2022] GET /identity/v3/projects/e106e710fd7d4929b0b920c82dceed4e => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:06:05.440849 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5007fb-d0d9-479e-9e31-48728c4930ed None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:06:05.542935 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5007fb-d0d9-479e-9e31-48728c4930ed None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:06:05.574622 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532838b2-e52b-43ee-9a0e-b0bf910e0416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:06:05.575198 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532838b2-e52b-43ee-9a0e-b0bf910e0416 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:06:05.575472 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532838b2-e52b-43ee-9a0e-b0bf910e0416 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:06:05.575742 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532838b2-e52b-43ee-9a0e-b0bf910e0416 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:06:05.576556 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532838b2-e52b-43ee-9a0e-b0bf910e0416 None admin] RBAC: Adding query filter params (role.id=332c8d70fd0f41e2beea20aaead5daa5, scope.project.id=e106e710fd7d4929b0b920c82dceed4e, user.id=0c56507df4274d2a99f29a7a18e383f2) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:06:05.576860 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532838b2-e52b-43ee-9a0e-b0bf910e0416 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:06:05.578292 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532838b2-e52b-43ee-9a0e-b0bf910e0416 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:06:05.583781 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 601/1200] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 17 18:06:05 2022] GET /identity/v3/role_assignments?user.id=0c56507df4274d2a99f29a7a18e383f2&scope.project.id=e106e710fd7d4929b0b920c82dceed4e&role.id=332c8d70fd0f41e2beea20aaead5daa5 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:07:06.007023 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e40fd-bee6-4277-9997-420e483b788b None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:06.007646 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e40fd-bee6-4277-9997-420e483b788b None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:06.007738 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e40fd-bee6-4277-9997-420e483b788b None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:06.010447 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 600/1201] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:07:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 18:07:06.017445 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8041c31-2cac-48fd-8c22-f7c40e7347a6 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:06.018012 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8041c31-2cac-48fd-8c22-f7c40e7347a6 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:06.018287 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8041c31-2cac-48fd-8c22-f7c40e7347a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:06.039533 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-c8041c31-2cac-48fd-8c22-f7c40e7347a6 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:07:06.040727 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-c8041c31-2cac-48fd-8c22-f7c40e7347a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:07:06.126825 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 602/1202] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:07:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:07:06.169030 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606e40fd-bee6-4277-9997-420e483b788b None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:06.317303 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606e40fd-bee6-4277-9997-420e483b788b None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:06.361599 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c754ac5-2f7e-4134-9aa6-33fbb27beee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:06.362480 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c754ac5-2f7e-4134-9aa6-33fbb27beee7 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:06.362822 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c754ac5-2f7e-4134-9aa6-33fbb27beee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:06.363104 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c754ac5-2f7e-4134-9aa6-33fbb27beee7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:06.375749 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c754ac5-2f7e-4134-9aa6-33fbb27beee7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:06.377603 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c754ac5-2f7e-4134-9aa6-33fbb27beee7 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:06.404744 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-7c754ac5-2f7e-4134-9aa6-33fbb27beee7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:07:06.404744 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:07:06.404744 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:07:06.404744 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:07:06.404744 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:07:06.404744 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:07:06.404744 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:07:06.404744 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:07:06.404744 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:07:06.404744 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:07:06.404744 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:07:06.404744 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:07:06.404744 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:07:06.404744 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:07:06.404744 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:07:06.406336 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:07:06.406336 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:07:06.406336 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:07:06.406336 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:07:06.406336 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:07:06.406336 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:07:06.406336 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:07:06.406336 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:07:06.406336 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:07:06.406336 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:07:06.406336 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:07:06.406336 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:07:06.406336 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:07:06.406336 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:07:06.406336 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:07:06.406336 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:07:06.406336 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:07:06.407317 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:07:06.407317 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:07:06.407317 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:07:06.407317 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:07:06.407317 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 601/1203] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:07:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:07:06.412424 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8041c31-2cac-48fd-8c22-f7c40e7347a6 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:06.535604 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8041c31-2cac-48fd-8c22-f7c40e7347a6 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:06.580741 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf25f1f-d037-499f-9a66-43e5db8c9fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:06.581413 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf25f1f-d037-499f-9a66-43e5db8c9fae None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:06.581715 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf25f1f-d037-499f-9a66-43e5db8c9fae None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:06.581992 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf25f1f-d037-499f-9a66-43e5db8c9fae None admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:06.582711 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf25f1f-d037-499f-9a66-43e5db8c9fae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:07:06.583014 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf25f1f-d037-499f-9a66-43e5db8c9fae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:06.584384 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf25f1f-d037-499f-9a66-43e5db8c9fae None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:06.598214 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 603/1204] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:07:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:07:06.605290 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c754ac5-2f7e-4134-9aa6-33fbb27beee7 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:06.730028 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c754ac5-2f7e-4134-9aa6-33fbb27beee7 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:06.769792 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0abba11-592d-4fa0-a826-3ee2b8bea401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:06.770634 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0abba11-592d-4fa0-a826-3ee2b8bea401 None admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:06.773891 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0abba11-592d-4fa0-a826-3ee2b8bea401 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:06.773891 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0abba11-592d-4fa0-a826-3ee2b8bea401 None admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:06.773891 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0abba11-592d-4fa0-a826-3ee2b8bea401 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:06.773891 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0abba11-592d-4fa0-a826-3ee2b8bea401 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:06.801502 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 602/1205] 10.222.0.65 () {60 vars in 1132 bytes} [Tue May 17 18:07:06 2022] POST /identity/v3/users => generated 251 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:07:09.303880 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a627c-21ba-4fe3-8543-b4eca4d92643 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:09.304490 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a627c-21ba-4fe3-8543-b4eca4d92643 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:09.304490 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a627c-21ba-4fe3-8543-b4eca4d92643 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:09.306502 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 604/1206] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:07:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:07:09.312345 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d74be3-8679-43dd-8b90-0a78c6baaac6 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:09.312834 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d74be3-8679-43dd-8b90-0a78c6baaac6 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:09.312934 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d74be3-8679-43dd-8b90-0a78c6baaac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:09.331590 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-59d74be3-8679-43dd-8b90-0a78c6baaac6 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:07:09.332931 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-59d74be3-8679-43dd-8b90-0a78c6baaac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:07:09.407401 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 603/1207] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:07:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:07:09.432129 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a627c-21ba-4fe3-8543-b4eca4d92643 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:09.543338 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a627c-21ba-4fe3-8543-b4eca4d92643 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:09.580354 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ba390-cf54-46c0-bf75-1abb710fe575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:09.581227 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ba390-cf54-46c0-bf75-1abb710fe575 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:09.581534 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ba390-cf54-46c0-bf75-1abb710fe575 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:09.581809 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ba390-cf54-46c0-bf75-1abb710fe575 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:09.593835 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48ba390-cf54-46c0-bf75-1abb710fe575 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:07:09.602074 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-f48ba390-cf54-46c0-bf75-1abb710fe575 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 18:07:09.602074 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:07:09.602074 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:07:09.602074 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:07:09.602074 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:07:09.602074 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:07:09.602074 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:07:09.602074 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:07:09.602074 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:07:09.602074 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:07:09.602074 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:07:09.602074 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:07:09.602074 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:07:09.602074 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:07:09.602074 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:07:09.602074 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:07:09.603447 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:07:09.603447 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:07:09.603447 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:07:09.603447 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:07:09.603447 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:07:09.603447 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:07:09.603447 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:07:09.603447 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:07:09.603447 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:07:09.603447 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:07:09.603447 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:07:09.603447 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:07:09.603447 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:07:09.603447 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:07:09.603447 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:07:09.603447 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:07:09.604818 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:07:09.604818 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:07:09.604818 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:07:09.604818 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:07:09.604818 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:07:09.604818 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:07:09.604818 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:07:09.604818 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:07:09.604818 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:07:09.604818 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:07:09.604818 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 18:07:09.604818 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:07:09.604818 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 605/1208] 10.222.0.65 () {56 vars in 1102 bytes} [Tue May 17 18:07:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:07:09.609597 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d74be3-8679-43dd-8b90-0a78c6baaac6 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:09.723797 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d74be3-8679-43dd-8b90-0a78c6baaac6 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:09.760188 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b0e98-2bf0-4a61-9c7d-6d20df3b596a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:09.761004 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b0e98-2bf0-4a61-9c7d-6d20df3b596a None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:09.761386 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b0e98-2bf0-4a61-9c7d-6d20df3b596a None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:09.761794 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b0e98-2bf0-4a61-9c7d-6d20df3b596a None admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:09.762643 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b0e98-2bf0-4a61-9c7d-6d20df3b596a None admin] RBAC: Adding query filter params (name=service) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:07:09.763428 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b0e98-2bf0-4a61-9c7d-6d20df3b596a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:09.764521 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b0e98-2bf0-4a61-9c7d-6d20df3b596a None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:09.773038 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 604/1209] 10.222.0.65 () {56 vars in 1103 bytes} [Tue May 17 18:07:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:07:09.778866 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ba390-cf54-46c0-bf75-1abb710fe575 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:09.890892 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ba390-cf54-46c0-bf75-1abb710fe575 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:09.929448 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db495799-8ad1-4d2d-a9ad-99c400330ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:09.930973 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db495799-8ad1-4d2d-a9ad-99c400330ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:09.931351 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db495799-8ad1-4d2d-a9ad-99c400330ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:09.931725 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db495799-8ad1-4d2d-a9ad-99c400330ed4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:09.943870 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db495799-8ad1-4d2d-a9ad-99c400330ed4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:09.946114 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db495799-8ad1-4d2d-a9ad-99c400330ed4 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:09.965261 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-db495799-8ad1-4d2d-a9ad-99c400330ed4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:07:09.965261 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:07:09.965261 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:07:09.965261 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:07:09.965261 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:07:09.965261 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:07:09.965261 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:07:09.965261 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:07:09.965261 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:07:09.965261 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:07:09.965261 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:07:09.965261 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:07:09.965261 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:07:09.965261 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:07:09.965261 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:07:09.966494 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:07:09.966494 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:07:09.966494 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:07:09.966494 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:07:09.966494 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:07:09.966494 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:07:09.966494 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:07:09.966494 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:07:09.966494 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:07:09.966494 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:07:09.966494 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:07:09.966494 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:07:09.966494 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:07:09.966494 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:07:09.966494 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:07:09.966494 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:07:09.966494 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:07:09.967628 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:07:09.967628 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:07:09.967628 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:07:09.967628 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:07:09.967628 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 606/1210] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:07:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:07:09.973665 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b0e98-2bf0-4a61-9c7d-6d20df3b596a None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:10.086060 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b0e98-2bf0-4a61-9c7d-6d20df3b596a None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:10.125408 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87ba48-66a4-4f8d-a133-c4bdaa92848b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:10.126248 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87ba48-66a4-4f8d-a133-c4bdaa92848b None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:10.126513 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87ba48-66a4-4f8d-a133-c4bdaa92848b None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:10.126891 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87ba48-66a4-4f8d-a133-c4bdaa92848b None admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:10.127649 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd87ba48-66a4-4f8d-a133-c4bdaa92848b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:07:10.127973 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd87ba48-66a4-4f8d-a133-c4bdaa92848b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:10.129317 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd87ba48-66a4-4f8d-a133-c4bdaa92848b None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:10.144683 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 605/1211] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:07:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:07:10.150602 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db495799-8ad1-4d2d-a9ad-99c400330ed4 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:10.273769 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db495799-8ad1-4d2d-a9ad-99c400330ed4 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:10.317083 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e71a44-1f6d-407e-bb89-5da05d72efb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:10.318261 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e71a44-1f6d-407e-bb89-5da05d72efb5 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:10.318536 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e71a44-1f6d-407e-bb89-5da05d72efb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:10.318841 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e71a44-1f6d-407e-bb89-5da05d72efb5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:10.329495 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e71a44-1f6d-407e-bb89-5da05d72efb5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:10.331106 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e71a44-1f6d-407e-bb89-5da05d72efb5 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:10.347937 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-64e71a44-1f6d-407e-bb89-5da05d72efb5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 17 18:07:10.347937 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:07:10.347937 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:07:10.347937 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:07:10.347937 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:07:10.347937 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:07:10.347937 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:07:10.347937 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:07:10.347937 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:07:10.347937 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:07:10.347937 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:07:10.347937 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:07:10.347937 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 18:07:10.347937 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 18:07:10.347937 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 18:07:10.347937 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 18:07:10.349193 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:07:10.349193 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:07:10.349193 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 18:07:10.349193 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:07:10.349193 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 18:07:10.349193 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:07:10.349193 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:07:10.349193 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:07:10.349193 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:07:10.349193 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:07:10.349193 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:07:10.349193 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:07:10.349193 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:07:10.349193 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:07:10.349193 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:07:10.349193 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:07:10.349193 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:07:10.349193 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:07:10.355295 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:07:10.355295 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:07:10.355295 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 18:07:10.355295 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 18:07:10.355295 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 18:07:10.355295 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 18:07:10.355295 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 18:07:10.355295 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 18:07:10.355295 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 17 18:07:10.355295 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:07:10.355295 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 607/1212] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:07:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:07:10.356016 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87ba48-66a4-4f8d-a133-c4bdaa92848b None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:10.467470 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87ba48-66a4-4f8d-a133-c4bdaa92848b None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:10.503462 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68347ae-147e-4e6c-95e2-c4311cf91767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:10.504052 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68347ae-147e-4e6c-95e2-c4311cf91767 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:10.504352 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68347ae-147e-4e6c-95e2-c4311cf91767 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:10.504586 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68347ae-147e-4e6c-95e2-c4311cf91767 None admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:10.505515 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68347ae-147e-4e6c-95e2-c4311cf91767 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:07:10.505843 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68347ae-147e-4e6c-95e2-c4311cf91767 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:10.507402 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68347ae-147e-4e6c-95e2-c4311cf91767 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:10.526625 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 606/1213] 10.222.0.65 () {56 vars in 1143 bytes} [Tue May 17 18:07:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:07:10.532514 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e71a44-1f6d-407e-bb89-5da05d72efb5 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:10.640365 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e71a44-1f6d-407e-bb89-5da05d72efb5 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:10.688727 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21180c0d-bc1f-4bd8-b536-c9add8cc50bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:10.689815 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21180c0d-bc1f-4bd8-b536-c9add8cc50bf None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:10.690301 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21180c0d-bc1f-4bd8-b536-c9add8cc50bf None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:10.691823 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21180c0d-bc1f-4bd8-b536-c9add8cc50bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:10.771288 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21180c0d-bc1f-4bd8-b536-c9add8cc50bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:10.772733 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21180c0d-bc1f-4bd8-b536-c9add8cc50bf None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:10.886450 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 608/1214] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 17 18:07:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 17 18:07:10.892457 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68347ae-147e-4e6c-95e2-c4311cf91767 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:11.001627 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68347ae-147e-4e6c-95e2-c4311cf91767 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:11.042112 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd1c079-0d7a-48ff-ac2f-2f4fcdb56902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:11.043074 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1c079-0d7a-48ff-ac2f-2f4fcdb56902 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:11.043447 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1c079-0d7a-48ff-ac2f-2f4fcdb56902 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:11.043815 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1c079-0d7a-48ff-ac2f-2f4fcdb56902 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:11.054182 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd1c079-0d7a-48ff-ac2f-2f4fcdb56902 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:11.056173 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd1c079-0d7a-48ff-ac2f-2f4fcdb56902 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:11.073354 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-bbd1c079-0d7a-48ff-ac2f-2f4fcdb56902 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:07:11.073354 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:07:11.073354 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:07:11.073354 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:07:11.073354 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:07:11.073354 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:07:11.073354 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:07:11.073354 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:07:11.073354 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:07:11.073354 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:07:11.073354 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:07:11.073354 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:07:11.073354 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:07:11.073354 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:07:11.073354 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:07:11.074465 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:07:11.074465 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:07:11.074465 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:07:11.074465 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:07:11.074465 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:07:11.074465 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:07:11.074465 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:07:11.074465 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:07:11.074465 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:07:11.074465 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:07:11.074465 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:07:11.074465 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:07:11.074465 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:07:11.074465 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:07:11.074465 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:07:11.074465 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:07:11.074465 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:07:11.075532 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:07:11.075532 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:07:11.075532 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:07:11.075532 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:07:11.075532 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 607/1215] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:07:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:07:11.080198 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21180c0d-bc1f-4bd8-b536-c9add8cc50bf None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:11.191132 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21180c0d-bc1f-4bd8-b536-c9add8cc50bf None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:11.228369 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381500d0-6739-4bbc-87b1-1a1a04cdf620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:11.229406 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381500d0-6739-4bbc-87b1-1a1a04cdf620 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:11.231166 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381500d0-6739-4bbc-87b1-1a1a04cdf620 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:11.231166 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381500d0-6739-4bbc-87b1-1a1a04cdf620 None admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:11.231365 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381500d0-6739-4bbc-87b1-1a1a04cdf620 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:07:11.231606 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381500d0-6739-4bbc-87b1-1a1a04cdf620 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:11.233272 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381500d0-6739-4bbc-87b1-1a1a04cdf620 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:11.248869 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 609/1216] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:07:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:07:11.254254 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd1c079-0d7a-48ff-ac2f-2f4fcdb56902 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:11.361601 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd1c079-0d7a-48ff-ac2f-2f4fcdb56902 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:11.399264 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8144c2e5-c5ed-4901-aa40-20012f32bce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:11.400063 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8144c2e5-c5ed-4901-aa40-20012f32bce5 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:11.400316 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8144c2e5-c5ed-4901-aa40-20012f32bce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:11.400597 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8144c2e5-c5ed-4901-aa40-20012f32bce5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:11.407606 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8144c2e5-c5ed-4901-aa40-20012f32bce5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:11.409059 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8144c2e5-c5ed-4901-aa40-20012f32bce5 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:11.422905 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-8144c2e5-c5ed-4901-aa40-20012f32bce5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:07:11.422905 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:07:11.422905 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:07:11.422905 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:07:11.422905 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:07:11.422905 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:07:11.422905 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:07:11.422905 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:07:11.422905 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:07:11.422905 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:07:11.422905 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:07:11.422905 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:07:11.422905 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 18:07:11.422905 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 18:07:11.422905 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 18:07:11.423905 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 18:07:11.423905 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:07:11.423905 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:07:11.423905 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:07:11.423905 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:07:11.423905 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:07:11.423905 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:07:11.423905 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:07:11.423905 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:07:11.423905 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:07:11.423905 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:07:11.423905 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:07:11.423905 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:07:11.423905 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:07:11.423905 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:07:11.423905 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:07:11.423905 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:07:11.424812 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 18:07:11.424812 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 18:07:11.424812 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 18:07:11.424812 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 18:07:11.424812 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 18:07:11.424812 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 18:07:11.424812 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:07:11.424812 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:07:11.430978 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 608/1217] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 17 18:07:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:07:11.431129 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381500d0-6739-4bbc-87b1-1a1a04cdf620 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:11.546424 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381500d0-6739-4bbc-87b1-1a1a04cdf620 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:11.583791 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c979ed54-8542-4ed5-a9c7-1b4d8aa38bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:11.584677 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979ed54-8542-4ed5-a9c7-1b4d8aa38bc4 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:11.585021 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979ed54-8542-4ed5-a9c7-1b4d8aa38bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:11.585359 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979ed54-8542-4ed5-a9c7-1b4d8aa38bc4 None admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:11.586795 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c979ed54-8542-4ed5-a9c7-1b4d8aa38bc4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:07:11.587207 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c979ed54-8542-4ed5-a9c7-1b4d8aa38bc4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:11.588681 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c979ed54-8542-4ed5-a9c7-1b4d8aa38bc4 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:11.605517 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 610/1218] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 17 18:07:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:07:11.607842 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8144c2e5-c5ed-4901-aa40-20012f32bce5 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:11.733607 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8144c2e5-c5ed-4901-aa40-20012f32bce5 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:11.773701 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f32163-526f-40d8-9e58-355c161bd635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:11.774363 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f32163-526f-40d8-9e58-355c161bd635 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:11.774737 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f32163-526f-40d8-9e58-355c161bd635 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:11.775025 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f32163-526f-40d8-9e58-355c161bd635 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:11.775940 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f32163-526f-40d8-9e58-355c161bd635 None admin] RBAC: Adding query filter params (role.id=60e39e2185d346a192b8698767df6018, scope.project.id=0cf165918c1f46cb96d4b54409862659, user.id=33ddf11ac3e14d03b1159868b3b73fa4) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:07:11.776318 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f32163-526f-40d8-9e58-355c161bd635 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:11.777899 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f32163-526f-40d8-9e58-355c161bd635 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:11.793486 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 609/1219] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 17 18:07:11 2022] GET /identity/v3/role_assignments?user.id=33ddf11ac3e14d03b1159868b3b73fa4&scope.project.id=0cf165918c1f46cb96d4b54409862659&role.id=60e39e2185d346a192b8698767df6018 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:07:14.075716 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dbffb3-d557-4726-a2b6-859bce12711b None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:14.076246 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dbffb3-d557-4726-a2b6-859bce12711b None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:14.076246 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dbffb3-d557-4726-a2b6-859bce12711b None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:14.077833 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 611/1220] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:07:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:07:14.083755 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e39a98-ad74-435c-9ecf-344b4b796500 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:14.084260 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e39a98-ad74-435c-9ecf-344b4b796500 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:14.084260 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e39a98-ad74-435c-9ecf-344b4b796500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:14.102077 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-a8e39a98-ad74-435c-9ecf-344b4b796500 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:07:14.103364 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-a8e39a98-ad74-435c-9ecf-344b4b796500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:07:14.182537 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 610/1221] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:07:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:07:14.208046 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dbffb3-d557-4726-a2b6-859bce12711b None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:14.320109 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dbffb3-d557-4726-a2b6-859bce12711b None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:14.357320 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9158e53-927c-4368-8fab-17e4816f826d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:14.358114 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9158e53-927c-4368-8fab-17e4816f826d None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:14.358395 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9158e53-927c-4368-8fab-17e4816f826d None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:14.358718 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9158e53-927c-4368-8fab-17e4816f826d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:14.369832 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9158e53-927c-4368-8fab-17e4816f826d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:07:14.377815 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-d9158e53-927c-4368-8fab-17e4816f826d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 18:07:14.377815 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:07:14.377815 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:07:14.377815 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:07:14.377815 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:07:14.377815 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:07:14.377815 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:07:14.377815 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:07:14.377815 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:07:14.377815 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:07:14.377815 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:07:14.377815 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:07:14.377815 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:07:14.377815 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:07:14.377815 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:07:14.377815 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:07:14.378753 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:07:14.378753 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:07:14.378753 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:07:14.378753 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:07:14.378753 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:07:14.378753 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:07:14.378753 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:07:14.378753 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:07:14.378753 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:07:14.378753 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:07:14.378753 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:07:14.378753 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:07:14.378753 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:07:14.378753 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:07:14.378753 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:07:14.378753 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:07:14.379653 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:07:14.379653 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:07:14.379653 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:07:14.379653 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:07:14.379653 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:07:14.379653 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:07:14.379653 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:07:14.379653 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:07:14.379653 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:07:14.379653 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:07:14.379653 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 18:07:14.379653 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:07:14.381804 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 612/1222] 10.222.0.65 () {56 vars in 1102 bytes} [Tue May 17 18:07:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:07:14.386155 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e39a98-ad74-435c-9ecf-344b4b796500 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:14.487020 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e39a98-ad74-435c-9ecf-344b4b796500 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:14.524086 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b326c-15c9-4b43-b079-677eb2c7a4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:14.524746 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b326c-15c9-4b43-b079-677eb2c7a4c1 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:14.525046 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b326c-15c9-4b43-b079-677eb2c7a4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:14.525401 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b326c-15c9-4b43-b079-677eb2c7a4c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:14.526300 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213b326c-15c9-4b43-b079-677eb2c7a4c1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:07:14.526632 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213b326c-15c9-4b43-b079-677eb2c7a4c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:14.528426 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213b326c-15c9-4b43-b079-677eb2c7a4c1 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:14.538542 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 611/1223] 10.222.0.65 () {56 vars in 1103 bytes} [Tue May 17 18:07:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:07:14.545658 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9158e53-927c-4368-8fab-17e4816f826d None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:14.667803 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9158e53-927c-4368-8fab-17e4816f826d None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:14.705506 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6658914-a7f3-4e9b-aa27-cf71ce9d1e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:14.706497 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6658914-a7f3-4e9b-aa27-cf71ce9d1e76 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:14.708470 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6658914-a7f3-4e9b-aa27-cf71ce9d1e76 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:14.708470 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6658914-a7f3-4e9b-aa27-cf71ce9d1e76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:14.725389 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6658914-a7f3-4e9b-aa27-cf71ce9d1e76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:14.728175 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6658914-a7f3-4e9b-aa27-cf71ce9d1e76 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:14.749434 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-b6658914-a7f3-4e9b-aa27-cf71ce9d1e76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:07:14.749434 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:07:14.749434 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:07:14.749434 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:07:14.749434 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:07:14.749434 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:07:14.749434 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:07:14.749434 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:07:14.749434 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:07:14.749434 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:07:14.749434 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:07:14.749434 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:07:14.749434 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:07:14.749434 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:07:14.749434 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:07:14.750636 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:07:14.750636 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:07:14.750636 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:07:14.750636 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:07:14.750636 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:07:14.750636 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:07:14.750636 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:07:14.750636 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:07:14.750636 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:07:14.750636 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:07:14.750636 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:07:14.750636 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:07:14.750636 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:07:14.750636 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:07:14.750636 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:07:14.750636 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:07:14.750636 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:07:14.756728 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:07:14.756728 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:07:14.756728 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:07:14.756728 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:07:14.756728 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 613/1224] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:07:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:07:14.757084 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b326c-15c9-4b43-b079-677eb2c7a4c1 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:14.874646 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b326c-15c9-4b43-b079-677eb2c7a4c1 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:14.913979 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb0e85-1c4d-4fcc-bde8-761463b0effc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:14.914881 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb0e85-1c4d-4fcc-bde8-761463b0effc None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:14.915160 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb0e85-1c4d-4fcc-bde8-761463b0effc None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:14.915434 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb0e85-1c4d-4fcc-bde8-761463b0effc None admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:14.916247 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb0e85-1c4d-4fcc-bde8-761463b0effc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:07:14.916549 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb0e85-1c4d-4fcc-bde8-761463b0effc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:14.918602 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb0e85-1c4d-4fcc-bde8-761463b0effc None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:14.931494 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 612/1225] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:07:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:07:14.937633 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6658914-a7f3-4e9b-aa27-cf71ce9d1e76 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:15.055510 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6658914-a7f3-4e9b-aa27-cf71ce9d1e76 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:15.089661 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c3cb3-ec0a-43e8-907d-708cab815f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:15.090453 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c3cb3-ec0a-43e8-907d-708cab815f06 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:15.090732 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c3cb3-ec0a-43e8-907d-708cab815f06 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:15.091002 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c3cb3-ec0a-43e8-907d-708cab815f06 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:15.099899 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64c3cb3-ec0a-43e8-907d-708cab815f06 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:15.101515 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64c3cb3-ec0a-43e8-907d-708cab815f06 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:15.115902 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-a64c3cb3-ec0a-43e8-907d-708cab815f06 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 17 18:07:15.115902 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:07:15.115902 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:07:15.115902 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:07:15.115902 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:07:15.115902 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:07:15.115902 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:07:15.115902 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:07:15.115902 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:07:15.115902 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:07:15.115902 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:07:15.115902 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:07:15.115902 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 18:07:15.115902 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 18:07:15.115902 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 18:07:15.115902 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 18:07:15.122906 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:07:15.122906 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:07:15.122906 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 18:07:15.122906 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:07:15.122906 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 18:07:15.122906 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:07:15.122906 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:07:15.122906 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:07:15.122906 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:07:15.122906 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:07:15.122906 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:07:15.122906 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:07:15.122906 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:07:15.122906 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:07:15.122906 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:07:15.122906 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:07:15.122906 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:07:15.122906 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:07:15.123866 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:07:15.123866 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:07:15.123866 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 18:07:15.123866 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 18:07:15.123866 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 18:07:15.123866 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 18:07:15.123866 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 18:07:15.123866 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 18:07:15.123866 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 17 18:07:15.123866 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:07:15.123866 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 614/1226] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:07:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:07:15.124555 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb0e85-1c4d-4fcc-bde8-761463b0effc None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:15.232182 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb0e85-1c4d-4fcc-bde8-761463b0effc None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:15.272103 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb99072b-284c-4bc1-a2e6-ecba89dd5af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:15.272764 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99072b-284c-4bc1-a2e6-ecba89dd5af1 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:15.273077 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99072b-284c-4bc1-a2e6-ecba89dd5af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:15.273535 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99072b-284c-4bc1-a2e6-ecba89dd5af1 None admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:15.274541 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb99072b-284c-4bc1-a2e6-ecba89dd5af1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:07:15.274929 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb99072b-284c-4bc1-a2e6-ecba89dd5af1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:15.276436 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb99072b-284c-4bc1-a2e6-ecba89dd5af1 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:15.296329 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 613/1227] 10.222.0.65 () {56 vars in 1143 bytes} [Tue May 17 18:07:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:07:15.304036 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c3cb3-ec0a-43e8-907d-708cab815f06 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:15.414724 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c3cb3-ec0a-43e8-907d-708cab815f06 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:15.450267 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff6ad1-a5e3-4392-8f8f-4e8dab6be727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:15.451052 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff6ad1-a5e3-4392-8f8f-4e8dab6be727 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:15.451333 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff6ad1-a5e3-4392-8f8f-4e8dab6be727 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:15.451650 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff6ad1-a5e3-4392-8f8f-4e8dab6be727 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:15.462237 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afff6ad1-a5e3-4392-8f8f-4e8dab6be727 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:15.463686 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afff6ad1-a5e3-4392-8f8f-4e8dab6be727 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:15.480778 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-afff6ad1-a5e3-4392-8f8f-4e8dab6be727 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:07:15.480778 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:07:15.480778 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:07:15.480778 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:07:15.480778 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:07:15.480778 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:07:15.480778 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:07:15.480778 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:07:15.480778 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:07:15.480778 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:07:15.480778 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:07:15.480778 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:07:15.480778 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:07:15.480778 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:07:15.480778 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:07:15.482448 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:07:15.482448 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:07:15.482448 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:07:15.482448 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:07:15.482448 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:07:15.482448 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:07:15.482448 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:07:15.482448 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:07:15.482448 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:07:15.482448 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:07:15.482448 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:07:15.482448 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:07:15.482448 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:07:15.482448 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:07:15.482448 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:07:15.482448 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:07:15.482448 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:07:15.483659 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:07:15.483659 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:07:15.483659 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:07:15.483659 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:07:15.483659 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 615/1228] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:07:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:07:15.488385 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb99072b-284c-4bc1-a2e6-ecba89dd5af1 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:15.593126 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb99072b-284c-4bc1-a2e6-ecba89dd5af1 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:15.634962 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb7dd4-d6fc-4375-a383-5825334b1633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:15.635661 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb7dd4-d6fc-4375-a383-5825334b1633 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:15.635969 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb7dd4-d6fc-4375-a383-5825334b1633 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:15.636255 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb7dd4-d6fc-4375-a383-5825334b1633 None admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:15.637024 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcb7dd4-d6fc-4375-a383-5825334b1633 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:07:15.637329 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcb7dd4-d6fc-4375-a383-5825334b1633 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:15.638852 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcb7dd4-d6fc-4375-a383-5825334b1633 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:15.651036 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 614/1229] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:07:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:07:15.657145 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff6ad1-a5e3-4392-8f8f-4e8dab6be727 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:15.761548 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff6ad1-a5e3-4392-8f8f-4e8dab6be727 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:15.797003 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de7717-96ca-4416-9d4f-759f53084e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:15.797818 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de7717-96ca-4416-9d4f-759f53084e64 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:15.798097 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de7717-96ca-4416-9d4f-759f53084e64 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:15.798369 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de7717-96ca-4416-9d4f-759f53084e64 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:15.805722 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8de7717-96ca-4416-9d4f-759f53084e64 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:15.807175 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8de7717-96ca-4416-9d4f-759f53084e64 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:15.823041 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-c8de7717-96ca-4416-9d4f-759f53084e64 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:07:15.823041 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:07:15.823041 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:07:15.823041 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:07:15.823041 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:07:15.823041 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:07:15.823041 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:07:15.823041 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:07:15.823041 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:07:15.823041 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:07:15.823041 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:07:15.823041 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:07:15.823041 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 18:07:15.823041 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 18:07:15.823041 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 18:07:15.824189 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 18:07:15.824189 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:07:15.824189 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:07:15.824189 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:07:15.824189 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:07:15.824189 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:07:15.824189 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:07:15.824189 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:07:15.824189 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:07:15.824189 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:07:15.824189 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:07:15.824189 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:07:15.824189 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:07:15.824189 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:07:15.824189 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:07:15.824189 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:07:15.824189 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:07:15.825305 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 18:07:15.825305 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 18:07:15.825305 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 18:07:15.825305 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 18:07:15.825305 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 18:07:15.825305 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 18:07:15.825305 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:07:15.825305 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:07:15.825305 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 616/1230] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 17 18:07:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:07:15.830431 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb7dd4-d6fc-4375-a383-5825334b1633 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:15.946562 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb7dd4-d6fc-4375-a383-5825334b1633 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:15.983433 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f407a4-cc2d-4ce6-9e5b-7ed43c00b3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:15.984080 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f407a4-cc2d-4ce6-9e5b-7ed43c00b3fc None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:15.984354 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f407a4-cc2d-4ce6-9e5b-7ed43c00b3fc None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:15.984627 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f407a4-cc2d-4ce6-9e5b-7ed43c00b3fc None admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:15.985590 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f407a4-cc2d-4ce6-9e5b-7ed43c00b3fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:07:15.985899 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f407a4-cc2d-4ce6-9e5b-7ed43c00b3fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:15.987577 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f407a4-cc2d-4ce6-9e5b-7ed43c00b3fc None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:16.002068 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 615/1231] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 17 18:07:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:07:16.008267 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de7717-96ca-4416-9d4f-759f53084e64 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:16.118399 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de7717-96ca-4416-9d4f-759f53084e64 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:16.155001 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5202c-f59c-4b87-9409-08ca5e566020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:16.156022 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5202c-f59c-4b87-9409-08ca5e566020 None admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:16.156330 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5202c-f59c-4b87-9409-08ca5e566020 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:16.156632 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5202c-f59c-4b87-9409-08ca5e566020 None admin] PATH_INFO: `/v3/projects/0cf165918c1f46cb96d4b54409862659/users/33ddf11ac3e14d03b1159868b3b73fa4/roles/60e39e2185d346a192b8698767df6018` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:16.176109 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae5202c-f59c-4b87-9409-08ca5e566020 None admin] RBAC: Authorizing `identity:create_grant(project_id=0cf165918c1f46cb96d4b54409862659, user_id=33ddf11ac3e14d03b1159868b3b73fa4, role_id=60e39e2185d346a192b8698767df6018)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:16.178420 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae5202c-f59c-4b87-9409-08ca5e566020 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:16.193935 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 617/1232] 10.222.0.65 () {58 vars in 1439 bytes} [Tue May 17 18:07:16 2022] PUT /identity/v3/projects/0cf165918c1f46cb96d4b54409862659/users/33ddf11ac3e14d03b1159868b3b73fa4/roles/60e39e2185d346a192b8698767df6018 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:07:18.539479 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bdaebd-750d-4b5c-9a8a-4786202c9a1f None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:18.540075 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bdaebd-750d-4b5c-9a8a-4786202c9a1f None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:18.540075 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bdaebd-750d-4b5c-9a8a-4786202c9a1f None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:18.541585 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 616/1233] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:07:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:07:18.546637 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaad86d-592c-413c-9940-750cd7e7c50a None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:18.547083 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaad86d-592c-413c-9940-750cd7e7c50a None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:18.547183 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaad86d-592c-413c-9940-750cd7e7c50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:18.565269 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-0eaad86d-592c-413c-9940-750cd7e7c50a None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:07:18.566651 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-0eaad86d-592c-413c-9940-750cd7e7c50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:07:18.644515 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 618/1234] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:07:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:07:18.672629 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bdaebd-750d-4b5c-9a8a-4786202c9a1f None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:18.785974 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bdaebd-750d-4b5c-9a8a-4786202c9a1f None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:18.824122 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d691ba-bd5e-41ea-8457-929e0c561f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:18.824860 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d691ba-bd5e-41ea-8457-929e0c561f2d None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:18.825144 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d691ba-bd5e-41ea-8457-929e0c561f2d None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:18.825526 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d691ba-bd5e-41ea-8457-929e0c561f2d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:18.837450 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d691ba-bd5e-41ea-8457-929e0c561f2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:07:18.845905 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-56d691ba-bd5e-41ea-8457-929e0c561f2d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 18:07:18.845905 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:07:18.845905 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:07:18.845905 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:07:18.845905 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:07:18.845905 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:07:18.845905 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:07:18.845905 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:07:18.845905 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:07:18.845905 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:07:18.845905 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:07:18.845905 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:07:18.845905 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:07:18.845905 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:07:18.845905 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:07:18.845905 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:07:18.847374 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:07:18.847374 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:07:18.847374 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:07:18.847374 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:07:18.847374 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:07:18.847374 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:07:18.847374 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:07:18.847374 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:07:18.847374 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:07:18.847374 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:07:18.847374 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:07:18.847374 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:07:18.847374 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:07:18.847374 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:07:18.847374 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:07:18.847374 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:07:18.848605 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:07:18.848605 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:07:18.848605 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:07:18.848605 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:07:18.848605 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:07:18.848605 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:07:18.848605 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:07:18.848605 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:07:18.848605 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:07:18.848605 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:07:18.848605 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 18:07:18.848605 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:07:18.848605 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 617/1235] 10.222.0.65 () {56 vars in 1102 bytes} [Tue May 17 18:07:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:07:18.853282 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaad86d-592c-413c-9940-750cd7e7c50a None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:18.962909 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaad86d-592c-413c-9940-750cd7e7c50a None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:18.999591 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b1588-f80b-4b70-a06e-b42b341794b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:19.000287 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b1588-f80b-4b70-a06e-b42b341794b4 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:19.000590 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b1588-f80b-4b70-a06e-b42b341794b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:19.000864 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b1588-f80b-4b70-a06e-b42b341794b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:19.001708 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0b1588-f80b-4b70-a06e-b42b341794b4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:07:19.002087 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0b1588-f80b-4b70-a06e-b42b341794b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:19.003632 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0b1588-f80b-4b70-a06e-b42b341794b4 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:19.013932 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 619/1236] 10.222.0.65 () {56 vars in 1103 bytes} [Tue May 17 18:07:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:07:19.020175 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d691ba-bd5e-41ea-8457-929e0c561f2d None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:19.137167 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d691ba-bd5e-41ea-8457-929e0c561f2d None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:19.184213 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31a626-ebb9-4988-854e-1966293acb74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:19.185206 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31a626-ebb9-4988-854e-1966293acb74 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:19.185548 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31a626-ebb9-4988-854e-1966293acb74 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:19.185854 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31a626-ebb9-4988-854e-1966293acb74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:19.201715 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b31a626-ebb9-4988-854e-1966293acb74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:19.203320 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b31a626-ebb9-4988-854e-1966293acb74 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:19.224657 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-8b31a626-ebb9-4988-854e-1966293acb74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:07:19.224657 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:07:19.224657 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:07:19.224657 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:07:19.224657 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:07:19.224657 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:07:19.224657 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:07:19.224657 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:07:19.224657 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:07:19.224657 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:07:19.224657 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:07:19.224657 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:07:19.224657 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:07:19.224657 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:07:19.224657 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:07:19.225877 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:07:19.225877 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:07:19.225877 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:07:19.225877 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:07:19.225877 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:07:19.225877 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:07:19.225877 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:07:19.225877 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:07:19.225877 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:07:19.225877 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:07:19.225877 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:07:19.225877 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:07:19.225877 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:07:19.225877 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:07:19.225877 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:07:19.225877 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:07:19.225877 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:07:19.227378 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:07:19.227378 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:07:19.227378 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:07:19.227378 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:07:19.227378 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 618/1237] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:07:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:07:19.232313 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b1588-f80b-4b70-a06e-b42b341794b4 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:19.338434 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b1588-f80b-4b70-a06e-b42b341794b4 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:19.375730 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c719e357-9f38-47e0-8dc5-4d3ec8d3cfcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:19.376490 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719e357-9f38-47e0-8dc5-4d3ec8d3cfcc None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:19.376746 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719e357-9f38-47e0-8dc5-4d3ec8d3cfcc None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:19.377012 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719e357-9f38-47e0-8dc5-4d3ec8d3cfcc None admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:19.377756 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c719e357-9f38-47e0-8dc5-4d3ec8d3cfcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:07:19.378054 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c719e357-9f38-47e0-8dc5-4d3ec8d3cfcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:19.379426 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c719e357-9f38-47e0-8dc5-4d3ec8d3cfcc None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:19.391761 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 620/1238] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:07:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:07:19.397932 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31a626-ebb9-4988-854e-1966293acb74 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:19.507237 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31a626-ebb9-4988-854e-1966293acb74 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:19.547684 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abc4514-ea2b-455c-ba43-1f7813871921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:19.548486 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc4514-ea2b-455c-ba43-1f7813871921 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:19.548760 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc4514-ea2b-455c-ba43-1f7813871921 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:19.549026 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc4514-ea2b-455c-ba43-1f7813871921 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:19.557693 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abc4514-ea2b-455c-ba43-1f7813871921 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:19.559112 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abc4514-ea2b-455c-ba43-1f7813871921 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:19.577100 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-2abc4514-ea2b-455c-ba43-1f7813871921 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 17 18:07:19.577100 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:07:19.577100 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:07:19.577100 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:07:19.577100 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:07:19.577100 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:07:19.577100 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:07:19.577100 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:07:19.577100 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:07:19.577100 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:07:19.577100 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:07:19.577100 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:07:19.577100 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 18:07:19.577100 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 18:07:19.577100 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 18:07:19.577100 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 18:07:19.578316 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:07:19.578316 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:07:19.578316 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 18:07:19.578316 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:07:19.578316 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 18:07:19.578316 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:07:19.578316 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:07:19.578316 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:07:19.578316 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:07:19.578316 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:07:19.578316 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:07:19.578316 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:07:19.578316 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:07:19.578316 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:07:19.578316 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:07:19.578316 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:07:19.578316 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:07:19.578316 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:07:19.579440 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:07:19.579440 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:07:19.579440 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 18:07:19.579440 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 18:07:19.579440 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 18:07:19.579440 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 18:07:19.579440 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 18:07:19.579440 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 18:07:19.579440 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 17 18:07:19.579440 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:07:19.579440 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 619/1239] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:07:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:07:19.584313 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c719e357-9f38-47e0-8dc5-4d3ec8d3cfcc None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:19.691094 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c719e357-9f38-47e0-8dc5-4d3ec8d3cfcc None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:19.731716 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a16394-8703-4241-b890-86df3f7e61ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:19.732445 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a16394-8703-4241-b890-86df3f7e61ec None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:19.732723 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a16394-8703-4241-b890-86df3f7e61ec None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:19.732997 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a16394-8703-4241-b890-86df3f7e61ec None admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:19.733938 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a16394-8703-4241-b890-86df3f7e61ec None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:07:19.734261 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a16394-8703-4241-b890-86df3f7e61ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:19.735786 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a16394-8703-4241-b890-86df3f7e61ec None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:19.755125 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 621/1240] 10.222.0.65 () {56 vars in 1143 bytes} [Tue May 17 18:07:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:07:19.762626 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abc4514-ea2b-455c-ba43-1f7813871921 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:19.868165 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abc4514-ea2b-455c-ba43-1f7813871921 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:19.904883 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7def3c-64d5-486d-bac6-3b3805cb0c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:19.905548 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7def3c-64d5-486d-bac6-3b3805cb0c61 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:19.905830 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7def3c-64d5-486d-bac6-3b3805cb0c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:19.906096 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7def3c-64d5-486d-bac6-3b3805cb0c61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:19.982819 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7def3c-64d5-486d-bac6-3b3805cb0c61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:19.984257 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7def3c-64d5-486d-bac6-3b3805cb0c61 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:20.097007 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 620/1241] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 17 18:07:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 18:07:20.103827 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a16394-8703-4241-b890-86df3f7e61ec None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:20.234642 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a16394-8703-4241-b890-86df3f7e61ec None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:20.271883 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2b3a7d-c6dc-4bc1-8c96-d066a223f27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:20.272671 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b3a7d-c6dc-4bc1-8c96-d066a223f27d None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:20.272946 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b3a7d-c6dc-4bc1-8c96-d066a223f27d None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:20.273211 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b3a7d-c6dc-4bc1-8c96-d066a223f27d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:20.283621 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2b3a7d-c6dc-4bc1-8c96-d066a223f27d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:20.285056 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2b3a7d-c6dc-4bc1-8c96-d066a223f27d None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:20.303037 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-5f2b3a7d-c6dc-4bc1-8c96-d066a223f27d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:07:20.303037 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:07:20.303037 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:07:20.303037 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:07:20.303037 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:07:20.303037 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:07:20.303037 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:07:20.303037 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:07:20.303037 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:07:20.303037 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:07:20.303037 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:07:20.303037 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:07:20.303037 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:07:20.303037 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:07:20.303037 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:07:20.304031 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:07:20.304031 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:07:20.304031 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:07:20.304031 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:07:20.304031 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:07:20.304031 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:07:20.304031 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:07:20.304031 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:07:20.304031 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:07:20.304031 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:07:20.304031 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:07:20.304031 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:07:20.304031 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:07:20.304031 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:07:20.304031 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:07:20.304031 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:07:20.304031 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:07:20.305500 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:07:20.305500 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:07:20.305500 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:07:20.305500 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:07:20.305500 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 622/1242] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:07:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:07:20.310803 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7def3c-64d5-486d-bac6-3b3805cb0c61 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:20.413053 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7def3c-64d5-486d-bac6-3b3805cb0c61 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:20.450099 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831b228-2fdf-4107-a20b-6eef17441c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:20.450825 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831b228-2fdf-4107-a20b-6eef17441c56 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:20.451104 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831b228-2fdf-4107-a20b-6eef17441c56 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:20.451375 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c831b228-2fdf-4107-a20b-6eef17441c56 None admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:20.452098 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c831b228-2fdf-4107-a20b-6eef17441c56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:07:20.452386 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c831b228-2fdf-4107-a20b-6eef17441c56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:20.453773 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c831b228-2fdf-4107-a20b-6eef17441c56 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:20.466409 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 621/1243] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:07:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:07:20.472059 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2b3a7d-c6dc-4bc1-8c96-d066a223f27d None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:20.574748 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2b3a7d-c6dc-4bc1-8c96-d066a223f27d None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:20.612351 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd9942-e410-4483-8fae-8450cd1dfa06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:20.613128 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd9942-e410-4483-8fae-8450cd1dfa06 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:20.613403 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd9942-e410-4483-8fae-8450cd1dfa06 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:20.613763 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efd9942-e410-4483-8fae-8450cd1dfa06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:20.620575 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efd9942-e410-4483-8fae-8450cd1dfa06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:20.622045 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efd9942-e410-4483-8fae-8450cd1dfa06 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:20.636502 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-2efd9942-e410-4483-8fae-8450cd1dfa06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:07:20.636502 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:07:20.636502 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:07:20.636502 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:07:20.636502 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:07:20.636502 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:07:20.636502 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:07:20.636502 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:07:20.636502 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:07:20.636502 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:07:20.636502 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:07:20.636502 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:07:20.636502 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 18:07:20.636502 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 18:07:20.636502 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 18:07:20.637898 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 18:07:20.637898 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:07:20.637898 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:07:20.637898 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:07:20.637898 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:07:20.637898 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:07:20.637898 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:07:20.637898 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:07:20.637898 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:07:20.637898 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:07:20.637898 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:07:20.637898 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:07:20.637898 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:07:20.637898 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:07:20.637898 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:07:20.637898 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:07:20.637898 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:07:20.639650 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 18:07:20.639650 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 18:07:20.639650 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 18:07:20.639650 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 18:07:20.639650 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 18:07:20.639650 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 18:07:20.639650 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:07:20.639650 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:07:20.639650 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 623/1244] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 17 18:07:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:07:20.645134 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831b228-2fdf-4107-a20b-6eef17441c56 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:20.747117 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c831b228-2fdf-4107-a20b-6eef17441c56 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:20.780569 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417625ed-8208-48e4-af52-c51d248d65cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:20.781217 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417625ed-8208-48e4-af52-c51d248d65cc None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:20.781518 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417625ed-8208-48e4-af52-c51d248d65cc None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:20.781790 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417625ed-8208-48e4-af52-c51d248d65cc None admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:20.782562 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417625ed-8208-48e4-af52-c51d248d65cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:07:20.782868 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417625ed-8208-48e4-af52-c51d248d65cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:20.784282 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417625ed-8208-48e4-af52-c51d248d65cc None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:20.801937 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 622/1245] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 17 18:07:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:07:20.803108 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd9942-e410-4483-8fae-8450cd1dfa06 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:20.916639 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efd9942-e410-4483-8fae-8450cd1dfa06 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:20.953546 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b2702-dc02-40ff-ab42-580da6c06a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:20.954214 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b2702-dc02-40ff-ab42-580da6c06a7c None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:20.954490 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b2702-dc02-40ff-ab42-580da6c06a7c None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:20.954759 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b2702-dc02-40ff-ab42-580da6c06a7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:20.955603 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53b2702-dc02-40ff-ab42-580da6c06a7c None admin] RBAC: Adding query filter params (role.id=60e39e2185d346a192b8698767df6018, scope.project.id=0cf165918c1f46cb96d4b54409862659, user.id=33ddf11ac3e14d03b1159868b3b73fa4) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:07:20.955896 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53b2702-dc02-40ff-ab42-580da6c06a7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:20.957575 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53b2702-dc02-40ff-ab42-580da6c06a7c None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:20.964261 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 624/1246] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 17 18:07:20 2022] GET /identity/v3/role_assignments?user.id=33ddf11ac3e14d03b1159868b3b73fa4&scope.project.id=0cf165918c1f46cb96d4b54409862659&role.id=60e39e2185d346a192b8698767df6018 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:07:23.477981 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9f7e8-60d4-41c2-8ecb-32d747562d88 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:23.478547 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9f7e8-60d4-41c2-8ecb-32d747562d88 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:23.478547 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9f7e8-60d4-41c2-8ecb-32d747562d88 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:23.479877 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 623/1247] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:07:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:07:23.485133 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad599c7-eec4-48ff-b0cc-41c37909a77b None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:23.485609 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad599c7-eec4-48ff-b0cc-41c37909a77b None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:23.485734 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad599c7-eec4-48ff-b0cc-41c37909a77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:23.504109 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-0ad599c7-eec4-48ff-b0cc-41c37909a77b None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:07:23.505379 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-0ad599c7-eec4-48ff-b0cc-41c37909a77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:07:23.576014 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 625/1248] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:07:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:07:23.600391 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa9f7e8-60d4-41c2-8ecb-32d747562d88 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:23.703958 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa9f7e8-60d4-41c2-8ecb-32d747562d88 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:23.740653 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cb44c6-b50b-4b70-9fd7-c4bf6e6922ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:23.741385 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb44c6-b50b-4b70-9fd7-c4bf6e6922ce None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:23.741792 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb44c6-b50b-4b70-9fd7-c4bf6e6922ce None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:23.742067 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb44c6-b50b-4b70-9fd7-c4bf6e6922ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:23.753826 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cb44c6-b50b-4b70-9fd7-c4bf6e6922ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:07:23.762726 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-36cb44c6-b50b-4b70-9fd7-c4bf6e6922ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:07:23.762726 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:07:23.762726 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:07:23.762726 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:07:23.762726 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:07:23.762726 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:07:23.762726 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:07:23.762726 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:07:23.762726 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:07:23.762726 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:07:23.762726 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:07:23.762726 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:07:23.762726 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:07:23.762726 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:07:23.762726 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:07:23.762726 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:07:23.764088 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:07:23.764088 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:07:23.764088 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:07:23.764088 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:07:23.764088 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:07:23.764088 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:07:23.764088 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:07:23.764088 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:07:23.764088 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:07:23.764088 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:07:23.764088 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:07:23.764088 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:07:23.764088 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:07:23.764088 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:07:23.764088 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:07:23.764088 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:07:23.765261 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:07:23.765261 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:07:23.765261 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:07:23.765261 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:07:23.765261 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:07:23.765261 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:07:23.765261 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:07:23.765261 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:07:23.765261 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:07:23.765261 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:07:23.765261 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:07:23.765261 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:07:23.765261 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 624/1249] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 17 18:07:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:07:23.770331 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad599c7-eec4-48ff-b0cc-41c37909a77b None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:23.878578 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad599c7-eec4-48ff-b0cc-41c37909a77b None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:23.915271 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f223a8-cff3-4e70-b057-71de8265d65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:23.915998 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f223a8-cff3-4e70-b057-71de8265d65f None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:23.916276 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f223a8-cff3-4e70-b057-71de8265d65f None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:23.916548 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f223a8-cff3-4e70-b057-71de8265d65f None admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:23.917353 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f223a8-cff3-4e70-b057-71de8265d65f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:07:23.917745 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f223a8-cff3-4e70-b057-71de8265d65f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:23.919224 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f223a8-cff3-4e70-b057-71de8265d65f None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:23.927881 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 626/1250] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 17 18:07:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:07:23.935861 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cb44c6-b50b-4b70-9fd7-c4bf6e6922ce None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:24.051663 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cb44c6-b50b-4b70-9fd7-c4bf6e6922ce None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:24.085940 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8001d179-4c21-4556-ab68-e5f07ad35953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:24.086778 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001d179-4c21-4556-ab68-e5f07ad35953 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:24.087056 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001d179-4c21-4556-ab68-e5f07ad35953 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:24.087328 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001d179-4c21-4556-ab68-e5f07ad35953 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:24.099822 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8001d179-4c21-4556-ab68-e5f07ad35953 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:24.101869 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8001d179-4c21-4556-ab68-e5f07ad35953 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:24.121929 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-8001d179-4c21-4556-ab68-e5f07ad35953 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:07:24.121929 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:07:24.121929 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:07:24.121929 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:07:24.121929 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:07:24.121929 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:07:24.121929 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:07:24.121929 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:07:24.121929 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:07:24.121929 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:07:24.121929 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:07:24.121929 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:07:24.121929 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:07:24.121929 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:07:24.121929 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:07:24.123035 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:07:24.123035 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:07:24.123035 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:07:24.123035 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:07:24.123035 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:07:24.123035 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:07:24.123035 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:07:24.123035 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:07:24.123035 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:07:24.123035 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:07:24.123035 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:07:24.123035 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:07:24.123035 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:07:24.123035 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:07:24.123035 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:07:24.123035 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:07:24.123035 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:07:24.124080 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:07:24.124080 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:07:24.124080 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:07:24.124080 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:07:24.124080 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 625/1251] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:07:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:07:24.129221 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f223a8-cff3-4e70-b057-71de8265d65f None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:24.243018 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f223a8-cff3-4e70-b057-71de8265d65f None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:24.279734 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ceda2c-d5da-4e34-adac-33ec31606550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:24.280379 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ceda2c-d5da-4e34-adac-33ec31606550 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:24.280655 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ceda2c-d5da-4e34-adac-33ec31606550 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:24.280923 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ceda2c-d5da-4e34-adac-33ec31606550 None admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:24.281660 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ceda2c-d5da-4e34-adac-33ec31606550 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:07:24.282769 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ceda2c-d5da-4e34-adac-33ec31606550 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:24.284206 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ceda2c-d5da-4e34-adac-33ec31606550 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:24.296406 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 627/1252] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:07:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:07:24.302339 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8001d179-4c21-4556-ab68-e5f07ad35953 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:24.407180 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8001d179-4c21-4556-ab68-e5f07ad35953 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:24.444711 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f065fb-770e-446d-ae05-879d219c7818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:24.445651 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f065fb-770e-446d-ae05-879d219c7818 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:24.445932 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f065fb-770e-446d-ae05-879d219c7818 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:24.446202 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f065fb-770e-446d-ae05-879d219c7818 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:24.454303 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f065fb-770e-446d-ae05-879d219c7818 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:24.455747 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f065fb-770e-446d-ae05-879d219c7818 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:24.475618 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-39f065fb-770e-446d-ae05-879d219c7818 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 17 18:07:24.475618 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:07:24.475618 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:07:24.475618 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:07:24.475618 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:07:24.475618 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:07:24.475618 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:07:24.475618 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:07:24.475618 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:07:24.475618 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:07:24.475618 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:07:24.475618 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:07:24.475618 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 18:07:24.475618 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 18:07:24.475618 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 18:07:24.475618 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 18:07:24.477716 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:07:24.477716 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:07:24.477716 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 18:07:24.477716 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:07:24.477716 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 18:07:24.477716 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:07:24.477716 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:07:24.477716 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:07:24.477716 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:07:24.477716 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:07:24.477716 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:07:24.477716 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:07:24.477716 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:07:24.477716 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:07:24.477716 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:07:24.477716 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:07:24.477716 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:07:24.477716 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:07:24.479758 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:07:24.479758 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:07:24.479758 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 18:07:24.479758 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 18:07:24.479758 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 18:07:24.479758 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 18:07:24.479758 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 18:07:24.479758 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 18:07:24.479758 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 17 18:07:24.479758 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:07:24.479758 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 626/1253] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:07:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:07:24.484189 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ceda2c-d5da-4e34-adac-33ec31606550 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:24.590159 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ceda2c-d5da-4e34-adac-33ec31606550 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:24.628139 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740f2e6-9b72-47e5-83ca-d38d2b6bc4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:24.629159 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740f2e6-9b72-47e5-83ca-d38d2b6bc4d1 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:24.629592 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740f2e6-9b72-47e5-83ca-d38d2b6bc4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:24.629867 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740f2e6-9b72-47e5-83ca-d38d2b6bc4d1 None admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:24.630702 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9740f2e6-9b72-47e5-83ca-d38d2b6bc4d1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:07:24.631010 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9740f2e6-9b72-47e5-83ca-d38d2b6bc4d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:24.632565 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9740f2e6-9b72-47e5-83ca-d38d2b6bc4d1 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:24.653921 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 628/1254] 10.222.0.65 () {56 vars in 1143 bytes} [Tue May 17 18:07:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:07:24.660029 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f065fb-770e-446d-ae05-879d219c7818 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:24.765736 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f065fb-770e-446d-ae05-879d219c7818 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:24.802097 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87297f32-19b1-41f9-9313-a1c352f0f721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:24.802742 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87297f32-19b1-41f9-9313-a1c352f0f721 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:24.803017 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87297f32-19b1-41f9-9313-a1c352f0f721 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:24.803284 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87297f32-19b1-41f9-9313-a1c352f0f721 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:24.872024 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87297f32-19b1-41f9-9313-a1c352f0f721 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:24.873419 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87297f32-19b1-41f9-9313-a1c352f0f721 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:24.977742 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 627/1255] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 17 18:07:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 18:07:24.978997 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740f2e6-9b72-47e5-83ca-d38d2b6bc4d1 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:25.079180 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740f2e6-9b72-47e5-83ca-d38d2b6bc4d1 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:25.113128 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f7a522-b422-4236-92d5-6d15c703a9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:25.114068 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7a522-b422-4236-92d5-6d15c703a9ec None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:25.114351 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7a522-b422-4236-92d5-6d15c703a9ec None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:25.114616 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7a522-b422-4236-92d5-6d15c703a9ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:25.125917 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f7a522-b422-4236-92d5-6d15c703a9ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:25.127300 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f7a522-b422-4236-92d5-6d15c703a9ec None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:25.145238 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-37f7a522-b422-4236-92d5-6d15c703a9ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:07:25.145238 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:07:25.145238 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:07:25.145238 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:07:25.145238 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:07:25.145238 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:07:25.145238 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:07:25.145238 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:07:25.145238 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:07:25.145238 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:07:25.145238 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:07:25.145238 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:07:25.145238 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:07:25.145238 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:07:25.145238 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:07:25.146383 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:07:25.146383 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:07:25.146383 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:07:25.146383 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:07:25.146383 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:07:25.146383 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:07:25.146383 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:07:25.146383 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:07:25.146383 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:07:25.146383 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:07:25.146383 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:07:25.146383 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:07:25.146383 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:07:25.146383 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:07:25.146383 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:07:25.146383 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:07:25.146383 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:07:25.147383 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:07:25.147383 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:07:25.147383 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:07:25.147383 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:07:25.147383 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 629/1256] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:07:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:07:25.155121 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87297f32-19b1-41f9-9313-a1c352f0f721 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:25.266842 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87297f32-19b1-41f9-9313-a1c352f0f721 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:25.300023 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d66c83-5184-4384-aa53-491eb3d719e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:25.300681 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d66c83-5184-4384-aa53-491eb3d719e0 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:25.300959 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d66c83-5184-4384-aa53-491eb3d719e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:25.301231 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d66c83-5184-4384-aa53-491eb3d719e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:25.301981 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d66c83-5184-4384-aa53-491eb3d719e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:07:25.302284 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d66c83-5184-4384-aa53-491eb3d719e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:25.303643 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d66c83-5184-4384-aa53-491eb3d719e0 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:25.314965 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 628/1257] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:07:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:07:25.321582 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f7a522-b422-4236-92d5-6d15c703a9ec None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:25.415933 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f7a522-b422-4236-92d5-6d15c703a9ec None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:25.448457 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c51ecc1-fe5c-49b1-a4fd-11457e1124f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:25.449250 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c51ecc1-fe5c-49b1-a4fd-11457e1124f2 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:25.449559 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c51ecc1-fe5c-49b1-a4fd-11457e1124f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:25.449834 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c51ecc1-fe5c-49b1-a4fd-11457e1124f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:25.456166 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c51ecc1-fe5c-49b1-a4fd-11457e1124f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:25.457637 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c51ecc1-fe5c-49b1-a4fd-11457e1124f2 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:25.470872 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-4c51ecc1-fe5c-49b1-a4fd-11457e1124f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:07:25.470872 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:07:25.470872 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:07:25.470872 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:07:25.470872 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:07:25.470872 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:07:25.470872 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:07:25.470872 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:07:25.470872 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:07:25.470872 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:07:25.470872 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:07:25.470872 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:07:25.470872 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 18:07:25.470872 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 18:07:25.470872 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 18:07:25.471924 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 18:07:25.471924 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:07:25.471924 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:07:25.471924 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:07:25.471924 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:07:25.471924 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:07:25.471924 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:07:25.471924 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:07:25.471924 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:07:25.471924 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:07:25.471924 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:07:25.471924 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:07:25.471924 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:07:25.471924 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:07:25.471924 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:07:25.471924 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:07:25.471924 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:07:25.477908 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 18:07:25.477908 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 18:07:25.477908 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 18:07:25.477908 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 18:07:25.477908 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 18:07:25.477908 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 18:07:25.477908 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:07:25.477908 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:07:25.477908 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 630/1258] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 17 18:07:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:07:25.478540 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d66c83-5184-4384-aa53-491eb3d719e0 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:25.572708 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d66c83-5184-4384-aa53-491eb3d719e0 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:25.603407 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c973ca6-c410-487b-aeaa-6f0031656f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:25.604040 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c973ca6-c410-487b-aeaa-6f0031656f40 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:25.604314 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c973ca6-c410-487b-aeaa-6f0031656f40 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:25.604580 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c973ca6-c410-487b-aeaa-6f0031656f40 None admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:25.605345 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c973ca6-c410-487b-aeaa-6f0031656f40 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:07:25.605671 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c973ca6-c410-487b-aeaa-6f0031656f40 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:25.607074 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c973ca6-c410-487b-aeaa-6f0031656f40 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:25.618957 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 629/1259] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 17 18:07:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:07:25.624862 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c51ecc1-fe5c-49b1-a4fd-11457e1124f2 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:25.717290 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c51ecc1-fe5c-49b1-a4fd-11457e1124f2 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:25.748138 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd93864-8a2d-4606-85c7-893fc7a52ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:25.748765 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd93864-8a2d-4606-85c7-893fc7a52ce3 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:25.749044 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd93864-8a2d-4606-85c7-893fc7a52ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:25.749316 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd93864-8a2d-4606-85c7-893fc7a52ce3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:25.750155 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd93864-8a2d-4606-85c7-893fc7a52ce3 None admin] RBAC: Adding query filter params (role.id=332c8d70fd0f41e2beea20aaead5daa5, scope.project.id=0cf165918c1f46cb96d4b54409862659, user.id=33ddf11ac3e14d03b1159868b3b73fa4) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:07:25.750461 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd93864-8a2d-4606-85c7-893fc7a52ce3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:25.751867 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd93864-8a2d-4606-85c7-893fc7a52ce3 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:25.756968 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 631/1260] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 17 18:07:25 2022] GET /identity/v3/role_assignments?user.id=33ddf11ac3e14d03b1159868b3b73fa4&scope.project.id=0cf165918c1f46cb96d4b54409862659&role.id=332c8d70fd0f41e2beea20aaead5daa5 => generated 259 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:07:27.921204 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb102f-0d31-46d3-b418-05ca1a630ec0 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:27.921796 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb102f-0d31-46d3-b418-05ca1a630ec0 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:27.921796 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb102f-0d31-46d3-b418-05ca1a630ec0 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:27.923122 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 630/1261] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:07:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:07:27.928302 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ca5b5-8916-412d-bd00-e95dded71a9e None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:27.928666 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ca5b5-8916-412d-bd00-e95dded71a9e None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:27.928880 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ca5b5-8916-412d-bd00-e95dded71a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:27.945936 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-c21ca5b5-8916-412d-bd00-e95dded71a9e None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:07:27.947098 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-c21ca5b5-8916-412d-bd00-e95dded71a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:07:28.010456 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 632/1262] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:07:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:07:28.035786 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb102f-0d31-46d3-b418-05ca1a630ec0 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:28.129557 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb102f-0d31-46d3-b418-05ca1a630ec0 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:28.168874 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86fc64-5763-4669-90f6-2274881098db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:28.170068 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86fc64-5763-4669-90f6-2274881098db None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:28.170385 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86fc64-5763-4669-90f6-2274881098db None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:28.170692 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86fc64-5763-4669-90f6-2274881098db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:28.184902 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da86fc64-5763-4669-90f6-2274881098db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:07:28.197650 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-da86fc64-5763-4669-90f6-2274881098db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:07:28.197650 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:07:28.197650 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:07:28.197650 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:07:28.197650 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:07:28.197650 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:07:28.197650 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:07:28.197650 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:07:28.197650 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:07:28.197650 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:07:28.197650 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:07:28.197650 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:07:28.197650 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:07:28.197650 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:07:28.197650 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:07:28.197650 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:07:28.198775 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:07:28.198775 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:07:28.198775 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:07:28.198775 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:07:28.198775 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:07:28.198775 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:07:28.198775 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:07:28.198775 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:07:28.198775 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:07:28.198775 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:07:28.198775 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:07:28.198775 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:07:28.198775 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:07:28.198775 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:07:28.198775 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:07:28.198775 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:07:28.199676 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:07:28.199676 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:07:28.199676 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:07:28.199676 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:07:28.199676 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:07:28.199676 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:07:28.199676 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:07:28.199676 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:07:28.199676 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:07:28.199676 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:07:28.199676 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:07:28.199676 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:07:28.199676 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 631/1263] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 17 18:07:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:07:28.206918 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ca5b5-8916-412d-bd00-e95dded71a9e None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:28.300014 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ca5b5-8916-412d-bd00-e95dded71a9e None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:28.331254 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e9984b-cd2f-4224-b266-2329f347c243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:28.331900 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9984b-cd2f-4224-b266-2329f347c243 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:28.332176 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9984b-cd2f-4224-b266-2329f347c243 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:28.332441 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9984b-cd2f-4224-b266-2329f347c243 None admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:28.333168 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e9984b-cd2f-4224-b266-2329f347c243 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:07:28.333479 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e9984b-cd2f-4224-b266-2329f347c243 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:28.334845 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e9984b-cd2f-4224-b266-2329f347c243 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:28.342909 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 633/1264] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 17 18:07:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:07:28.348745 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86fc64-5763-4669-90f6-2274881098db None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:28.442375 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86fc64-5763-4669-90f6-2274881098db None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:28.478076 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e9e64d-5cb7-4608-9e76-68a6641578cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:28.478852 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e9e64d-5cb7-4608-9e76-68a6641578cf None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:28.479132 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e9e64d-5cb7-4608-9e76-68a6641578cf None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:28.479405 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e9e64d-5cb7-4608-9e76-68a6641578cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:28.489379 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e9e64d-5cb7-4608-9e76-68a6641578cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:28.490836 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e9e64d-5cb7-4608-9e76-68a6641578cf None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:28.508212 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-45e9e64d-5cb7-4608-9e76-68a6641578cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:07:28.508212 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:07:28.508212 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:07:28.508212 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:07:28.508212 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:07:28.508212 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:07:28.508212 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:07:28.508212 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:07:28.508212 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:07:28.508212 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:07:28.508212 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:07:28.508212 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:07:28.508212 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:07:28.508212 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:07:28.508212 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:07:28.509244 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:07:28.509244 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:07:28.509244 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:07:28.509244 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:07:28.509244 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:07:28.509244 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:07:28.509244 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:07:28.509244 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:07:28.509244 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:07:28.509244 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:07:28.509244 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:07:28.509244 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:07:28.509244 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:07:28.509244 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:07:28.509244 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:07:28.509244 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:07:28.509244 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:07:28.510405 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:07:28.510405 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:07:28.510405 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:07:28.510405 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:07:28.510405 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 632/1265] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:07:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:07:28.515246 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e9984b-cd2f-4224-b266-2329f347c243 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:28.607020 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e9984b-cd2f-4224-b266-2329f347c243 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:28.638455 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8ce92-e3cf-4922-b8f3-29618b761b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:28.639096 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8ce92-e3cf-4922-b8f3-29618b761b8a None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:28.639372 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8ce92-e3cf-4922-b8f3-29618b761b8a None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:28.639638 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8ce92-e3cf-4922-b8f3-29618b761b8a None admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:28.640337 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f8ce92-e3cf-4922-b8f3-29618b761b8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:07:28.640632 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f8ce92-e3cf-4922-b8f3-29618b761b8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:28.642015 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f8ce92-e3cf-4922-b8f3-29618b761b8a None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:28.653166 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 634/1266] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:07:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:07:28.658901 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e9e64d-5cb7-4608-9e76-68a6641578cf None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:28.756441 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e9e64d-5cb7-4608-9e76-68a6641578cf None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:28.787343 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecda08c-e91c-4169-8580-ec9d40eb11df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:28.788133 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecda08c-e91c-4169-8580-ec9d40eb11df None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:28.788927 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecda08c-e91c-4169-8580-ec9d40eb11df None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:28.789197 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecda08c-e91c-4169-8580-ec9d40eb11df None admin] PATH_INFO: `/v3/users/placement` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:28.796192 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecda08c-e91c-4169-8580-ec9d40eb11df None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:28.797651 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecda08c-e91c-4169-8580-ec9d40eb11df None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:28.811899 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-5ecda08c-e91c-4169-8580-ec9d40eb11df None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 17 18:07:28.811899 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:07:28.811899 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:07:28.811899 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:07:28.811899 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:07:28.811899 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:07:28.811899 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:07:28.811899 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:07:28.811899 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:07:28.811899 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:07:28.811899 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:07:28.811899 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:07:28.811899 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 18:07:28.811899 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 18:07:28.811899 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 18:07:28.811899 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 18:07:28.812992 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:07:28.812992 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:07:28.812992 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 18:07:28.812992 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:07:28.812992 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 18:07:28.812992 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:07:28.812992 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:07:28.812992 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:07:28.812992 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:07:28.812992 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:07:28.812992 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:07:28.812992 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:07:28.812992 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:07:28.812992 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:07:28.812992 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:07:28.812992 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:07:28.812992 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:07:28.812992 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:07:28.814239 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:07:28.814239 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:07:28.814239 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 18:07:28.814239 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 18:07:28.814239 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 18:07:28.814239 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 18:07:28.814239 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 18:07:28.814239 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 18:07:28.814239 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 17 18:07:28.814239 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:07:28.814239 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 633/1267] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:07:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:07:28.819235 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8ce92-e3cf-4922-b8f3-29618b761b8a None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:28.911560 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8ce92-e3cf-4922-b8f3-29618b761b8a None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:28.943529 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf4ec45-b433-44cd-be30-2c646a5b2b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:28.944170 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4ec45-b433-44cd-be30-2c646a5b2b68 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:28.944452 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4ec45-b433-44cd-be30-2c646a5b2b68 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:28.944730 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4ec45-b433-44cd-be30-2c646a5b2b68 None admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:28.945590 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf4ec45-b433-44cd-be30-2c646a5b2b68 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:07:28.945894 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf4ec45-b433-44cd-be30-2c646a5b2b68 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:28.947335 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf4ec45-b433-44cd-be30-2c646a5b2b68 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:28.963142 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 635/1268] 10.222.0.65 () {56 vars in 1143 bytes} [Tue May 17 18:07:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:07:28.968671 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecda08c-e91c-4169-8580-ec9d40eb11df None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:29.066455 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecda08c-e91c-4169-8580-ec9d40eb11df None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:29.098119 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757d2ff8-251e-45f0-b9fd-435eaac0def7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:29.098893 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757d2ff8-251e-45f0-b9fd-435eaac0def7 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:29.099173 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757d2ff8-251e-45f0-b9fd-435eaac0def7 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:29.099444 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757d2ff8-251e-45f0-b9fd-435eaac0def7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:29.110027 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757d2ff8-251e-45f0-b9fd-435eaac0def7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:29.111446 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757d2ff8-251e-45f0-b9fd-435eaac0def7 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:29.127570 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-757d2ff8-251e-45f0-b9fd-435eaac0def7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:07:29.127570 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:07:29.127570 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:07:29.127570 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:07:29.127570 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:07:29.127570 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:07:29.127570 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:07:29.127570 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:07:29.127570 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:07:29.127570 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:07:29.127570 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:07:29.127570 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:07:29.127570 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:07:29.127570 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:07:29.127570 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:07:29.128605 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:07:29.128605 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:07:29.128605 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:07:29.128605 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:07:29.128605 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:07:29.128605 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:07:29.128605 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:07:29.128605 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:07:29.128605 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:07:29.128605 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:07:29.128605 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:07:29.128605 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:07:29.128605 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:07:29.128605 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:07:29.128605 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:07:29.128605 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:07:29.128605 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:07:29.129719 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:07:29.129719 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:07:29.129719 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:07:29.129719 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:07:29.129719 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 634/1269] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:07:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:07:29.134627 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf4ec45-b433-44cd-be30-2c646a5b2b68 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:29.233783 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf4ec45-b433-44cd-be30-2c646a5b2b68 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:29.264516 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb4f2bd-1a4b-4cfb-82a0-3907290f67e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:29.265156 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4f2bd-1a4b-4cfb-82a0-3907290f67e2 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:29.265430 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4f2bd-1a4b-4cfb-82a0-3907290f67e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:29.265731 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4f2bd-1a4b-4cfb-82a0-3907290f67e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:29.266441 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb4f2bd-1a4b-4cfb-82a0-3907290f67e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:07:29.266739 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb4f2bd-1a4b-4cfb-82a0-3907290f67e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:29.268101 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb4f2bd-1a4b-4cfb-82a0-3907290f67e2 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:29.279070 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 636/1270] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:07:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:07:29.284673 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757d2ff8-251e-45f0-b9fd-435eaac0def7 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:29.377310 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757d2ff8-251e-45f0-b9fd-435eaac0def7 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:29.409598 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc8ecb8-5975-43ff-bb95-6f053fdde03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:29.410379 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8ecb8-5975-43ff-bb95-6f053fdde03b None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:29.410654 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8ecb8-5975-43ff-bb95-6f053fdde03b None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:29.410920 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc8ecb8-5975-43ff-bb95-6f053fdde03b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:29.417902 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc8ecb8-5975-43ff-bb95-6f053fdde03b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:29.419321 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc8ecb8-5975-43ff-bb95-6f053fdde03b None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:29.432857 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-6bc8ecb8-5975-43ff-bb95-6f053fdde03b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:07:29.432857 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:07:29.432857 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:07:29.432857 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:07:29.432857 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:07:29.432857 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:07:29.432857 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:07:29.432857 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:07:29.432857 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:07:29.432857 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:07:29.432857 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:07:29.432857 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:07:29.432857 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 18:07:29.432857 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 18:07:29.432857 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 18:07:29.433920 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 18:07:29.433920 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:07:29.433920 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:07:29.433920 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:07:29.433920 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:07:29.433920 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:07:29.433920 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:07:29.433920 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:07:29.433920 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:07:29.433920 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:07:29.433920 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:07:29.433920 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:07:29.433920 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:07:29.433920 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:07:29.433920 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:07:29.433920 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:07:29.433920 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:07:29.435044 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 18:07:29.435044 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 18:07:29.435044 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 18:07:29.435044 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 18:07:29.435044 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 18:07:29.435044 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 18:07:29.435044 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:07:29.435044 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:07:29.435044 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 635/1271] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 17 18:07:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:07:29.439781 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb4f2bd-1a4b-4cfb-82a0-3907290f67e2 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:29.532485 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb4f2bd-1a4b-4cfb-82a0-3907290f67e2 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:29.562787 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f93e9-671b-4286-afd1-790d5bce5288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:29.563418 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f93e9-671b-4286-afd1-790d5bce5288 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:29.563691 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f93e9-671b-4286-afd1-790d5bce5288 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:29.563959 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f93e9-671b-4286-afd1-790d5bce5288 None admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:29.564727 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5f93e9-671b-4286-afd1-790d5bce5288 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:07:29.565029 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5f93e9-671b-4286-afd1-790d5bce5288 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:29.566462 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5f93e9-671b-4286-afd1-790d5bce5288 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:29.578375 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 637/1272] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 17 18:07:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:07:29.584239 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc8ecb8-5975-43ff-bb95-6f053fdde03b None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:29.677899 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc8ecb8-5975-43ff-bb95-6f053fdde03b None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:29.710851 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24fabf5-2cb3-4de4-8176-6530be754ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:29.711721 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24fabf5-2cb3-4de4-8176-6530be754ae8 None admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:29.712000 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24fabf5-2cb3-4de4-8176-6530be754ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:29.712270 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24fabf5-2cb3-4de4-8176-6530be754ae8 None admin] PATH_INFO: `/v3/projects/0cf165918c1f46cb96d4b54409862659/users/33ddf11ac3e14d03b1159868b3b73fa4/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:29.714177 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24fabf5-2cb3-4de4-8176-6530be754ae8 None admin] RBAC: Authorizing `identity:create_grant(project_id=0cf165918c1f46cb96d4b54409862659, user_id=33ddf11ac3e14d03b1159868b3b73fa4, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:29.715589 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24fabf5-2cb3-4de4-8176-6530be754ae8 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:29.727371 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 636/1273] 10.222.0.65 () {58 vars in 1439 bytes} [Tue May 17 18:07:29 2022] PUT /identity/v3/projects/0cf165918c1f46cb96d4b54409862659/users/33ddf11ac3e14d03b1159868b3b73fa4/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:07:31.912576 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854ebc0-893e-44da-8ef0-45b78c6d22d8 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:31.913059 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854ebc0-893e-44da-8ef0-45b78c6d22d8 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:31.913663 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8854ebc0-893e-44da-8ef0-45b78c6d22d8 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:31.914965 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 638/1274] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:07:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:07:31.920197 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2243675-d25c-4948-b037-d1ca2d6001c6 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:31.920611 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2243675-d25c-4948-b037-d1ca2d6001c6 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:31.920751 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2243675-d25c-4948-b037-d1ca2d6001c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:31.937531 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-e2243675-d25c-4948-b037-d1ca2d6001c6 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:07:31.938716 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-e2243675-d25c-4948-b037-d1ca2d6001c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:07:32.003837 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 637/1275] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:07:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:07:32.026749 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854ebc0-893e-44da-8ef0-45b78c6d22d8 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:32.124030 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8854ebc0-893e-44da-8ef0-45b78c6d22d8 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:32.160227 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ccdae0-c61d-4361-afee-98a106b06755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:32.161119 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ccdae0-c61d-4361-afee-98a106b06755 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:32.161403 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ccdae0-c61d-4361-afee-98a106b06755 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:32.161723 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ccdae0-c61d-4361-afee-98a106b06755 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:32.174088 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ccdae0-c61d-4361-afee-98a106b06755 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:07:32.183023 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-d4ccdae0-c61d-4361-afee-98a106b06755 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:07:32.183023 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:07:32.183023 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:07:32.183023 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:07:32.183023 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:07:32.183023 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:07:32.183023 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:07:32.183023 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:07:32.183023 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:07:32.183023 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:07:32.183023 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:07:32.183023 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:07:32.183023 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:07:32.183023 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:07:32.183023 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:07:32.183023 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:07:32.184302 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:07:32.184302 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:07:32.184302 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:07:32.184302 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:07:32.184302 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:07:32.184302 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:07:32.184302 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:07:32.184302 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:07:32.184302 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:07:32.184302 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:07:32.184302 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:07:32.184302 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:07:32.184302 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:07:32.184302 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:07:32.184302 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:07:32.184302 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:07:32.185373 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:07:32.185373 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:07:32.185373 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:07:32.185373 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:07:32.185373 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:07:32.185373 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:07:32.185373 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:07:32.185373 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:07:32.185373 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:07:32.185373 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:07:32.185373 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:07:32.185373 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:07:32.185373 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 639/1276] 10.222.0.65 () {56 vars in 1096 bytes} [Tue May 17 18:07:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:07:32.191202 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2243675-d25c-4948-b037-d1ca2d6001c6 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:32.292944 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2243675-d25c-4948-b037-d1ca2d6001c6 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:32.324235 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d7805-4d52-4f69-9a38-d9fc8d9f6283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:32.324888 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d7805-4d52-4f69-9a38-d9fc8d9f6283 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:32.325166 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d7805-4d52-4f69-9a38-d9fc8d9f6283 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:32.325437 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d7805-4d52-4f69-9a38-d9fc8d9f6283 None admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:32.326202 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93d7805-4d52-4f69-9a38-d9fc8d9f6283 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:07:32.326504 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93d7805-4d52-4f69-9a38-d9fc8d9f6283 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:32.327879 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93d7805-4d52-4f69-9a38-d9fc8d9f6283 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:32.335992 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 638/1277] 10.222.0.65 () {56 vars in 1099 bytes} [Tue May 17 18:07:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:07:32.341673 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ccdae0-c61d-4361-afee-98a106b06755 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:32.434350 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ccdae0-c61d-4361-afee-98a106b06755 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:32.466195 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d5527-7432-4e17-ad5d-8857ac3446c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:32.466948 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d5527-7432-4e17-ad5d-8857ac3446c2 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:32.467221 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d5527-7432-4e17-ad5d-8857ac3446c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:32.467488 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7d5527-7432-4e17-ad5d-8857ac3446c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:32.477389 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7d5527-7432-4e17-ad5d-8857ac3446c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:32.478830 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7d5527-7432-4e17-ad5d-8857ac3446c2 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:32.494926 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-ff7d5527-7432-4e17-ad5d-8857ac3446c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:07:32.494926 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:07:32.494926 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:07:32.494926 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:07:32.494926 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:07:32.494926 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:07:32.494926 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:07:32.494926 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:07:32.494926 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:07:32.494926 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:07:32.494926 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:07:32.494926 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:07:32.494926 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:07:32.494926 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:07:32.494926 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:07:32.495946 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:07:32.495946 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:07:32.495946 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:07:32.495946 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:07:32.495946 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:07:32.495946 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:07:32.495946 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:07:32.495946 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:07:32.495946 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:07:32.495946 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:07:32.495946 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:07:32.495946 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:07:32.495946 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:07:32.495946 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:07:32.495946 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:07:32.495946 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:07:32.495946 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:07:32.497251 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:07:32.497251 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:07:32.497251 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:07:32.497251 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:07:32.497251 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 640/1278] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:07:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:07:32.501491 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d7805-4d52-4f69-9a38-d9fc8d9f6283 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:32.594668 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d7805-4d52-4f69-9a38-d9fc8d9f6283 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:32.626256 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778efb06-2d8a-44e6-bdac-f1f293df9066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:32.626893 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778efb06-2d8a-44e6-bdac-f1f293df9066 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:32.627173 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778efb06-2d8a-44e6-bdac-f1f293df9066 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:32.627444 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778efb06-2d8a-44e6-bdac-f1f293df9066 None admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:32.628146 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778efb06-2d8a-44e6-bdac-f1f293df9066 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:07:32.628447 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778efb06-2d8a-44e6-bdac-f1f293df9066 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:32.629817 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778efb06-2d8a-44e6-bdac-f1f293df9066 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:32.640765 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 639/1279] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:07:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:07:32.646162 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d5527-7432-4e17-ad5d-8857ac3446c2 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:32.739962 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7d5527-7432-4e17-ad5d-8857ac3446c2 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:32.770675 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc7de92-4612-454f-a9ff-bed6de0714ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:32.771439 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7de92-4612-454f-a9ff-bed6de0714ca None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:32.771712 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7de92-4612-454f-a9ff-bed6de0714ca None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:32.771974 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7de92-4612-454f-a9ff-bed6de0714ca None admin] PATH_INFO: `/v3/users/placement` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:32.779038 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc7de92-4612-454f-a9ff-bed6de0714ca None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:32.780457 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc7de92-4612-454f-a9ff-bed6de0714ca None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:32.794715 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-4cc7de92-4612-454f-a9ff-bed6de0714ca None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 17 18:07:32.794715 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:07:32.794715 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:07:32.794715 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:07:32.794715 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:07:32.794715 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:07:32.794715 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:07:32.794715 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:07:32.794715 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:07:32.794715 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:07:32.794715 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:07:32.794715 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:07:32.794715 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 18:07:32.794715 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 18:07:32.794715 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 18:07:32.794715 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 18:07:32.795795 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:07:32.795795 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:07:32.795795 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 18:07:32.795795 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:07:32.795795 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 18:07:32.795795 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:07:32.795795 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:07:32.795795 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:07:32.795795 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:07:32.795795 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:07:32.795795 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:07:32.795795 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:07:32.795795 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:07:32.795795 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:07:32.795795 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:07:32.795795 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:07:32.795795 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:07:32.795795 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:07:32.797106 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:07:32.797106 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:07:32.797106 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 18:07:32.797106 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 18:07:32.797106 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 18:07:32.797106 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 18:07:32.797106 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 18:07:32.797106 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 18:07:32.797106 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 17 18:07:32.797106 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:07:32.797106 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 641/1280] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:07:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:07:32.801641 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778efb06-2d8a-44e6-bdac-f1f293df9066 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:32.895760 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778efb06-2d8a-44e6-bdac-f1f293df9066 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:32.927781 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c4f6c-34ac-4338-a129-f89401012ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:32.928434 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c4f6c-34ac-4338-a129-f89401012ee7 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:32.928734 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c4f6c-34ac-4338-a129-f89401012ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:32.929004 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7c4f6c-34ac-4338-a129-f89401012ee7 None admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:32.929854 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7c4f6c-34ac-4338-a129-f89401012ee7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:07:32.930161 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7c4f6c-34ac-4338-a129-f89401012ee7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:32.931568 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7c4f6c-34ac-4338-a129-f89401012ee7 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:32.947888 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 640/1281] 10.222.0.65 () {56 vars in 1143 bytes} [Tue May 17 18:07:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:07:32.953529 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc7de92-4612-454f-a9ff-bed6de0714ca None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:33.046556 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc7de92-4612-454f-a9ff-bed6de0714ca None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:33.077183 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbba1c3-b64e-49a0-afe6-4a1ab58aa344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:33.077830 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbba1c3-b64e-49a0-afe6-4a1ab58aa344 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:33.078109 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbba1c3-b64e-49a0-afe6-4a1ab58aa344 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:33.078378 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbba1c3-b64e-49a0-afe6-4a1ab58aa344 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:33.140384 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbba1c3-b64e-49a0-afe6-4a1ab58aa344 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:33.142186 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbba1c3-b64e-49a0-afe6-4a1ab58aa344 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:33.239579 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 642/1282] 10.222.0.65 () {58 vars in 1282 bytes} [Tue May 17 18:07:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 18:07:33.245387 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c4f6c-34ac-4338-a129-f89401012ee7 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:33.338071 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7c4f6c-34ac-4338-a129-f89401012ee7 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:33.368653 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b1dafb-a5e4-4b06-9770-c3b8a358da8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:33.369416 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b1dafb-a5e4-4b06-9770-c3b8a358da8c None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:33.369718 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b1dafb-a5e4-4b06-9770-c3b8a358da8c None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:33.369987 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b1dafb-a5e4-4b06-9770-c3b8a358da8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:33.379388 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b1dafb-a5e4-4b06-9770-c3b8a358da8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:33.380817 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b1dafb-a5e4-4b06-9770-c3b8a358da8c None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:33.397902 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-35b1dafb-a5e4-4b06-9770-c3b8a358da8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:07:33.397902 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:07:33.397902 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:07:33.397902 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:07:33.397902 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:07:33.397902 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:07:33.397902 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:07:33.397902 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:07:33.397902 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:07:33.397902 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:07:33.397902 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:07:33.397902 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:07:33.397902 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:07:33.397902 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:07:33.397902 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:07:33.398972 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:07:33.398972 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:07:33.398972 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:07:33.398972 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:07:33.398972 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:07:33.398972 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:07:33.398972 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:07:33.398972 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:07:33.398972 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:07:33.398972 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:07:33.398972 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:07:33.398972 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:07:33.398972 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:07:33.398972 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:07:33.398972 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:07:33.398972 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:07:33.398972 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:07:33.400103 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:07:33.400103 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:07:33.400103 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:07:33.400103 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:07:33.400103 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 641/1283] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:07:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:07:33.404525 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbba1c3-b64e-49a0-afe6-4a1ab58aa344 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:33.498408 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbba1c3-b64e-49a0-afe6-4a1ab58aa344 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:33.529578 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba345de-e971-431a-b11f-a5f357ebb6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:33.530224 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba345de-e971-431a-b11f-a5f357ebb6f4 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:33.530503 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba345de-e971-431a-b11f-a5f357ebb6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:33.530776 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba345de-e971-431a-b11f-a5f357ebb6f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:33.531485 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba345de-e971-431a-b11f-a5f357ebb6f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:07:33.531788 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba345de-e971-431a-b11f-a5f357ebb6f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:33.533155 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba345de-e971-431a-b11f-a5f357ebb6f4 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:33.544237 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 643/1284] 10.222.0.65 () {56 vars in 1109 bytes} [Tue May 17 18:07:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:07:33.549529 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b1dafb-a5e4-4b06-9770-c3b8a358da8c None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:33.643513 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b1dafb-a5e4-4b06-9770-c3b8a358da8c None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:33.675915 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0801270-c9d0-4b36-84c5-bb765f1b6027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:33.676684 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0801270-c9d0-4b36-84c5-bb765f1b6027 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:33.676963 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0801270-c9d0-4b36-84c5-bb765f1b6027 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:33.677234 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0801270-c9d0-4b36-84c5-bb765f1b6027 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:33.683654 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0801270-c9d0-4b36-84c5-bb765f1b6027 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:33.685087 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0801270-c9d0-4b36-84c5-bb765f1b6027 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:33.698564 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application [None req-e0801270-c9d0-4b36-84c5-bb765f1b6027 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:07:33.698564 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:07:33.698564 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:07:33.698564 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:07:33.698564 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:07:33.698564 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:07:33.698564 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:07:33.698564 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:07:33.698564 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:07:33.698564 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:07:33.698564 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:07:33.698564 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:07:33.698564 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 18:07:33.698564 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 18:07:33.698564 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 18:07:33.699686 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 18:07:33.699686 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:07:33.699686 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:07:33.699686 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:07:33.699686 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:07:33.699686 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:07:33.699686 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:07:33.699686 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:07:33.699686 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application with Lock( May 17 18:07:33.699686 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:07:33.699686 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._enter() May 17 18:07:33.699686 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:07:33.699686 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:07:33.699686 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:07:33.699686 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.creator() May 17 18:07:33.699686 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:07:33.699686 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application created_value = creator( May 17 18:07:33.700821 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 18:07:33.700821 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 18:07:33.700821 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 18:07:33.700821 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 18:07:33.700821 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 18:07:33.700821 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 18:07:33.700821 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:07:33.700821 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: ERROR keystone.server.flask.application May 17 18:07:33.700821 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 642/1285] 10.222.0.65 () {56 vars in 1111 bytes} [Tue May 17 18:07:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:07:33.705407 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba345de-e971-431a-b11f-a5f357ebb6f4 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:33.798160 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba345de-e971-431a-b11f-a5f357ebb6f4 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:33.836467 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a136559-1a30-4fa7-acac-0c9b32526773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:33.837118 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a136559-1a30-4fa7-acac-0c9b32526773 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:33.837395 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a136559-1a30-4fa7-acac-0c9b32526773 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:33.837692 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a136559-1a30-4fa7-acac-0c9b32526773 None admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:33.838478 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a136559-1a30-4fa7-acac-0c9b32526773 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:07:33.838784 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a136559-1a30-4fa7-acac-0c9b32526773 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:33.840211 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a136559-1a30-4fa7-acac-0c9b32526773 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:33.852776 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 644/1286] 10.222.0.65 () {56 vars in 1148 bytes} [Tue May 17 18:07:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:07:33.858763 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0801270-c9d0-4b36-84c5-bb765f1b6027 None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:33.952134 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0801270-c9d0-4b36-84c5-bb765f1b6027 None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:33.983271 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51927d07-202a-4359-ad33-add502309de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:33.983901 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51927d07-202a-4359-ad33-add502309de6 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:33.984179 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51927d07-202a-4359-ad33-add502309de6 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:33.984454 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51927d07-202a-4359-ad33-add502309de6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:33.985277 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51927d07-202a-4359-ad33-add502309de6 None admin] RBAC: Adding query filter params (role.id=332c8d70fd0f41e2beea20aaead5daa5, scope.project.id=0cf165918c1f46cb96d4b54409862659, user.id=33ddf11ac3e14d03b1159868b3b73fa4) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:07:33.985616 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51927d07-202a-4359-ad33-add502309de6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:33.987034 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51927d07-202a-4359-ad33-add502309de6 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:33.992539 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 643/1287] 10.222.0.65 () {56 vars in 1374 bytes} [Tue May 17 18:07:33 2022] GET /identity/v3/role_assignments?user.id=33ddf11ac3e14d03b1159868b3b73fa4&scope.project.id=0cf165918c1f46cb96d4b54409862659&role.id=332c8d70fd0f41e2beea20aaead5daa5 => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:07:36.201033 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2d53e-ff72-4d0d-b08c-997fed80476c None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:36.201613 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2d53e-ff72-4d0d-b08c-997fed80476c None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:36.201613 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e2d53e-ff72-4d0d-b08c-997fed80476c None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:36.203051 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 645/1288] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:07:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:07:36.208854 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726fa46-3817-4af0-9742-af6c59916525 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:36.209270 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726fa46-3817-4af0-9742-af6c59916525 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:36.209539 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d726fa46-3817-4af0-9742-af6c59916525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:36.227138 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-d726fa46-3817-4af0-9742-af6c59916525 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:07:36.228290 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-d726fa46-3817-4af0-9742-af6c59916525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:07:36.293011 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 644/1289] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:07:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 18:07:36.315077 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e2d53e-ff72-4d0d-b08c-997fed80476c None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:36.408023 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e2d53e-ff72-4d0d-b08c-997fed80476c None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:36.439475 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1345eaad-7ba0-46bc-a698-c3dbf70bfe82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:36.440240 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345eaad-7ba0-46bc-a698-c3dbf70bfe82 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:36.440512 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345eaad-7ba0-46bc-a698-c3dbf70bfe82 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:36.440778 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345eaad-7ba0-46bc-a698-c3dbf70bfe82 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:36.441408 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1345eaad-7ba0-46bc-a698-c3dbf70bfe82 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:36.442779 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1345eaad-7ba0-46bc-a698-c3dbf70bfe82 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:36.454324 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-1345eaad-7ba0-46bc-a698-c3dbf70bfe82 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 17 18:07:36.454324 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:07:36.454324 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 18:07:36.454324 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 18:07:36.454324 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 18:07:36.454324 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 18:07:36.454324 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 18:07:36.454324 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:07:36.454324 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 17 18:07:36.454324 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:07:36.454324 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 18:07:36.454324 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:07:36.454324 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:07:36.454324 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:07:36.454324 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:07:36.454324 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:07:36.454324 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:07:36.455521 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:07:36.455521 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:07:36.455521 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:07:36.455521 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:07:36.455521 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:07:36.455521 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:07:36.455521 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 18:07:36.455521 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 18:07:36.455521 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 18:07:36.455521 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 18:07:36.455521 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:07:36.455521 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:07:36.455521 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:07:36.455521 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:07:36.455521 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:07:36.455521 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:07:36.456536 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:07:36.456536 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:07:36.456536 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:07:36.456536 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:07:36.456536 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:07:36.456536 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:07:36.456536 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:07:36.456536 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:07:36.456536 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:07:36.456536 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:07:36.456536 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 18:07:36.456536 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:07:36.456536 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 17 18:07:36.456536 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:07:36.456536 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 646/1290] 10.222.0.65 () {56 vars in 1117 bytes} [Tue May 17 18:07:36 2022] GET /identity/v3/services/placement => generated 90 bytes in 141 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:07:36.461323 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726fa46-3817-4af0-9742-af6c59916525 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:36.551836 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d726fa46-3817-4af0-9742-af6c59916525 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:36.583244 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd8fa4-d956-4188-a934-9840c0ee6787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:36.583877 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd8fa4-d956-4188-a934-9840c0ee6787 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:36.584151 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd8fa4-d956-4188-a934-9840c0ee6787 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:36.584420 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd8fa4-d956-4188-a934-9840c0ee6787 None admin] PATH_INFO: `/v3/services` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:36.585660 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd8fa4-d956-4188-a934-9840c0ee6787 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:07:36.585958 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd8fa4-d956-4188-a934-9840c0ee6787 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:36.587297 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd8fa4-d956-4188-a934-9840c0ee6787 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:36.591813 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 645/1291] 10.222.0.65 () {56 vars in 1116 bytes} [Tue May 17 18:07:36 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:07:36.597356 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1345eaad-7ba0-46bc-a698-c3dbf70bfe82 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:36.690226 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1345eaad-7ba0-46bc-a698-c3dbf70bfe82 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:36.722182 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78265a8b-aa15-4b55-8e1c-4ccb08d0df4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:36.722764 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78265a8b-aa15-4b55-8e1c-4ccb08d0df4f None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:36.723042 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78265a8b-aa15-4b55-8e1c-4ccb08d0df4f None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:36.723313 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78265a8b-aa15-4b55-8e1c-4ccb08d0df4f None admin] PATH_INFO: `/v3/services` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:36.724008 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78265a8b-aa15-4b55-8e1c-4ccb08d0df4f None admin] RBAC: Adding query filter params (type=placement) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:07:36.724309 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78265a8b-aa15-4b55-8e1c-4ccb08d0df4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:36.726265 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78265a8b-aa15-4b55-8e1c-4ccb08d0df4f None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:36.730554 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 647/1292] 10.222.0.65 () {56 vars in 1116 bytes} [Tue May 17 18:07:36 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:07:38.927768 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec32f0-4677-4960-861a-63c00424c538 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:38.928285 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec32f0-4677-4960-861a-63c00424c538 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:38.928285 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ec32f0-4677-4960-861a-63c00424c538 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:38.930189 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 646/1293] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:07:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:07:38.935283 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df7cf8-2f77-4fb4-9c76-a2498aa394d1 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:38.935661 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df7cf8-2f77-4fb4-9c76-a2498aa394d1 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:38.935838 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df7cf8-2f77-4fb4-9c76-a2498aa394d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:38.952694 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-54df7cf8-2f77-4fb4-9c76-a2498aa394d1 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:07:38.953896 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-54df7cf8-2f77-4fb4-9c76-a2498aa394d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:07:39.014842 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 648/1294] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:07:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:07:39.036540 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec32f0-4677-4960-861a-63c00424c538 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:39.131154 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ec32f0-4677-4960-861a-63c00424c538 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:39.167639 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e379a-4080-489c-ad97-c106cb063941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:39.168454 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e379a-4080-489c-ad97-c106cb063941 None admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:39.168684 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e379a-4080-489c-ad97-c106cb063941 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:39.169002 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e379a-4080-489c-ad97-c106cb063941 None admin] PATH_INFO: `/v3/services` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:39.169823 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7e379a-4080-489c-ad97-c106cb063941 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:39.171401 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7e379a-4080-489c-ad97-c106cb063941 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:39.187241 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 647/1295] 10.222.0.65 () {60 vars in 1141 bytes} [Tue May 17 18:07:39 2022] POST /identity/v3/services => generated 246 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:07:41.372081 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f503e87-8756-4720-bd5d-61c85e4621ce None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:41.372631 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f503e87-8756-4720-bd5d-61c85e4621ce None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:41.372631 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f503e87-8756-4720-bd5d-61c85e4621ce None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:41.374005 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 649/1296] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:07:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:07:41.379040 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b4e28-f682-4933-82e1-5958ca481566 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:41.379434 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b4e28-f682-4933-82e1-5958ca481566 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:41.379596 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b4e28-f682-4933-82e1-5958ca481566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:41.395701 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-c37b4e28-f682-4933-82e1-5958ca481566 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:07:41.396880 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-c37b4e28-f682-4933-82e1-5958ca481566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:07:41.465835 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 648/1297] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:07:41 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:07:41.487179 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f503e87-8756-4720-bd5d-61c85e4621ce None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:41.582014 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f503e87-8756-4720-bd5d-61c85e4621ce None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:41.614241 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f325f15-422a-459e-8a08-95809230c0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:41.615016 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f325f15-422a-459e-8a08-95809230c0bd None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:41.615291 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f325f15-422a-459e-8a08-95809230c0bd None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:41.615559 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f325f15-422a-459e-8a08-95809230c0bd None admin] PATH_INFO: `/v3/services/placement` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:41.616219 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f325f15-422a-459e-8a08-95809230c0bd None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:41.617604 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f325f15-422a-459e-8a08-95809230c0bd None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:41.628850 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-6f325f15-422a-459e-8a08-95809230c0bd None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 17 18:07:41.628850 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:07:41.628850 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 18:07:41.628850 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 18:07:41.628850 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 18:07:41.628850 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 18:07:41.628850 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 18:07:41.628850 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:07:41.628850 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 17 18:07:41.628850 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:07:41.628850 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 18:07:41.628850 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:07:41.628850 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:07:41.628850 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:07:41.628850 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:07:41.628850 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:07:41.628850 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:07:41.630060 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:07:41.630060 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:07:41.630060 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:07:41.630060 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:07:41.630060 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:07:41.630060 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:07:41.630060 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 18:07:41.630060 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 18:07:41.630060 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 18:07:41.630060 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 18:07:41.630060 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:07:41.630060 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:07:41.630060 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:07:41.630060 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:07:41.630060 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:07:41.630060 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:07:41.631357 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:07:41.631357 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:07:41.631357 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:07:41.631357 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:07:41.631357 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:07:41.631357 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:07:41.631357 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:07:41.631357 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:07:41.631357 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:07:41.631357 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:07:41.631357 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 18:07:41.631357 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:07:41.631357 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 17 18:07:41.631357 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:07:41.631357 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 650/1298] 10.222.0.65 () {56 vars in 1117 bytes} [Tue May 17 18:07:41 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:07:41.636582 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b4e28-f682-4933-82e1-5958ca481566 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:41.728917 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b4e28-f682-4933-82e1-5958ca481566 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:41.760032 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a3be7-4092-4c7d-9b16-698ec59544eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:41.760670 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a3be7-4092-4c7d-9b16-698ec59544eb None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:41.760943 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a3be7-4092-4c7d-9b16-698ec59544eb None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:41.761210 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a3be7-4092-4c7d-9b16-698ec59544eb None admin] PATH_INFO: `/v3/services` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:41.761929 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41a3be7-4092-4c7d-9b16-698ec59544eb None admin] RBAC: Adding query filter params (name=placement) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:07:41.762229 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41a3be7-4092-4c7d-9b16-698ec59544eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:41.763588 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41a3be7-4092-4c7d-9b16-698ec59544eb None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:41.768418 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 649/1299] 10.222.0.65 () {56 vars in 1116 bytes} [Tue May 17 18:07:41 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:07:41.774714 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f325f15-422a-459e-8a08-95809230c0bd None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:41.874298 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f325f15-422a-459e-8a08-95809230c0bd None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:41.905513 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e5060a-5650-41e0-969a-23d74e6bea91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:41.906095 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5060a-5650-41e0-969a-23d74e6bea91 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:41.906368 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5060a-5650-41e0-969a-23d74e6bea91 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:41.906636 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5060a-5650-41e0-969a-23d74e6bea91 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:41.907407 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e5060a-5650-41e0-969a-23d74e6bea91 None admin] RBAC: Adding query filter params (interface=public, service_id=f8fc5e945de74f7ea6deb366f1f9d476, region_id=RegionOne) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:07:41.907708 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e5060a-5650-41e0-969a-23d74e6bea91 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:41.909050 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e5060a-5650-41e0-969a-23d74e6bea91 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:41.913809 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 651/1300] 10.222.0.65 () {56 vars in 1251 bytes} [Tue May 17 18:07:41 2022] GET /identity/v3/endpoints?service_id=f8fc5e945de74f7ea6deb366f1f9d476&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:07:41.919420 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a3be7-4092-4c7d-9b16-698ec59544eb None admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:42.012005 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a3be7-4092-4c7d-9b16-698ec59544eb None admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:42.042707 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a191bab-84c7-4c7d-919e-3e55621d2625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:42.043340 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a191bab-84c7-4c7d-919e-3e55621d2625 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:42.043615 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a191bab-84c7-4c7d-919e-3e55621d2625 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:42.043884 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a191bab-84c7-4c7d-919e-3e55621d2625 None admin] PATH_INFO: `/v3/services` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:42.044545 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a191bab-84c7-4c7d-919e-3e55621d2625 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:42.045907 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a191bab-84c7-4c7d-919e-3e55621d2625 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:42.052367 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 650/1301] 10.222.0.65 () {56 vars in 1087 bytes} [Tue May 17 18:07:41 2022] GET /identity/v3/services => generated 2191 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:07:44.264858 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a2e0d-82ef-4446-9745-965a3da0947e None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:44.265447 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a2e0d-82ef-4446-9745-965a3da0947e None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:44.265447 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a2e0d-82ef-4446-9745-965a3da0947e None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:44.266767 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 652/1302] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:07:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:07:44.271955 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09eefa6-8b70-4188-bbfe-04432f7f03e1 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:44.272893 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09eefa6-8b70-4188-bbfe-04432f7f03e1 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:44.273033 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09eefa6-8b70-4188-bbfe-04432f7f03e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:44.289944 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-b09eefa6-8b70-4188-bbfe-04432f7f03e1 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:07:44.291134 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-b09eefa6-8b70-4188-bbfe-04432f7f03e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:07:44.353963 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 651/1303] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:07:44 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:07:44.376290 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a2e0d-82ef-4446-9745-965a3da0947e None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:44.472938 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a2e0d-82ef-4446-9745-965a3da0947e None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:44.503185 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd2c96f-6233-43d5-bc47-e47625f38b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:44.503957 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2c96f-6233-43d5-bc47-e47625f38b29 None admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:44.504231 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2c96f-6233-43d5-bc47-e47625f38b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:44.504496 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd2c96f-6233-43d5-bc47-e47625f38b29 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:44.505126 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd2c96f-6233-43d5-bc47-e47625f38b29 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:44.506995 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd2c96f-6233-43d5-bc47-e47625f38b29 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:44.518311 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application [None req-dcd2c96f-6233-43d5-bc47-e47625f38b29 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 17 18:07:44.518311 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:07:44.518311 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 18:07:44.518311 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 18:07:44.518311 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 18:07:44.518311 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 18:07:44.518311 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 18:07:44.518311 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:07:44.518311 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 17 18:07:44.518311 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:07:44.518311 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 18:07:44.518311 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:07:44.518311 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:07:44.518311 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:07:44.518311 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:07:44.518311 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:07:44.518311 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:07:44.519496 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:07:44.519496 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:07:44.519496 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:07:44.519496 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:07:44.519496 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:07:44.519496 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:07:44.519496 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 18:07:44.519496 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 18:07:44.519496 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 18:07:44.519496 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 18:07:44.519496 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:07:44.519496 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:07:44.519496 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:07:44.519496 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:07:44.519496 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:07:44.519496 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:07:44.520654 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:07:44.520654 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application with Lock( May 17 18:07:44.520654 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:07:44.520654 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self._enter() May 17 18:07:44.520654 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:07:44.520654 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:07:44.520654 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:07:44.520654 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application return self.creator() May 17 18:07:44.520654 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:07:44.520654 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application created_value = creator( May 17 18:07:44.520654 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 18:07:44.520654 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:07:44.520654 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 17 18:07:44.520654 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: ERROR keystone.server.flask.application May 17 18:07:44.520654 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 653/1304] 10.222.0.65 () {56 vars in 1117 bytes} [Tue May 17 18:07:44 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:07:44.528408 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09eefa6-8b70-4188-bbfe-04432f7f03e1 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:44.621577 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09eefa6-8b70-4188-bbfe-04432f7f03e1 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:44.653879 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2460acd-e594-4ce3-a400-ddcd3b489b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:44.654522 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2460acd-e594-4ce3-a400-ddcd3b489b59 None admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:44.654802 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2460acd-e594-4ce3-a400-ddcd3b489b59 None admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:44.655079 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2460acd-e594-4ce3-a400-ddcd3b489b59 None admin] PATH_INFO: `/v3/services` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:44.655776 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2460acd-e594-4ce3-a400-ddcd3b489b59 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:07:44.656080 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2460acd-e594-4ce3-a400-ddcd3b489b59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:44.657440 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2460acd-e594-4ce3-a400-ddcd3b489b59 None admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:44.662359 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 652/1305] 10.222.0.65 () {56 vars in 1116 bytes} [Tue May 17 18:07:44 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:07:44.667892 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd2c96f-6233-43d5-bc47-e47625f38b29 None admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:44.759916 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd2c96f-6233-43d5-bc47-e47625f38b29 None admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:44.792928 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ce6145-8cb9-41e8-8369-53edfc7fe097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:44.793516 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce6145-8cb9-41e8-8369-53edfc7fe097 None admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:44.793793 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce6145-8cb9-41e8-8369-53edfc7fe097 None admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:44.794059 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce6145-8cb9-41e8-8369-53edfc7fe097 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:44.794779 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ce6145-8cb9-41e8-8369-53edfc7fe097 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:44.796132 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ce6145-8cb9-41e8-8369-53edfc7fe097 None admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:44.813704 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 654/1306] 10.222.0.65 () {60 vars in 1144 bytes} [Tue May 17 18:07:44 2022] POST /identity/v3/endpoints => generated 331 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:08:47.810320 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2daa7ba-aff0-48cf-98af-4e13a60046c2 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:08:47.810945 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2daa7ba-aff0-48cf-98af-4e13a60046c2 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:08:47.810945 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2daa7ba-aff0-48cf-98af-4e13a60046c2 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:08:47.812240 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 653/1307] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:08:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:08:47.818467 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa1eb5-6f1d-430a-ae81-e520a94ac934 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:08:47.818951 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa1eb5-6f1d-430a-ae81-e520a94ac934 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:08:47.819044 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa1eb5-6f1d-430a-ae81-e520a94ac934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:08:47.897654 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-d8aa1eb5-6f1d-430a-ae81-e520a94ac934 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:08:47.898877 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-d8aa1eb5-6f1d-430a-ae81-e520a94ac934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:08:48.002031 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 655/1308] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:08:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:08:48.050632 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290967f-d4f0-441d-87cc-e6e6393fc2c9 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:08:48.051710 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290967f-d4f0-441d-87cc-e6e6393fc2c9 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:08:48.052228 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4290967f-d4f0-441d-87cc-e6e6393fc2c9 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:08:48.054483 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 654/1309] 10.222.0.65 () {54 vars in 964 bytes} [Tue May 17 18:08:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:08:48.063007 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92693d92-3a0f-4989-9fd0-2120de49782f None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:08:48.063722 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92693d92-3a0f-4989-9fd0-2120de49782f None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:08:48.064526 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92693d92-3a0f-4989-9fd0-2120de49782f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:08:48.196852 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-92693d92-3a0f-4989-9fd0-2120de49782f None None] MFA Rules not processed for user `83430939ae474ad6bab37dfb6fc8da78`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:08:48.201073 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-92693d92-3a0f-4989-9fd0-2120de49782f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:08:48.297511 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 656/1310] 10.222.0.65 () {58 vars in 1061 bytes} [Tue May 17 18:08:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:08:48.306537 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290967f-d4f0-441d-87cc-e6e6393fc2c9 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:08:48.308394 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-4290967f-d4f0-441d-87cc-e6e6393fc2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:08:48.420847 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4290967f-d4f0-441d-87cc-e6e6393fc2c9 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:08:48.492797 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d545f95-f132-4544-bc9e-d30eb29958aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:08:48.494031 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d545f95-f132-4544-bc9e-d30eb29958aa service neutron] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:08:48.494525 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d545f95-f132-4544-bc9e-d30eb29958aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:08:48.495008 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d545f95-f132-4544-bc9e-d30eb29958aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:08:48.496869 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-9d545f95-f132-4544-bc9e-d30eb29958aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:08:48.604941 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d545f95-f132-4544-bc9e-d30eb29958aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:08:48.606407 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d545f95-f132-4544-bc9e-d30eb29958aa service neutron] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:08:48.628797 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 655/1311] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:08:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:08:51.174998 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16cddc3-4b7a-48cf-be80-074098dd8b63 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:08:51.175565 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16cddc3-4b7a-48cf-be80-074098dd8b63 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:08:51.175565 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16cddc3-4b7a-48cf-be80-074098dd8b63 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:08:51.177452 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 657/1312] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:08:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 18:08:51.182759 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ca193-3b4f-427c-b088-3469596be522 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:08:51.183159 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ca193-3b4f-427c-b088-3469596be522 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:08:51.183320 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31ca193-3b4f-427c-b088-3469596be522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:08:51.269915 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-f31ca193-3b4f-427c-b088-3469596be522 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:08:51.271445 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-f31ca193-3b4f-427c-b088-3469596be522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:08:51.399560 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 656/1313] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:08:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:08:51.442399 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16cddc3-4b7a-48cf-be80-074098dd8b63 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:08:51.444485 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-c16cddc3-4b7a-48cf-be80-074098dd8b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:08:51.570049 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16cddc3-4b7a-48cf-be80-074098dd8b63 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:08:51.641473 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ad80d-7843-4f12-916c-2b4a3f500784 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:08:51.642279 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ad80d-7843-4f12-916c-2b4a3f500784 service neutron] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:08:51.642666 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ad80d-7843-4f12-916c-2b4a3f500784 service neutron] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:08:51.643031 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ad80d-7843-4f12-916c-2b4a3f500784 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:08:51.645263 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-279ad80d-7843-4f12-916c-2b4a3f500784 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:08:51.750869 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ad80d-7843-4f12-916c-2b4a3f500784 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:08:51.752491 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ad80d-7843-4f12-916c-2b4a3f500784 service neutron] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:08:51.771364 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 658/1314] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:08:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:08:54.399404 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641f820-57e4-45ae-9788-66873de88ab4 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:08:54.399979 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641f820-57e4-45ae-9788-66873de88ab4 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:08:54.399979 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641f820-57e4-45ae-9788-66873de88ab4 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:08:54.401315 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 657/1315] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:08:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:08:54.406593 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8138ef73-458a-494d-bfc8-41aad03fe5e7 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:08:54.406993 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8138ef73-458a-494d-bfc8-41aad03fe5e7 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:08:54.407141 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8138ef73-458a-494d-bfc8-41aad03fe5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:08:54.469450 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-8138ef73-458a-494d-bfc8-41aad03fe5e7 None None] MFA Rules not processed for user `f3c67b1de39b4a0db1d2d09839e38f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:08:54.470651 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-8138ef73-458a-494d-bfc8-41aad03fe5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:08:54.559608 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 659/1316] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:08:54 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:08:54.599258 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641f820-57e4-45ae-9788-66873de88ab4 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:08:54.600778 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-9641f820-57e4-45ae-9788-66873de88ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:08:54.700333 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641f820-57e4-45ae-9788-66873de88ab4 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:08:54.771560 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc47538-7231-40ae-876e-d401ef3b8e63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:08:54.772194 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc47538-7231-40ae-876e-d401ef3b8e63 service neutron] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:08:54.772471 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc47538-7231-40ae-876e-d401ef3b8e63 service neutron] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:08:54.772742 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc47538-7231-40ae-876e-d401ef3b8e63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:08:54.774379 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-ccc47538-7231-40ae-876e-d401ef3b8e63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:08:54.877136 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc47538-7231-40ae-876e-d401ef3b8e63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:08:54.878596 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc47538-7231-40ae-876e-d401ef3b8e63 service neutron] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:08:54.896021 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 658/1317] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:08:54 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:08:57.650139 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed692e3-141d-4396-9c89-19ad43d9df67 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:08:57.650675 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed692e3-141d-4396-9c89-19ad43d9df67 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:08:57.650675 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed692e3-141d-4396-9c89-19ad43d9df67 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:08:57.652029 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 660/1318] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:08:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:08:57.657420 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c1e8f-5762-41e5-a3dd-457c15019f42 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:08:57.657849 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c1e8f-5762-41e5-a3dd-457c15019f42 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:08:57.658065 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c1e8f-5762-41e5-a3dd-457c15019f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:08:57.719505 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-d00c1e8f-5762-41e5-a3dd-457c15019f42 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:08:57.720677 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-d00c1e8f-5762-41e5-a3dd-457c15019f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:08:57.812223 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 659/1319] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:08:57 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:08:57.850464 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed692e3-141d-4396-9c89-19ad43d9df67 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:08:57.851987 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-fed692e3-141d-4396-9c89-19ad43d9df67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:08:57.951235 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed692e3-141d-4396-9c89-19ad43d9df67 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:08:58.023128 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df5358c-3e3c-4a70-8097-007135093769 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:08:58.024049 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df5358c-3e3c-4a70-8097-007135093769 service neutron] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:08:58.024331 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df5358c-3e3c-4a70-8097-007135093769 service neutron] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:08:58.024607 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df5358c-3e3c-4a70-8097-007135093769 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:08:58.026271 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-4df5358c-3e3c-4a70-8097-007135093769 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:08:58.129003 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df5358c-3e3c-4a70-8097-007135093769 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:08:58.130454 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df5358c-3e3c-4a70-8097-007135093769 service neutron] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:08:58.147379 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 661/1320] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:08:57 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:09:01.018238 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8195b4e-91c3-4a5d-a702-be64457d793a None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:09:01.018795 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8195b4e-91c3-4a5d-a702-be64457d793a None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:09:01.018795 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8195b4e-91c3-4a5d-a702-be64457d793a None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:09:01.020830 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 660/1321] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:09:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:09:01.026007 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947867a-bfd9-49f9-9027-6c703c2cf61b None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:09:01.026421 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947867a-bfd9-49f9-9027-6c703c2cf61b None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:09:01.026592 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947867a-bfd9-49f9-9027-6c703c2cf61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:09:01.089516 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-6947867a-bfd9-49f9-9027-6c703c2cf61b None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:09:01.090618 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-6947867a-bfd9-49f9-9027-6c703c2cf61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:09:01.186081 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 662/1322] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:09:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:09:01.235883 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305fab5-9c53-4ce1-babf-92b8d0fe1446 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:09:01.236169 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305fab5-9c53-4ce1-babf-92b8d0fe1446 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:09:01.236448 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305fab5-9c53-4ce1-babf-92b8d0fe1446 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:09:01.237902 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 661/1323] 10.222.0.65 () {54 vars in 964 bytes} [Tue May 17 18:09:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:09:01.244040 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e240b-4c24-4d28-be9b-c44b1a410498 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:09:01.244327 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e240b-4c24-4d28-be9b-c44b1a410498 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:09:01.244603 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e240b-4c24-4d28-be9b-c44b1a410498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:09:01.316677 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-842e240b-4c24-4d28-be9b-c44b1a410498 None None] MFA Rules not processed for user `83430939ae474ad6bab37dfb6fc8da78`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:09:01.317884 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-842e240b-4c24-4d28-be9b-c44b1a410498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:09:01.390347 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 663/1324] 10.222.0.65 () {58 vars in 1061 bytes} [Tue May 17 18:09:01 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:09:01.400062 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5305fab5-9c53-4ce1-babf-92b8d0fe1446 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:09:01.401606 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-5305fab5-9c53-4ce1-babf-92b8d0fe1446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:09:01.501448 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5305fab5-9c53-4ce1-babf-92b8d0fe1446 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:09:01.573410 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5378dd-dbdc-4da4-beb2-01fd1e452383 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:09:01.574070 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5378dd-dbdc-4da4-beb2-01fd1e452383 service neutron] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:09:01.574349 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5378dd-dbdc-4da4-beb2-01fd1e452383 service neutron] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:09:01.574613 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5378dd-dbdc-4da4-beb2-01fd1e452383 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:09:01.576215 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-7d5378dd-dbdc-4da4-beb2-01fd1e452383 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:09:01.681394 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5378dd-dbdc-4da4-beb2-01fd1e452383 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:09:01.682807 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5378dd-dbdc-4da4-beb2-01fd1e452383 service neutron] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:09:01.704597 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 662/1325] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:09:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:09:04.248718 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341898a3-d64a-4fdd-b081-de6c6c24d8ee None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:09:04.249261 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341898a3-d64a-4fdd-b081-de6c6c24d8ee None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:09:04.249261 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341898a3-d64a-4fdd-b081-de6c6c24d8ee None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:09:04.250678 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 664/1326] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:09:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:09:04.256452 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeca86c-7120-4d54-9969-aff9200e6cf6 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:09:04.256929 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeca86c-7120-4d54-9969-aff9200e6cf6 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:09:04.257040 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeca86c-7120-4d54-9969-aff9200e6cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:09:04.322028 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-fbeca86c-7120-4d54-9969-aff9200e6cf6 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:09:04.323223 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-fbeca86c-7120-4d54-9969-aff9200e6cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:09:04.415074 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 663/1327] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:09:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:09:04.451018 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341898a3-d64a-4fdd-b081-de6c6c24d8ee None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:09:04.452643 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-341898a3-d64a-4fdd-b081-de6c6c24d8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:09:04.552031 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341898a3-d64a-4fdd-b081-de6c6c24d8ee None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:09:04.622007 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99086565-711f-48e3-9524-ebf89ef69c8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:09:04.622646 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99086565-711f-48e3-9524-ebf89ef69c8f service neutron] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:09:04.622923 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99086565-711f-48e3-9524-ebf89ef69c8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:09:04.623188 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99086565-711f-48e3-9524-ebf89ef69c8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:09:04.624789 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-99086565-711f-48e3-9524-ebf89ef69c8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:09:04.732827 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99086565-711f-48e3-9524-ebf89ef69c8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:09:04.734317 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99086565-711f-48e3-9524-ebf89ef69c8f service neutron] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:09:04.752018 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 665/1328] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:09:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:09:07.036567 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7beb0-0e66-4fcf-9a22-3a2bbe707ca5 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:09:07.037180 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7beb0-0e66-4fcf-9a22-3a2bbe707ca5 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:09:07.037180 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b7beb0-0e66-4fcf-9a22-3a2bbe707ca5 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:09:07.038529 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 664/1329] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:09:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:09:07.043764 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cac9b9-f472-4859-9de7-cf2762a9f96b None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:09:07.044181 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cac9b9-f472-4859-9de7-cf2762a9f96b None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:09:07.044307 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cac9b9-f472-4859-9de7-cf2762a9f96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:09:07.108352 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-b9cac9b9-f472-4859-9de7-cf2762a9f96b None None] MFA Rules not processed for user `f3c67b1de39b4a0db1d2d09839e38f88`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:09:07.109440 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-b9cac9b9-f472-4859-9de7-cf2762a9f96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:09:07.199933 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 666/1330] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:09:07 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:09:07.236015 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b7beb0-0e66-4fcf-9a22-3a2bbe707ca5 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:09:07.237559 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-42b7beb0-0e66-4fcf-9a22-3a2bbe707ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:09:07.336610 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b7beb0-0e66-4fcf-9a22-3a2bbe707ca5 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:09:07.406879 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5252b7cf-c335-4fa4-9110-04eb736ca034 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:09:07.407522 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252b7cf-c335-4fa4-9110-04eb736ca034 service neutron] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:09:07.407800 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252b7cf-c335-4fa4-9110-04eb736ca034 service neutron] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:09:07.408072 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252b7cf-c335-4fa4-9110-04eb736ca034 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:09:07.413280 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-5252b7cf-c335-4fa4-9110-04eb736ca034 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:09:07.517405 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5252b7cf-c335-4fa4-9110-04eb736ca034 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:09:07.518865 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5252b7cf-c335-4fa4-9110-04eb736ca034 service neutron] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:09:07.538298 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 665/1331] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:09:07 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:09:10.216315 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a06a9f-86c0-4e68-a9ae-d237ca7b632d None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:09:10.216789 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a06a9f-86c0-4e68-a9ae-d237ca7b632d None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:09:10.216882 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a06a9f-86c0-4e68-a9ae-d237ca7b632d None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:09:10.221559 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 667/1332] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:09:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:09:10.224591 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8f545-bd21-4656-9ade-d7507bf4466f None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:09:10.225050 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8f545-bd21-4656-9ade-d7507bf4466f None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:09:10.225144 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8f545-bd21-4656-9ade-d7507bf4466f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:09:10.295560 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-f4c8f545-bd21-4656-9ade-d7507bf4466f None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:09:10.296942 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-f4c8f545-bd21-4656-9ade-d7507bf4466f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:09:10.403236 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 666/1333] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:09:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:09:10.438719 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a06a9f-86c0-4e68-a9ae-d237ca7b632d None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:09:10.440374 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-46a06a9f-86c0-4e68-a9ae-d237ca7b632d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:09:10.539417 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a06a9f-86c0-4e68-a9ae-d237ca7b632d None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:09:10.608529 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2981e43e-1050-41fa-992c-32f6f83f6d90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:09:10.609062 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981e43e-1050-41fa-992c-32f6f83f6d90 service neutron] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:09:10.609335 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981e43e-1050-41fa-992c-32f6f83f6d90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:09:10.609635 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2981e43e-1050-41fa-992c-32f6f83f6d90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:09:10.611229 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-2981e43e-1050-41fa-992c-32f6f83f6d90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:09:10.714346 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2981e43e-1050-41fa-992c-32f6f83f6d90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:09:10.715769 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2981e43e-1050-41fa-992c-32f6f83f6d90 service neutron] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:09:10.733066 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 668/1334] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:09:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:09:13.030007 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a996e-2fa6-46d0-829a-618bd202f701 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:09:13.030559 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a996e-2fa6-46d0-829a-618bd202f701 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:09:13.030559 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a996e-2fa6-46d0-829a-618bd202f701 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:09:13.031904 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 667/1335] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:09:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:09:13.037768 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1777463-2348-4aa2-8691-79f97448c92e None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:09:13.038195 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1777463-2348-4aa2-8691-79f97448c92e None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:09:13.038320 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1777463-2348-4aa2-8691-79f97448c92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:09:13.100730 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-d1777463-2348-4aa2-8691-79f97448c92e None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:09:13.101871 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-d1777463-2348-4aa2-8691-79f97448c92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:09:13.194639 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 669/1336] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:09:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:09:13.234804 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422a996e-2fa6-46d0-829a-618bd202f701 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:09:13.236302 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-422a996e-2fa6-46d0-829a-618bd202f701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:09:13.336424 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422a996e-2fa6-46d0-829a-618bd202f701 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:09:13.405123 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a496aec-ebf5-425b-a232-982bbb28c476 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:09:13.405792 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a496aec-ebf5-425b-a232-982bbb28c476 service neutron] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:09:13.406071 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a496aec-ebf5-425b-a232-982bbb28c476 service neutron] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:09:13.406343 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a496aec-ebf5-425b-a232-982bbb28c476 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:09:13.407946 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-6a496aec-ebf5-425b-a232-982bbb28c476 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:09:13.510289 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a496aec-ebf5-425b-a232-982bbb28c476 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:09:13.511708 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a496aec-ebf5-425b-a232-982bbb28c476 service neutron] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:09:13.529097 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 668/1337] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:09:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:09:16.161601 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8fcdb-a442-4100-a135-966f124f9ed6 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:09:16.162145 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8fcdb-a442-4100-a135-966f124f9ed6 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:09:16.162145 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b8fcdb-a442-4100-a135-966f124f9ed6 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:09:16.163500 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 670/1338] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:09:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:09:16.168732 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc5ceab-e6f1-4561-b3e3-e7b1a548e893 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:09:16.169160 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc5ceab-e6f1-4561-b3e3-e7b1a548e893 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:09:16.169257 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc5ceab-e6f1-4561-b3e3-e7b1a548e893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:09:16.231777 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-1bc5ceab-e6f1-4561-b3e3-e7b1a548e893 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:09:16.232956 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-1bc5ceab-e6f1-4561-b3e3-e7b1a548e893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:09:16.323439 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 669/1339] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:09:16 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:09:16.359107 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b8fcdb-a442-4100-a135-966f124f9ed6 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:09:16.360622 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-b8b8fcdb-a442-4100-a135-966f124f9ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:09:16.459690 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b8fcdb-a442-4100-a135-966f124f9ed6 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:09:16.528254 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49569f9-d7f0-413b-812e-c2cc6d73d0cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:09:16.528897 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49569f9-d7f0-413b-812e-c2cc6d73d0cf service neutron] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:09:16.529173 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49569f9-d7f0-413b-812e-c2cc6d73d0cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:09:16.529449 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49569f9-d7f0-413b-812e-c2cc6d73d0cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:09:16.531080 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-e49569f9-d7f0-413b-812e-c2cc6d73d0cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:09:16.634109 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49569f9-d7f0-413b-812e-c2cc6d73d0cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:09:16.635530 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49569f9-d7f0-413b-812e-c2cc6d73d0cf service neutron] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:09:16.652885 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 671/1340] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:09:16 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:09:20.807754 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27762cf-787d-482f-b681-76ee50fdf400 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:09:20.808282 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27762cf-787d-482f-b681-76ee50fdf400 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:09:20.808282 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27762cf-787d-482f-b681-76ee50fdf400 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:09:20.809648 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 670/1341] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:09:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:09:20.814963 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60847b65-6a37-480c-8724-711c1c8ea0eb None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:09:20.815898 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60847b65-6a37-480c-8724-711c1c8ea0eb None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:09:20.816167 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60847b65-6a37-480c-8724-711c1c8ea0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:09:20.886035 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-60847b65-6a37-480c-8724-711c1c8ea0eb None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:09:20.887202 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-60847b65-6a37-480c-8724-711c1c8ea0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:09:20.992410 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 672/1342] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:09:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:09:21.030855 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27762cf-787d-482f-b681-76ee50fdf400 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:09:21.033034 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-f27762cf-787d-482f-b681-76ee50fdf400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:09:21.124210 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27762cf-787d-482f-b681-76ee50fdf400 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:09:21.127641 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d816df-f976-4c20-8d2f-702228cc145c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:09:21.128815 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d816df-f976-4c20-8d2f-702228cc145c service neutron] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:09:21.129087 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d816df-f976-4c20-8d2f-702228cc145c service neutron] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:09:21.129359 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d816df-f976-4c20-8d2f-702228cc145c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:09:21.138008 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d816df-f976-4c20-8d2f-702228cc145c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:09:21.139428 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d816df-f976-4c20-8d2f-702228cc145c service neutron] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:09:21.148524 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 671/1343] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:09:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:09:24.076610 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd6d37-ae0a-4e8b-8fa0-34383f520ac6 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:09:24.077163 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd6d37-ae0a-4e8b-8fa0-34383f520ac6 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:09:24.077163 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd6d37-ae0a-4e8b-8fa0-34383f520ac6 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:09:24.078555 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 673/1344] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:09:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:09:24.084186 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8754b3-b4e0-454f-867d-1211ab40041c None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:09:24.084641 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8754b3-b4e0-454f-867d-1211ab40041c None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:09:24.084747 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8754b3-b4e0-454f-867d-1211ab40041c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:09:24.111887 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-8d8754b3-b4e0-454f-867d-1211ab40041c None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:09:24.113084 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-8d8754b3-b4e0-454f-867d-1211ab40041c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:09:24.195655 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 672/1345] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:09:24 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:09:24.232686 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd6d37-ae0a-4e8b-8fa0-34383f520ac6 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:09:24.243556 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd6d37-ae0a-4e8b-8fa0-34383f520ac6 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:09:24.247145 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf3a56-f201-4014-831f-41d95451bdb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:09:24.247856 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf3a56-f201-4014-831f-41d95451bdb9 service neutron] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:09:24.248199 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf3a56-f201-4014-831f-41d95451bdb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:09:24.248477 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf3a56-f201-4014-831f-41d95451bdb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:09:24.258075 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bf3a56-f201-4014-831f-41d95451bdb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:09:24.259502 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bf3a56-f201-4014-831f-41d95451bdb9 service neutron] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:09:24.269319 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 674/1346] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:09:24 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:09:28.582484 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9ecc4-0dd8-49ec-a8df-543ac38275e8 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:09:28.582991 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9ecc4-0dd8-49ec-a8df-543ac38275e8 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:09:28.582991 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9ecc4-0dd8-49ec-a8df-543ac38275e8 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:09:28.584336 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 673/1347] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:09:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:09:28.589549 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae63c02-48c2-4b82-a0e0-ef69c1041490 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:09:28.589998 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae63c02-48c2-4b82-a0e0-ef69c1041490 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:09:28.590088 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae63c02-48c2-4b82-a0e0-ef69c1041490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:09:28.607893 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-cae63c02-48c2-4b82-a0e0-ef69c1041490 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:09:28.609088 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-cae63c02-48c2-4b82-a0e0-ef69c1041490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:09:28.616992 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 675/1348] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:09:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:09:28.655333 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb9ecc4-0dd8-49ec-a8df-543ac38275e8 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:09:28.657137 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-9cb9ecc4-0dd8-49ec-a8df-543ac38275e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:09:28.670439 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb9ecc4-0dd8-49ec-a8df-543ac38275e8 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:09:28.673880 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0ef45-4d0e-4be0-92a0-07492f6f5c97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:09:28.674530 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0ef45-4d0e-4be0-92a0-07492f6f5c97 service neutron] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:09:28.674808 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0ef45-4d0e-4be0-92a0-07492f6f5c97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:09:28.675080 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0ef45-4d0e-4be0-92a0-07492f6f5c97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:09:28.683607 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d0ef45-4d0e-4be0-92a0-07492f6f5c97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:09:28.685023 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d0ef45-4d0e-4be0-92a0-07492f6f5c97 service neutron] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:09:28.694925 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 674/1349] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:09:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:09:33.941533 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8953e-eaf0-4a3f-898f-6bf1554b6502 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:09:33.942646 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8953e-eaf0-4a3f-898f-6bf1554b6502 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:09:33.943074 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed8953e-eaf0-4a3f-898f-6bf1554b6502 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:09:33.945122 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 676/1350] 10.222.0.65 () {54 vars in 921 bytes} [Tue May 17 18:09:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:09:33.949879 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d73b0-a2ed-4052-b4e8-cfa8e25c4063 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:09:33.950891 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d73b0-a2ed-4052-b4e8-cfa8e25c4063 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:09:33.951388 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d73b0-a2ed-4052-b4e8-cfa8e25c4063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:09:34.022453 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-ee2d73b0-a2ed-4052-b4e8-cfa8e25c4063 None None] MFA Rules not processed for user `33ddf11ac3e14d03b1159868b3b73fa4`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:09:34.024121 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-ee2d73b0-a2ed-4052-b4e8-cfa8e25c4063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:09:34.252352 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 675/1351] 10.222.0.65 () {58 vars in 1018 bytes} [Tue May 17 18:09:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:09:38.429581 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12c10a-dc50-4a99-a7a8-8dc5d80414d2 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:09:38.430469 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12c10a-dc50-4a99-a7a8-8dc5d80414d2 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:09:38.430739 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12c10a-dc50-4a99-a7a8-8dc5d80414d2 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:09:38.432527 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 677/1352] 10.222.0.65 () {54 vars in 921 bytes} [Tue May 17 18:09:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:09:38.438392 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a0db88-16b2-4131-9edd-62c57f984de7 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:09:38.438823 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a0db88-16b2-4131-9edd-62c57f984de7 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:09:38.438932 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a0db88-16b2-4131-9edd-62c57f984de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:09:38.458936 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-30a0db88-16b2-4131-9edd-62c57f984de7 None None] MFA Rules not processed for user `33ddf11ac3e14d03b1159868b3b73fa4`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:09:38.460225 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-30a0db88-16b2-4131-9edd-62c57f984de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:09:38.468770 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 676/1353] 10.222.0.65 () {58 vars in 1018 bytes} [Tue May 17 18:09:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:09:40.097937 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a071f7-aeef-41b4-a7af-5056a34e3c70 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:09:40.098451 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a071f7-aeef-41b4-a7af-5056a34e3c70 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:09:40.098451 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a071f7-aeef-41b4-a7af-5056a34e3c70 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:09:40.099732 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 678/1354] 10.222.0.65 () {54 vars in 921 bytes} [Tue May 17 18:09:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:09:40.104644 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcabf36e-faba-42bf-81b1-290311dfebc6 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:09:40.105023 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcabf36e-faba-42bf-81b1-290311dfebc6 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:09:40.105273 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcabf36e-faba-42bf-81b1-290311dfebc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:09:40.123746 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-fcabf36e-faba-42bf-81b1-290311dfebc6 None None] MFA Rules not processed for user `33ddf11ac3e14d03b1159868b3b73fa4`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:09:40.125036 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-fcabf36e-faba-42bf-81b1-290311dfebc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:09:40.134272 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 677/1355] 10.222.0.65 () {58 vars in 1018 bytes} [Tue May 17 18:09:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:09:43.957813 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f64bb-ae77-4d4f-a9fd-e9193c87f666 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:09:43.958332 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f64bb-ae77-4d4f-a9fd-e9193c87f666 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:09:43.958332 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f64bb-ae77-4d4f-a9fd-e9193c87f666 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:09:43.959775 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 679/1356] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:09:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:09:43.964721 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9baa3-300a-4520-ac1f-175aae9cff10 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:09:43.965536 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9baa3-300a-4520-ac1f-175aae9cff10 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:09:43.965817 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9baa3-300a-4520-ac1f-175aae9cff10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:09:43.983839 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-dab9baa3-300a-4520-ac1f-175aae9cff10 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:09:43.985010 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-dab9baa3-300a-4520-ac1f-175aae9cff10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:09:43.992814 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 678/1357] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:09:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:09:44.050840 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4194b-7f94-49fd-94ab-db740e0725b7 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:09:44.051124 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4194b-7f94-49fd-94ab-db740e0725b7 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:09:44.051428 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4194b-7f94-49fd-94ab-db740e0725b7 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:09:44.052811 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 680/1358] 10.222.0.65 () {54 vars in 961 bytes} [Tue May 17 18:09:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:09:44.058543 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ece7fb-69aa-4d8b-8585-6a941b79ca42 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:09:44.058825 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ece7fb-69aa-4d8b-8585-6a941b79ca42 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:09:44.059094 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ece7fb-69aa-4d8b-8585-6a941b79ca42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:09:44.105584 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-b2ece7fb-69aa-4d8b-8585-6a941b79ca42 None None] MFA Rules not processed for user `5b430b739cb54fc7911bc89f8ea2df72`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:09:44.106743 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-b2ece7fb-69aa-4d8b-8585-6a941b79ca42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:09:44.189038 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 679/1359] 10.222.0.65 () {58 vars in 1058 bytes} [Tue May 17 18:09:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:09:44.198406 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4194b-7f94-49fd-94ab-db740e0725b7 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:09:44.213450 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4194b-7f94-49fd-94ab-db740e0725b7 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:09:44.220098 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a93649b-c898-46d8-9a4a-632c85fd4dc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b430b739cb54fc7911bc89f8ea2df72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:09:44.220738 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a93649b-c898-46d8-9a4a-632c85fd4dc2 service nova] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:09:44.221886 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a93649b-c898-46d8-9a4a-632c85fd4dc2 service nova] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:09:44.221886 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a93649b-c898-46d8-9a4a-632c85fd4dc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:09:44.232757 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a93649b-c898-46d8-9a4a-632c85fd4dc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:09:44.234431 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a93649b-c898-46d8-9a4a-632c85fd4dc2 service nova] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:09:44.244579 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 681/1360] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:09:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:09:46.692892 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c50317-96cf-4482-97f4-5ade0bd094da None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:09:46.693729 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c50317-96cf-4482-97f4-5ade0bd094da None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:09:46.693729 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c50317-96cf-4482-97f4-5ade0bd094da None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:09:46.695101 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 680/1361] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:09:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:09:46.700461 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e11e19-9e70-4dfe-8937-e8c49b968988 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:09:46.701333 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e11e19-9e70-4dfe-8937-e8c49b968988 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:09:46.701664 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e11e19-9e70-4dfe-8937-e8c49b968988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:09:46.720637 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-95e11e19-9e70-4dfe-8937-e8c49b968988 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:09:46.721893 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-95e11e19-9e70-4dfe-8937-e8c49b968988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:09:46.729762 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 682/1362] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:09:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:09:46.774084 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c50317-96cf-4482-97f4-5ade0bd094da None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:09:46.788604 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c50317-96cf-4482-97f4-5ade0bd094da None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:09:46.794408 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107aacf-d9d3-4735-abb8-f750f9c6de84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b430b739cb54fc7911bc89f8ea2df72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:09:46.795752 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107aacf-d9d3-4735-abb8-f750f9c6de84 service nova] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:09:46.795968 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107aacf-d9d3-4735-abb8-f750f9c6de84 service nova] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:09:46.796245 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107aacf-d9d3-4735-abb8-f750f9c6de84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:09:46.805571 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e107aacf-d9d3-4735-abb8-f750f9c6de84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:09:46.807339 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e107aacf-d9d3-4735-abb8-f750f9c6de84 service nova] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:09:46.817835 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 681/1363] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:09:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:09:49.401930 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb156d-1c4e-4615-8e4e-7942851d023d None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:09:49.402441 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb156d-1c4e-4615-8e4e-7942851d023d None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:09:49.402537 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb156d-1c4e-4615-8e4e-7942851d023d None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:09:49.405556 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 683/1364] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:09:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:09:49.415509 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20352768-37b2-4502-904e-27db6b81ddf5 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:09:49.416031 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20352768-37b2-4502-904e-27db6b81ddf5 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:09:49.416031 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20352768-37b2-4502-904e-27db6b81ddf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:09:49.434674 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-20352768-37b2-4502-904e-27db6b81ddf5 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:09:49.435867 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-20352768-37b2-4502-904e-27db6b81ddf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:09:49.444852 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 682/1365] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:09:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:09:49.489118 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8307b7-5907-441c-9752-3626a33f383a None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:09:49.489406 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8307b7-5907-441c-9752-3626a33f383a None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:09:49.489716 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8307b7-5907-441c-9752-3626a33f383a None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:09:49.491068 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 684/1366] 10.222.0.65 () {54 vars in 961 bytes} [Tue May 17 18:09:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:09:49.496550 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18900665-3989-4a58-aee6-b88860922476 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:09:49.496835 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18900665-3989-4a58-aee6-b88860922476 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:09:49.497114 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18900665-3989-4a58-aee6-b88860922476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:09:49.515322 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-18900665-3989-4a58-aee6-b88860922476 None None] MFA Rules not processed for user `5b430b739cb54fc7911bc89f8ea2df72`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:09:49.516496 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-18900665-3989-4a58-aee6-b88860922476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:09:49.525623 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 683/1367] 10.222.0.65 () {58 vars in 1058 bytes} [Tue May 17 18:09:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:09:49.533262 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8307b7-5907-441c-9752-3626a33f383a None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:09:49.547224 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8307b7-5907-441c-9752-3626a33f383a None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:09:49.553167 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9195a9-4649-47be-be26-0b05349b6e09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b430b739cb54fc7911bc89f8ea2df72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:09:49.553908 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9195a9-4649-47be-be26-0b05349b6e09 service nova] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:09:49.554258 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9195a9-4649-47be-be26-0b05349b6e09 service nova] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:09:49.554608 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9195a9-4649-47be-be26-0b05349b6e09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:09:49.562564 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9195a9-4649-47be-be26-0b05349b6e09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:09:49.564205 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9195a9-4649-47be-be26-0b05349b6e09 service nova] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:09:49.574363 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 685/1368] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:09:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:09:51.846985 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b82acc-2ff8-485a-b34f-54f9415e10f9 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:09:51.846985 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b82acc-2ff8-485a-b34f-54f9415e10f9 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:09:51.846985 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b82acc-2ff8-485a-b34f-54f9415e10f9 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:09:51.851877 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 684/1369] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:09:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:09:51.853804 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b234b-01d1-42e1-8ca7-e38e7c8133f4 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:09:51.854269 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b234b-01d1-42e1-8ca7-e38e7c8133f4 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:09:51.854552 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b234b-01d1-42e1-8ca7-e38e7c8133f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:09:51.872970 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-356b234b-01d1-42e1-8ca7-e38e7c8133f4 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:09:51.874332 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-356b234b-01d1-42e1-8ca7-e38e7c8133f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:09:51.882758 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 686/1370] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:09:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:09:51.927616 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b82acc-2ff8-485a-b34f-54f9415e10f9 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:09:51.944301 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b82acc-2ff8-485a-b34f-54f9415e10f9 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:09:51.950056 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579b1b55-b9b8-40d1-9db1-b5a34639cbfd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b430b739cb54fc7911bc89f8ea2df72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:09:51.950725 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b1b55-b9b8-40d1-9db1-b5a34639cbfd service nova] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:09:51.951005 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b1b55-b9b8-40d1-9db1-b5a34639cbfd service nova] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:09:51.951275 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b1b55-b9b8-40d1-9db1-b5a34639cbfd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:09:51.961963 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579b1b55-b9b8-40d1-9db1-b5a34639cbfd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:09:51.963784 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579b1b55-b9b8-40d1-9db1-b5a34639cbfd service nova] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:09:51.974726 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 685/1371] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:09:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:09:52.139028 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6e501-92af-4133-8788-0235479aebd0 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:09:52.139377 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6e501-92af-4133-8788-0235479aebd0 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:09:52.139657 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6e501-92af-4133-8788-0235479aebd0 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:09:52.141041 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 687/1372] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:09:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:09:52.147655 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec0e35-60b7-43b0-954c-e3a10acf72ec None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:09:52.147946 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec0e35-60b7-43b0-954c-e3a10acf72ec None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:09:52.148225 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec0e35-60b7-43b0-954c-e3a10acf72ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:09:52.168596 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-40ec0e35-60b7-43b0-954c-e3a10acf72ec None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:09:52.170116 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-40ec0e35-60b7-43b0-954c-e3a10acf72ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:09:52.181014 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 686/1373] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:09:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:09:52.498330 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b89a8-5da0-49d0-99a1-5e499635d526 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:09:52.498330 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b89a8-5da0-49d0-99a1-5e499635d526 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:09:52.498330 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4b89a8-5da0-49d0-99a1-5e499635d526 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:09:52.498330 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 688/1374] 10.222.0.65 () {54 vars in 963 bytes} [Tue May 17 18:09:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:09:52.504133 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459c9dd-eefd-4910-a23a-d9705b8ae375 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:09:52.504495 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459c9dd-eefd-4910-a23a-d9705b8ae375 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:09:52.504881 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459c9dd-eefd-4910-a23a-d9705b8ae375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:09:52.555151 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-a459c9dd-eefd-4910-a23a-d9705b8ae375 None None] MFA Rules not processed for user `769f675c28e34902a079c70dab44dbf8`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:09:52.557004 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-a459c9dd-eefd-4910-a23a-d9705b8ae375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:09:52.618676 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 687/1375] 10.222.0.65 () {58 vars in 1060 bytes} [Tue May 17 18:09:52 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:09:52.626484 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4b89a8-5da0-49d0-99a1-5e499635d526 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:09:52.637269 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4b89a8-5da0-49d0-99a1-5e499635d526 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:09:52.640669 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75597fa-561f-49cf-9f5c-c8f14c046c47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:09:52.641288 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75597fa-561f-49cf-9f5c-c8f14c046c47 service cinder] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:09:52.641607 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75597fa-561f-49cf-9f5c-c8f14c046c47 service cinder] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:09:52.641880 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75597fa-561f-49cf-9f5c-c8f14c046c47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:09:52.650788 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75597fa-561f-49cf-9f5c-c8f14c046c47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:09:52.652195 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75597fa-561f-49cf-9f5c-c8f14c046c47 service cinder] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:09:52.661375 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 689/1376] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:09:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:09:54.221152 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa6aef-7c83-471c-b1b5-7f45f74aa3dd None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:09:54.221764 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa6aef-7c83-471c-b1b5-7f45f74aa3dd None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:09:54.221764 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa6aef-7c83-471c-b1b5-7f45f74aa3dd None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:09:54.223120 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 688/1377] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:09:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:09:54.228854 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047d184-7c9e-46a5-b1ae-94b14f9f05f9 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:09:54.229374 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047d184-7c9e-46a5-b1ae-94b14f9f05f9 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:09:54.229374 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047d184-7c9e-46a5-b1ae-94b14f9f05f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:09:54.248569 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-e047d184-7c9e-46a5-b1ae-94b14f9f05f9 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:09:54.249852 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-e047d184-7c9e-46a5-b1ae-94b14f9f05f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:09:54.257871 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 690/1378] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:09:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:09:54.313170 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aa6aef-7c83-471c-b1b5-7f45f74aa3dd None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:09:54.328256 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aa6aef-7c83-471c-b1b5-7f45f74aa3dd None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:09:54.333787 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18523cce-fc0e-4e53-98f7-d064e26a5971 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b430b739cb54fc7911bc89f8ea2df72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:09:54.334440 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18523cce-fc0e-4e53-98f7-d064e26a5971 service nova] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:09:54.334715 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18523cce-fc0e-4e53-98f7-d064e26a5971 service nova] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:09:54.334985 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18523cce-fc0e-4e53-98f7-d064e26a5971 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:09:54.343837 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18523cce-fc0e-4e53-98f7-d064e26a5971 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:09:54.345501 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18523cce-fc0e-4e53-98f7-d064e26a5971 service nova] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:09:54.356528 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 689/1379] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:09:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:09:56.692243 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd05e64-ae6e-4d98-81ad-e2965dc606b9 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:09:56.692845 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd05e64-ae6e-4d98-81ad-e2965dc606b9 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:09:56.692845 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd05e64-ae6e-4d98-81ad-e2965dc606b9 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:09:56.694423 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 691/1380] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:09:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:09:56.699972 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03b312-b445-430c-9fb3-cf7f1879d90a None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:09:56.700449 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03b312-b445-430c-9fb3-cf7f1879d90a None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:09:56.700544 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03b312-b445-430c-9fb3-cf7f1879d90a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:09:56.721196 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-bd03b312-b445-430c-9fb3-cf7f1879d90a None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:09:56.722797 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-bd03b312-b445-430c-9fb3-cf7f1879d90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:09:56.731910 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 690/1381] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:09:56.780866 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd05e64-ae6e-4d98-81ad-e2965dc606b9 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:09:56.796643 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd05e64-ae6e-4d98-81ad-e2965dc606b9 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:09:56.803530 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df28f1-3fc7-48dc-acde-feac615be536 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b430b739cb54fc7911bc89f8ea2df72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:09:56.804250 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df28f1-3fc7-48dc-acde-feac615be536 service nova] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:09:56.804598 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df28f1-3fc7-48dc-acde-feac615be536 service nova] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:09:56.804943 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df28f1-3fc7-48dc-acde-feac615be536 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:09:56.816171 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23df28f1-3fc7-48dc-acde-feac615be536 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:09:56.818188 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23df28f1-3fc7-48dc-acde-feac615be536 service nova] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:09:56.837906 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 692/1382] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:09:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:09:59.164992 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ccf8b4-938d-483b-8d77-ed5e36440296 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:09:59.166249 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ccf8b4-938d-483b-8d77-ed5e36440296 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:09:59.166855 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ccf8b4-938d-483b-8d77-ed5e36440296 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:09:59.168597 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 691/1383] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:09:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:09:59.175676 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68b903-96d4-4e45-8539-1ba2bd9fffea None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:09:59.176866 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68b903-96d4-4e45-8539-1ba2bd9fffea None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:09:59.177157 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af68b903-96d4-4e45-8539-1ba2bd9fffea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:09:59.201753 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-af68b903-96d4-4e45-8539-1ba2bd9fffea None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:09:59.203533 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-af68b903-96d4-4e45-8539-1ba2bd9fffea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:09:59.213095 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 693/1384] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:09:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:09:59.267546 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ccf8b4-938d-483b-8d77-ed5e36440296 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:09:59.288747 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ccf8b4-938d-483b-8d77-ed5e36440296 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:09:59.298283 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add9145-8dbd-487b-84f8-e8b8b1ff7efb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b430b739cb54fc7911bc89f8ea2df72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:09:59.300036 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add9145-8dbd-487b-84f8-e8b8b1ff7efb service nova] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:09:59.300425 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add9145-8dbd-487b-84f8-e8b8b1ff7efb service nova] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:09:59.300808 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add9145-8dbd-487b-84f8-e8b8b1ff7efb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:09:59.315206 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add9145-8dbd-487b-84f8-e8b8b1ff7efb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:09:59.319311 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add9145-8dbd-487b-84f8-e8b8b1ff7efb service nova] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:09:59.335136 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 692/1385] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:09:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:10:01.956026 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae6901-baa1-4c98-9d2d-5147d25fcaec None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:01.956739 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae6901-baa1-4c98-9d2d-5147d25fcaec None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:01.956739 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae6901-baa1-4c98-9d2d-5147d25fcaec None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:01.958036 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 694/1386] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:10:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:10:01.963802 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46039fe7-f037-4311-b1a5-c8fef9e50599 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:01.964236 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46039fe7-f037-4311-b1a5-c8fef9e50599 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:01.964605 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46039fe7-f037-4311-b1a5-c8fef9e50599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:01.984566 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-46039fe7-f037-4311-b1a5-c8fef9e50599 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:10:01.985800 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-46039fe7-f037-4311-b1a5-c8fef9e50599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:10:01.994084 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 693/1387] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:10:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:10:02.037547 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae6901-baa1-4c98-9d2d-5147d25fcaec None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:10:02.052639 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae6901-baa1-4c98-9d2d-5147d25fcaec None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:10:02.058820 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379fe8e1-3e51-48ad-ba69-0377ab18aff1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b430b739cb54fc7911bc89f8ea2df72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:10:02.059509 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379fe8e1-3e51-48ad-ba69-0377ab18aff1 service nova] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:02.059730 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379fe8e1-3e51-48ad-ba69-0377ab18aff1 service nova] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:02.060002 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379fe8e1-3e51-48ad-ba69-0377ab18aff1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:02.068375 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379fe8e1-3e51-48ad-ba69-0377ab18aff1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:10:02.070211 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379fe8e1-3e51-48ad-ba69-0377ab18aff1 service nova] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:10:02.079469 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 695/1388] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:10:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:10:04.297552 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04467e35-4b61-4471-962e-c662b55acb2e None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:04.298141 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04467e35-4b61-4471-962e-c662b55acb2e None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:04.298141 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04467e35-4b61-4471-962e-c662b55acb2e None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:04.300246 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 694/1389] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:10:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 18:10:04.305801 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140286b-8f88-4292-a613-37180ab8d449 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:04.306224 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140286b-8f88-4292-a613-37180ab8d449 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:04.306331 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140286b-8f88-4292-a613-37180ab8d449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:04.324471 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-7140286b-8f88-4292-a613-37180ab8d449 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:10:04.325699 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-7140286b-8f88-4292-a613-37180ab8d449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:10:04.333872 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 696/1390] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:10:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:10:04.379455 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04467e35-4b61-4471-962e-c662b55acb2e None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:10:04.394757 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04467e35-4b61-4471-962e-c662b55acb2e None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:10:04.400439 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cdc3a3-7e25-40a8-8002-c0c7ae650fe8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b430b739cb54fc7911bc89f8ea2df72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:10:04.401109 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cdc3a3-7e25-40a8-8002-c0c7ae650fe8 service nova] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:04.401410 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cdc3a3-7e25-40a8-8002-c0c7ae650fe8 service nova] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:04.401737 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cdc3a3-7e25-40a8-8002-c0c7ae650fe8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:04.411160 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cdc3a3-7e25-40a8-8002-c0c7ae650fe8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:10:04.412862 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cdc3a3-7e25-40a8-8002-c0c7ae650fe8 service nova] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:10:04.422779 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 695/1391] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:10:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:10:07.113180 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396fa15-e435-4609-a64b-c1813592e217 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:07.113781 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396fa15-e435-4609-a64b-c1813592e217 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:07.113781 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396fa15-e435-4609-a64b-c1813592e217 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:07.115101 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 697/1392] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:10:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:10:07.120376 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe50de8-8bd1-4bad-8878-f12338a1b35f None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:07.120799 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe50de8-8bd1-4bad-8878-f12338a1b35f None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:07.120947 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe50de8-8bd1-4bad-8878-f12338a1b35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:07.138904 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-2fe50de8-8bd1-4bad-8878-f12338a1b35f None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:10:07.140082 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-2fe50de8-8bd1-4bad-8878-f12338a1b35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:10:07.148069 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 696/1393] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:10:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:10:07.191867 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396fa15-e435-4609-a64b-c1813592e217 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:10:07.205837 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396fa15-e435-4609-a64b-c1813592e217 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:10:07.211393 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ee55a-ed68-45ba-9302-079a50d72b48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b430b739cb54fc7911bc89f8ea2df72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:10:07.212020 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ee55a-ed68-45ba-9302-079a50d72b48 service nova] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:07.212302 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ee55a-ed68-45ba-9302-079a50d72b48 service nova] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:07.212579 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ee55a-ed68-45ba-9302-079a50d72b48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:07.221141 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47ee55a-ed68-45ba-9302-079a50d72b48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:10:07.222740 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47ee55a-ed68-45ba-9302-079a50d72b48 service nova] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:10:07.232167 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 698/1394] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:10:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:10:08.536449 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4aab5-78c1-49dd-9290-d28600175a73 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:08.537022 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4aab5-78c1-49dd-9290-d28600175a73 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:08.537022 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4aab5-78c1-49dd-9290-d28600175a73 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:08.538400 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 697/1395] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:10:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:10:08.543715 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c78d4-561a-45bb-a356-c42ebef30528 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:08.544138 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c78d4-561a-45bb-a356-c42ebef30528 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:08.544283 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c78d4-561a-45bb-a356-c42ebef30528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:08.562226 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-dc1c78d4-561a-45bb-a356-c42ebef30528 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:10:08.563397 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-dc1c78d4-561a-45bb-a356-c42ebef30528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:10:08.571320 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 699/1396] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:10:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:10:08.626793 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2466d945-2276-4359-9310-76e821d6d975 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:08.627077 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2466d945-2276-4359-9310-76e821d6d975 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:08.627351 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2466d945-2276-4359-9310-76e821d6d975 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:08.628710 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 698/1397] 10.222.0.65 () {54 vars in 962 bytes} [Tue May 17 18:10:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:10:08.633566 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ddd1d0-ef91-4362-a327-59b2e39e51ae None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:08.633854 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ddd1d0-ef91-4362-a327-59b2e39e51ae None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:08.634128 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ddd1d0-ef91-4362-a327-59b2e39e51ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:08.680339 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-58ddd1d0-ef91-4362-a327-59b2e39e51ae None None] MFA Rules not processed for user `ce570634a66b45158d940151828f533a`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:10:08.681542 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-58ddd1d0-ef91-4362-a327-59b2e39e51ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:10:08.738556 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 700/1398] 10.222.0.65 () {58 vars in 1059 bytes} [Tue May 17 18:10:08 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:10:08.745962 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2466d945-2276-4359-9310-76e821d6d975 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:10:08.756248 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2466d945-2276-4359-9310-76e821d6d975 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:10:08.759646 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db0e4b-c24f-4640-a6e4-adf372ae8d93 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce570634a66b45158d940151828f533a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:10:08.760260 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db0e4b-c24f-4640-a6e4-adf372ae8d93 service glance] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:08.760541 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db0e4b-c24f-4640-a6e4-adf372ae8d93 service glance] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:08.760804 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db0e4b-c24f-4640-a6e4-adf372ae8d93 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:08.769563 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59db0e4b-c24f-4640-a6e4-adf372ae8d93 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:10:08.770968 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59db0e4b-c24f-4640-a6e4-adf372ae8d93 service glance] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:10:08.780322 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 699/1399] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:10:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:10:09.191943 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19529a-58f8-4961-b74d-7c8b79d2880d None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:09.192299 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19529a-58f8-4961-b74d-7c8b79d2880d None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:09.192672 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19529a-58f8-4961-b74d-7c8b79d2880d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:09.238192 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-8a19529a-58f8-4961-b74d-7c8b79d2880d None None] MFA Rules not processed for user `f370e353067848b5843c5650183be347`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:10:09.239364 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-8a19529a-58f8-4961-b74d-7c8b79d2880d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:10:09.304091 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 701/1400] 10.222.0.65 () {58 vars in 1009 bytes} [Tue May 17 18:10:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:10:09.348457 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc53a8d-940f-4275-88bc-7d0ffdbbb337 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:09.348783 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc53a8d-940f-4275-88bc-7d0ffdbbb337 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:09.349092 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc53a8d-940f-4275-88bc-7d0ffdbbb337 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:09.350865 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 700/1401] 10.222.0.65 () {54 vars in 942 bytes} [Tue May 17 18:10:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:10:09.358150 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb15ee-0ef8-437c-b3d3-ed91e8421cff None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:09.358438 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb15ee-0ef8-437c-b3d3-ed91e8421cff None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:09.358710 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb15ee-0ef8-437c-b3d3-ed91e8421cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:09.407180 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-b1eb15ee-0ef8-437c-b3d3-ed91e8421cff None None] MFA Rules not processed for user `1464e84a3a2d4321a98b98d398bc7be3`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:10:09.408399 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-b1eb15ee-0ef8-437c-b3d3-ed91e8421cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:10:09.476341 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 702/1402] 10.222.0.65 () {58 vars in 1039 bytes} [Tue May 17 18:10:09 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:10:09.484427 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a643177-1613-41e6-8608-136ea234cac6 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:09.484714 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a643177-1613-41e6-8608-136ea234cac6 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:09.484988 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a643177-1613-41e6-8608-136ea234cac6 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:09.485550 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb15ee-0ef8-437c-b3d3-ed91e8421cff None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:10:09.486413 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 701/1403] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:10:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:10:09.491448 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ae5ce-10a8-402e-9ba3-0214ad860a98 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:09.491730 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ae5ce-10a8-402e-9ba3-0214ad860a98 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:09.492006 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ae5ce-10a8-402e-9ba3-0214ad860a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:09.494979 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb15ee-0ef8-437c-b3d3-ed91e8421cff None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:10:09.499917 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade321ac-3d54-4e53-8c50-219187ac050a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1464e84a3a2d4321a98b98d398bc7be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:10:09.500543 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade321ac-3d54-4e53-8c50-219187ac050a service swift] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:09.500818 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade321ac-3d54-4e53-8c50-219187ac050a service swift] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:09.501088 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade321ac-3d54-4e53-8c50-219187ac050a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:09.509418 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-900ae5ce-10a8-402e-9ba3-0214ad860a98 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:10:09.509593 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade321ac-3d54-4e53-8c50-219187ac050a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:10:09.510691 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-900ae5ce-10a8-402e-9ba3-0214ad860a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:10:09.511157 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade321ac-3d54-4e53-8c50-219187ac050a service swift] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:10:09.518954 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 702/1404] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:10:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:10:09.519510 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 703/1405] 10.222.0.65 () {60 vars in 1384 bytes} [Tue May 17 18:10:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 17 18:10:09.562886 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900ae5ce-10a8-402e-9ba3-0214ad860a98 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:10:09.576063 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900ae5ce-10a8-402e-9ba3-0214ad860a98 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:10:09.582022 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e3a6a6-3b1f-4514-8af1-9f8a86ec7a48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b430b739cb54fc7911bc89f8ea2df72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:10:09.582665 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3a6a6-3b1f-4514-8af1-9f8a86ec7a48 service nova] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:09.582938 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3a6a6-3b1f-4514-8af1-9f8a86ec7a48 service nova] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:09.583204 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3a6a6-3b1f-4514-8af1-9f8a86ec7a48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:09.593276 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e3a6a6-3b1f-4514-8af1-9f8a86ec7a48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:10:09.594871 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e3a6a6-3b1f-4514-8af1-9f8a86ec7a48 service nova] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:10:09.604702 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 703/1406] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:10:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:10:11.896114 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65966f-b547-4a5d-87df-f036d54f77a7 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:11.896677 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65966f-b547-4a5d-87df-f036d54f77a7 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:11.896677 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f65966f-b547-4a5d-87df-f036d54f77a7 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:11.898453 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 704/1407] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:10:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:10:11.903218 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5653d618-0ca5-4f27-9265-2a144b39a979 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:11.903635 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5653d618-0ca5-4f27-9265-2a144b39a979 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:11.903767 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5653d618-0ca5-4f27-9265-2a144b39a979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:11.924568 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-5653d618-0ca5-4f27-9265-2a144b39a979 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:10:11.925838 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-5653d618-0ca5-4f27-9265-2a144b39a979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:10:11.938708 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 704/1408] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:10:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:10:11.978654 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f65966f-b547-4a5d-87df-f036d54f77a7 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:10:11.992862 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f65966f-b547-4a5d-87df-f036d54f77a7 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:10:11.998271 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720999a-020d-4450-bca9-7bfd8a5fd322 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b430b739cb54fc7911bc89f8ea2df72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:10:11.998890 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720999a-020d-4450-bca9-7bfd8a5fd322 service nova] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:11.999164 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720999a-020d-4450-bca9-7bfd8a5fd322 service nova] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:11.999430 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720999a-020d-4450-bca9-7bfd8a5fd322 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:12.007395 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7720999a-020d-4450-bca9-7bfd8a5fd322 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:10:12.012388 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7720999a-020d-4450-bca9-7bfd8a5fd322 service nova] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:10:12.019902 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 705/1409] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:10:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:10:33.074009 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea1720-9a57-4c86-8ad1-00b8d58d9e1c None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:33.074686 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea1720-9a57-4c86-8ad1-00b8d58d9e1c None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:33.074686 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ea1720-9a57-4c86-8ad1-00b8d58d9e1c None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:33.075942 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 705/1410] 10.222.0.65 () {54 vars in 918 bytes} [Tue May 17 18:10:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:10:33.081706 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea77c669-a525-4cf2-9306-98fef258823f None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:33.082180 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea77c669-a525-4cf2-9306-98fef258823f None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:33.082288 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea77c669-a525-4cf2-9306-98fef258823f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:33.100153 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-ea77c669-a525-4cf2-9306-98fef258823f None None] MFA Rules not processed for user `33ddf11ac3e14d03b1159868b3b73fa4`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:10:33.101290 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-ea77c669-a525-4cf2-9306-98fef258823f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:10:33.109478 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 706/1411] 10.222.0.65 () {58 vars in 1015 bytes} [Tue May 17 18:10:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:10:33.123364 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293b0fb-72b3-42af-aff1-00eaca9b9c44 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:33.123646 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293b0fb-72b3-42af-aff1-00eaca9b9c44 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:33.123968 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293b0fb-72b3-42af-aff1-00eaca9b9c44 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:33.125315 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 706/1412] 10.222.0.65 () {54 vars in 918 bytes} [Tue May 17 18:10:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:10:33.129930 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca084d-79c3-43f7-9571-742445275dd3 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:33.130209 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca084d-79c3-43f7-9571-742445275dd3 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:33.130481 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca084d-79c3-43f7-9571-742445275dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:33.148427 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-3aca084d-79c3-43f7-9571-742445275dd3 None None] MFA Rules not processed for user `5b430b739cb54fc7911bc89f8ea2df72`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:10:33.149617 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-3aca084d-79c3-43f7-9571-742445275dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:10:33.159030 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 707/1413] 10.222.0.65 () {58 vars in 1015 bytes} [Tue May 17 18:10:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:10:35.819521 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3489b-a8e2-454f-a2ec-916af9bf42ce None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:35.820104 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3489b-a8e2-454f-a2ec-916af9bf42ce None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:35.820104 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb3489b-a8e2-454f-a2ec-916af9bf42ce None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:35.821406 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 707/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 18:10:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:10:35.826551 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c5892-9db6-4c02-b28a-f6bb09b84859 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:35.827001 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c5892-9db6-4c02-b28a-f6bb09b84859 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:35.827158 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c5892-9db6-4c02-b28a-f6bb09b84859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:35.845665 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-872c5892-9db6-4c02-b28a-f6bb09b84859 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:10:35.846842 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-872c5892-9db6-4c02-b28a-f6bb09b84859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:10:35.854455 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 708/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 18:10:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:10:35.895339 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb3489b-a8e2-454f-a2ec-916af9bf42ce None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:10:35.909589 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb3489b-a8e2-454f-a2ec-916af9bf42ce None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:10:35.914752 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00c97a-79aa-48e1-b896-529fbfb4a2c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b430b739cb54fc7911bc89f8ea2df72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:10:35.915369 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00c97a-79aa-48e1-b896-529fbfb4a2c6 service nova] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:35.915642 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00c97a-79aa-48e1-b896-529fbfb4a2c6 service nova] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:35.915913 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00c97a-79aa-48e1-b896-529fbfb4a2c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:35.923632 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be00c97a-79aa-48e1-b896-529fbfb4a2c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:10:35.925184 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be00c97a-79aa-48e1-b896-529fbfb4a2c6 service nova] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:10:35.934052 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 708/1416] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:10:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:10:36.912377 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34213d77-c21d-403d-b50a-a353543bc8ab None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:36.912910 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34213d77-c21d-403d-b50a-a353543bc8ab None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:36.912910 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34213d77-c21d-403d-b50a-a353543bc8ab None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:36.914298 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 709/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 18:10:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:10:36.919232 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9930263-19e1-4b21-a08d-d18ac47556e8 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:36.919617 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9930263-19e1-4b21-a08d-d18ac47556e8 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:36.919776 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9930263-19e1-4b21-a08d-d18ac47556e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:36.937109 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-e9930263-19e1-4b21-a08d-d18ac47556e8 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:10:36.938314 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-e9930263-19e1-4b21-a08d-d18ac47556e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:10:36.946648 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 709/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 18:10:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:10:37.103716 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34213d77-c21d-403d-b50a-a353543bc8ab None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:10:37.117364 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34213d77-c21d-403d-b50a-a353543bc8ab None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:10:37.122544 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f84c4b7-87d8-4496-8acf-9e06fc90afef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b430b739cb54fc7911bc89f8ea2df72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:10:37.123236 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84c4b7-87d8-4496-8acf-9e06fc90afef service nova] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:37.123514 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84c4b7-87d8-4496-8acf-9e06fc90afef service nova] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:37.123781 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84c4b7-87d8-4496-8acf-9e06fc90afef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:37.132155 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f84c4b7-87d8-4496-8acf-9e06fc90afef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:10:37.133781 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f84c4b7-87d8-4496-8acf-9e06fc90afef service nova] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:10:37.143375 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 710/1419] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:10:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:10:38.087946 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694036fd-a0fe-461f-ac89-27cafcb43344 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:38.088463 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694036fd-a0fe-461f-ac89-27cafcb43344 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:38.088463 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694036fd-a0fe-461f-ac89-27cafcb43344 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:38.089830 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 710/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 18:10:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:10:38.095325 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7fb051-876c-450b-a102-7fc269c4bf03 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:38.095770 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7fb051-876c-450b-a102-7fc269c4bf03 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:38.095876 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7fb051-876c-450b-a102-7fc269c4bf03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:38.113230 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-ed7fb051-876c-450b-a102-7fc269c4bf03 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:10:38.114464 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-ed7fb051-876c-450b-a102-7fc269c4bf03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:10:38.122037 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 711/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 18:10:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:10:38.270644 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694036fd-a0fe-461f-ac89-27cafcb43344 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:10:38.285322 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694036fd-a0fe-461f-ac89-27cafcb43344 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:10:38.290601 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f412bf66-1282-473c-b302-f9f832ad1791 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b430b739cb54fc7911bc89f8ea2df72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:10:38.291236 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f412bf66-1282-473c-b302-f9f832ad1791 service nova] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:38.291514 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f412bf66-1282-473c-b302-f9f832ad1791 service nova] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:38.291786 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f412bf66-1282-473c-b302-f9f832ad1791 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:38.299514 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f412bf66-1282-473c-b302-f9f832ad1791 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:10:38.301076 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f412bf66-1282-473c-b302-f9f832ad1791 service nova] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:10:38.310010 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 711/1422] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:10:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:10:39.224851 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f8dfe-412e-45f1-81be-562de819016a None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:39.225424 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f8dfe-412e-45f1-81be-562de819016a None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:39.225424 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f8dfe-412e-45f1-81be-562de819016a None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:39.226788 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 712/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 18:10:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:10:39.231716 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509d818-d660-4ea2-95af-3d8d3d138f60 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:39.232104 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509d818-d660-4ea2-95af-3d8d3d138f60 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:39.232261 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509d818-d660-4ea2-95af-3d8d3d138f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:39.250157 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-8509d818-d660-4ea2-95af-3d8d3d138f60 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:10:39.251341 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-8509d818-d660-4ea2-95af-3d8d3d138f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:10:39.258878 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 712/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 18:10:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:10:39.406389 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f8dfe-412e-45f1-81be-562de819016a None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:10:39.420666 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f8dfe-412e-45f1-81be-562de819016a None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:10:39.426588 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8181427e-f7d3-47ac-b1dc-af0fd16907cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b430b739cb54fc7911bc89f8ea2df72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:10:39.427210 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181427e-f7d3-47ac-b1dc-af0fd16907cb service nova] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:39.427492 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181427e-f7d3-47ac-b1dc-af0fd16907cb service nova] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:39.427774 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181427e-f7d3-47ac-b1dc-af0fd16907cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:39.435580 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8181427e-f7d3-47ac-b1dc-af0fd16907cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:10:39.437144 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8181427e-f7d3-47ac-b1dc-af0fd16907cb service nova] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:10:39.446508 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 713/1425] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:10:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:10:40.369788 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e506f64-0b0c-4996-8e42-223d31f78e36 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:40.370303 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e506f64-0b0c-4996-8e42-223d31f78e36 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:40.370566 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e506f64-0b0c-4996-8e42-223d31f78e36 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:40.371943 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 713/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 18:10:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:10:40.376745 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e7bc7-ea93-46e0-81f3-d1bbd223664d None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:40.377142 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e7bc7-ea93-46e0-81f3-d1bbd223664d None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:40.377329 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e7bc7-ea93-46e0-81f3-d1bbd223664d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:40.395343 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-124e7bc7-ea93-46e0-81f3-d1bbd223664d None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:10:40.396511 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-124e7bc7-ea93-46e0-81f3-d1bbd223664d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:10:40.404077 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 714/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 18:10:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:10:40.551363 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e506f64-0b0c-4996-8e42-223d31f78e36 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:10:40.566250 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e506f64-0b0c-4996-8e42-223d31f78e36 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:10:40.571784 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734946e4-ab70-44c9-83b3-305b3b8e40ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b430b739cb54fc7911bc89f8ea2df72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:10:40.572403 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734946e4-ab70-44c9-83b3-305b3b8e40ae service nova] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:40.572680 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734946e4-ab70-44c9-83b3-305b3b8e40ae service nova] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:40.572951 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734946e4-ab70-44c9-83b3-305b3b8e40ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:40.581407 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734946e4-ab70-44c9-83b3-305b3b8e40ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:10:40.582988 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734946e4-ab70-44c9-83b3-305b3b8e40ae service nova] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:10:40.591960 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 714/1428] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:10:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:10:41.470826 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcae7c6-f116-4b62-bbd0-4d1bb88d1e9b None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:41.471406 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcae7c6-f116-4b62-bbd0-4d1bb88d1e9b None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:41.471406 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcae7c6-f116-4b62-bbd0-4d1bb88d1e9b None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:41.472727 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 715/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 18:10:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:10:41.477631 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df370720-9078-4a79-9623-edb7ec727d76 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:41.478067 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df370720-9078-4a79-9623-edb7ec727d76 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:41.478170 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df370720-9078-4a79-9623-edb7ec727d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:41.496860 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-df370720-9078-4a79-9623-edb7ec727d76 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:10:41.498076 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-df370720-9078-4a79-9623-edb7ec727d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:10:41.506726 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 715/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 18:10:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:10:41.662791 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcae7c6-f116-4b62-bbd0-4d1bb88d1e9b None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:10:41.677551 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcae7c6-f116-4b62-bbd0-4d1bb88d1e9b None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:10:41.682832 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef219d-55f6-4857-8fe5-fcb2d595b5fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b430b739cb54fc7911bc89f8ea2df72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:10:41.683456 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef219d-55f6-4857-8fe5-fcb2d595b5fc service nova] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:41.683737 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef219d-55f6-4857-8fe5-fcb2d595b5fc service nova] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:41.684013 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef219d-55f6-4857-8fe5-fcb2d595b5fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:41.691938 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdef219d-55f6-4857-8fe5-fcb2d595b5fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:10:41.693544 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdef219d-55f6-4857-8fe5-fcb2d595b5fc service nova] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:10:41.702883 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 716/1431] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:10:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:10:42.566967 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb1e2b-d6cf-49a1-ba3a-c4d24644a010 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:42.567516 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb1e2b-d6cf-49a1-ba3a-c4d24644a010 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:42.567516 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb1e2b-d6cf-49a1-ba3a-c4d24644a010 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:42.568860 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 716/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 18:10:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:10:42.574091 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06132a73-81f5-474a-8a41-4d023281b7b2 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:42.574523 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06132a73-81f5-474a-8a41-4d023281b7b2 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:42.574633 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06132a73-81f5-474a-8a41-4d023281b7b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:42.592805 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-06132a73-81f5-474a-8a41-4d023281b7b2 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:10:42.594053 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-06132a73-81f5-474a-8a41-4d023281b7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:10:42.603792 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 717/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 18:10:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:10:42.753766 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eb1e2b-d6cf-49a1-ba3a-c4d24644a010 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:10:42.767561 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eb1e2b-d6cf-49a1-ba3a-c4d24644a010 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:10:42.772754 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820ef1f8-46e8-4636-b533-526d073131b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b430b739cb54fc7911bc89f8ea2df72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:10:42.773372 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ef1f8-46e8-4636-b533-526d073131b2 service nova] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:42.773672 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ef1f8-46e8-4636-b533-526d073131b2 service nova] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:42.773940 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ef1f8-46e8-4636-b533-526d073131b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:42.781686 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820ef1f8-46e8-4636-b533-526d073131b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:10:42.783493 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820ef1f8-46e8-4636-b533-526d073131b2 service nova] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:10:42.792382 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 717/1434] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:10:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:10:43.655362 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec5833-e517-42cb-b754-09c238c5a630 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:43.655936 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec5833-e517-42cb-b754-09c238c5a630 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:43.655936 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ec5833-e517-42cb-b754-09c238c5a630 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:43.658008 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 718/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 18:10:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:10:43.663123 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be7299-ce30-4c23-ba70-7c7381f6b714 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:43.663545 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be7299-ce30-4c23-ba70-7c7381f6b714 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:43.663671 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be7299-ce30-4c23-ba70-7c7381f6b714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:43.681114 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-75be7299-ce30-4c23-ba70-7c7381f6b714 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:10:43.682346 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-75be7299-ce30-4c23-ba70-7c7381f6b714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:10:43.690607 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 718/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 18:10:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:10:43.840588 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec5833-e517-42cb-b754-09c238c5a630 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:10:43.854533 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ec5833-e517-42cb-b754-09c238c5a630 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:10:43.859778 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb94542-bf1f-40c3-baa8-c4fce7bb6aa7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b430b739cb54fc7911bc89f8ea2df72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:10:43.860398 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb94542-bf1f-40c3-baa8-c4fce7bb6aa7 service nova] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:43.860678 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb94542-bf1f-40c3-baa8-c4fce7bb6aa7 service nova] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:43.860947 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb94542-bf1f-40c3-baa8-c4fce7bb6aa7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:43.868748 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb94542-bf1f-40c3-baa8-c4fce7bb6aa7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:10:43.870337 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb94542-bf1f-40c3-baa8-c4fce7bb6aa7 service nova] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:10:43.879778 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 719/1437] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:10:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:10:44.752265 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273a5a2-7fee-43f9-abdb-cb138a80f5b2 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:44.752841 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273a5a2-7fee-43f9-abdb-cb138a80f5b2 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:44.752841 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273a5a2-7fee-43f9-abdb-cb138a80f5b2 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:44.754236 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 719/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 18:10:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:10:44.759070 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01be33-a79c-4392-a3bf-44499f806b44 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:44.759466 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01be33-a79c-4392-a3bf-44499f806b44 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:44.759604 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c01be33-a79c-4392-a3bf-44499f806b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:44.776812 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-6c01be33-a79c-4392-a3bf-44499f806b44 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:10:44.778078 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-6c01be33-a79c-4392-a3bf-44499f806b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:10:44.786341 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 720/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 18:10:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:10:44.935373 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2273a5a2-7fee-43f9-abdb-cb138a80f5b2 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:10:44.951174 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2273a5a2-7fee-43f9-abdb-cb138a80f5b2 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:10:44.958804 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc0a85c-de27-4dde-bab0-13c9fe68726f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b430b739cb54fc7911bc89f8ea2df72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:10:44.959069 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0a85c-de27-4dde-bab0-13c9fe68726f service nova] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:44.959346 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0a85c-de27-4dde-bab0-13c9fe68726f service nova] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:44.960309 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc0a85c-de27-4dde-bab0-13c9fe68726f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:44.969399 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc0a85c-de27-4dde-bab0-13c9fe68726f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:10:44.971561 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc0a85c-de27-4dde-bab0-13c9fe68726f service nova] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:10:44.980693 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 720/1440] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:10:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:10:47.053523 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b260d31-f838-45bd-9823-947f70034a92 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:47.054058 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b260d31-f838-45bd-9823-947f70034a92 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:47.054058 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b260d31-f838-45bd-9823-947f70034a92 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:47.055372 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 721/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 18:10:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:10:47.060710 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfcc657-a0af-4f26-b973-34dcfad13ade None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:47.061156 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfcc657-a0af-4f26-b973-34dcfad13ade None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:47.061269 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfcc657-a0af-4f26-b973-34dcfad13ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:47.079690 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-dcfcc657-a0af-4f26-b973-34dcfad13ade None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:10:47.080868 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-dcfcc657-a0af-4f26-b973-34dcfad13ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:10:47.088599 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 721/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 18:10:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:10:47.126671 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b260d31-f838-45bd-9823-947f70034a92 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:10:47.136893 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b260d31-f838-45bd-9823-947f70034a92 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:10:47.140341 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a5047-074b-453d-b062-4787e6cd6cf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:10:47.140957 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a5047-074b-453d-b062-4787e6cd6cf6 service neutron] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:47.141236 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a5047-074b-453d-b062-4787e6cd6cf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:47.141553 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a5047-074b-453d-b062-4787e6cd6cf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:47.150408 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404a5047-074b-453d-b062-4787e6cd6cf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:10:47.151857 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404a5047-074b-453d-b062-4787e6cd6cf6 service neutron] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:10:47.161430 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 722/1443] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:10:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:10:49.496179 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab936ef6-7976-41c1-a2cb-862baf2e448c None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:49.496699 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab936ef6-7976-41c1-a2cb-862baf2e448c None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:49.496699 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab936ef6-7976-41c1-a2cb-862baf2e448c None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:49.498048 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 722/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 18:10:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:10:49.503298 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a954a-4a89-4083-95cf-cdb6268c4971 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:49.503728 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a954a-4a89-4083-95cf-cdb6268c4971 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:49.503853 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219a954a-4a89-4083-95cf-cdb6268c4971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:49.521348 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-219a954a-4a89-4083-95cf-cdb6268c4971 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:10:49.522573 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-219a954a-4a89-4083-95cf-cdb6268c4971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:10:49.530167 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 723/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 18:10:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:10:49.567485 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab936ef6-7976-41c1-a2cb-862baf2e448c None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:10:49.578010 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab936ef6-7976-41c1-a2cb-862baf2e448c None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:10:49.581969 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce3a60-e6f8-45b8-80a6-48a77b6b313d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:10:49.582586 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce3a60-e6f8-45b8-80a6-48a77b6b313d service neutron] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:49.582862 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce3a60-e6f8-45b8-80a6-48a77b6b313d service neutron] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:49.583133 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce3a60-e6f8-45b8-80a6-48a77b6b313d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:49.591850 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce3a60-e6f8-45b8-80a6-48a77b6b313d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:10:49.593298 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce3a60-e6f8-45b8-80a6-48a77b6b313d service neutron] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:10:49.608786 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 723/1446] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:10:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:10:52.111349 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab0eb6-d5a6-4be7-9f3d-5c08beab2aab None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:52.111797 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab0eb6-d5a6-4be7-9f3d-5c08beab2aab None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:52.111890 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab0eb6-d5a6-4be7-9f3d-5c08beab2aab None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:52.113262 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 724/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 18:10:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:10:52.118402 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d83e9-68d6-4dc3-9d46-65acf48c76f1 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:52.118823 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d83e9-68d6-4dc3-9d46-65acf48c76f1 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:52.118953 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0d83e9-68d6-4dc3-9d46-65acf48c76f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:52.136349 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-ff0d83e9-68d6-4dc3-9d46-65acf48c76f1 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:10:52.137548 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-ff0d83e9-68d6-4dc3-9d46-65acf48c76f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:10:52.145902 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 724/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 18:10:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:10:52.182993 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab0eb6-d5a6-4be7-9f3d-5c08beab2aab None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:10:52.194534 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab0eb6-d5a6-4be7-9f3d-5c08beab2aab None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:10:52.198065 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aceb591-ec69-4d6b-988a-73344d094519 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:10:52.198688 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aceb591-ec69-4d6b-988a-73344d094519 service neutron] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:52.198994 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aceb591-ec69-4d6b-988a-73344d094519 service neutron] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:52.199264 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aceb591-ec69-4d6b-988a-73344d094519 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:52.208388 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aceb591-ec69-4d6b-988a-73344d094519 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:10:52.209839 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aceb591-ec69-4d6b-988a-73344d094519 service neutron] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:10:52.218810 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 725/1449] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:10:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:10:54.537161 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e200752-cb4d-4edd-b746-d47a1444e384 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:54.537783 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e200752-cb4d-4edd-b746-d47a1444e384 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:54.537783 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e200752-cb4d-4edd-b746-d47a1444e384 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:54.539143 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 725/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 18:10:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:10:54.544432 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba7398-b1bb-495c-8d2b-e838ab3457f1 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:54.544864 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba7398-b1bb-495c-8d2b-e838ab3457f1 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:54.544993 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba7398-b1bb-495c-8d2b-e838ab3457f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:54.561986 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-78ba7398-b1bb-495c-8d2b-e838ab3457f1 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:10:54.563684 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-78ba7398-b1bb-495c-8d2b-e838ab3457f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:10:54.571556 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 726/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 18:10:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:10:54.609355 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e200752-cb4d-4edd-b746-d47a1444e384 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:10:54.620184 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e200752-cb4d-4edd-b746-d47a1444e384 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:10:54.623600 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa90aa8-056e-404e-b12a-49b8a0c61384 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:10:54.624224 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa90aa8-056e-404e-b12a-49b8a0c61384 service neutron] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:54.624499 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa90aa8-056e-404e-b12a-49b8a0c61384 service neutron] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:54.624768 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa90aa8-056e-404e-b12a-49b8a0c61384 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:54.633839 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa90aa8-056e-404e-b12a-49b8a0c61384 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:10:54.635285 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa90aa8-056e-404e-b12a-49b8a0c61384 service neutron] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:10:54.644232 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 726/1452] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:10:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:10:56.979563 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6efdf4e-8492-4b96-9962-9c46affff600 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:56.980145 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6efdf4e-8492-4b96-9962-9c46affff600 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:56.980145 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6efdf4e-8492-4b96-9962-9c46affff600 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:56.981478 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 727/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 18:10:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:10:56.987359 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297cdea-6497-4056-b576-2bc68c77371a None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:56.987805 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297cdea-6497-4056-b576-2bc68c77371a None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:56.987910 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2297cdea-6497-4056-b576-2bc68c77371a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:57.005502 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-2297cdea-6497-4056-b576-2bc68c77371a None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:10:57.006683 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-2297cdea-6497-4056-b576-2bc68c77371a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:10:57.014275 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 727/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 18:10:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:10:57.051422 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6efdf4e-8492-4b96-9962-9c46affff600 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:10:57.061804 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6efdf4e-8492-4b96-9962-9c46affff600 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:10:57.065886 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660b6e9-1cac-4f09-a8b9-9f084ff86b46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:10:57.066506 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660b6e9-1cac-4f09-a8b9-9f084ff86b46 service neutron] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:57.066782 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660b6e9-1cac-4f09-a8b9-9f084ff86b46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:57.067055 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660b6e9-1cac-4f09-a8b9-9f084ff86b46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:57.075853 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3660b6e9-1cac-4f09-a8b9-9f084ff86b46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:10:57.077269 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3660b6e9-1cac-4f09-a8b9-9f084ff86b46 service neutron] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:10:57.086308 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 728/1455] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:10:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:10:59.333780 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732a716-eb52-4d6b-84fc-538900e8c09e None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:59.334348 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732a716-eb52-4d6b-84fc-538900e8c09e None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:59.334348 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732a716-eb52-4d6b-84fc-538900e8c09e None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:59.335675 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 728/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 18:10:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:10:59.341213 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc78c4-8663-4f0d-8d05-916253b52357 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:59.341656 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc78c4-8663-4f0d-8d05-916253b52357 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:59.341799 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc78c4-8663-4f0d-8d05-916253b52357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:59.360724 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-efcc78c4-8663-4f0d-8d05-916253b52357 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:10:59.361990 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-efcc78c4-8663-4f0d-8d05-916253b52357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:10:59.372300 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 729/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 18:10:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:10:59.415128 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732a716-eb52-4d6b-84fc-538900e8c09e None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:10:59.425731 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732a716-eb52-4d6b-84fc-538900e8c09e None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:10:59.429187 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e7a25-7581-48de-9ca3-b3ff3f775850 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:10:59.429851 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e7a25-7581-48de-9ca3-b3ff3f775850 service neutron] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:59.430123 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e7a25-7581-48de-9ca3-b3ff3f775850 service neutron] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:59.430388 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e7a25-7581-48de-9ca3-b3ff3f775850 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:59.439479 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84e7a25-7581-48de-9ca3-b3ff3f775850 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:10:59.440887 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84e7a25-7581-48de-9ca3-b3ff3f775850 service neutron] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:10:59.450157 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 729/1458] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:10:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:11:01.705748 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b6898-d21c-4b07-9960-87dea8e6ad78 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:11:01.706320 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b6898-d21c-4b07-9960-87dea8e6ad78 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:11:01.706456 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b6898-d21c-4b07-9960-87dea8e6ad78 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:11:01.708202 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 730/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 18:11:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 18:11:01.714393 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39fd10e-5206-4830-a033-815fdc1767f9 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:11:01.714827 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39fd10e-5206-4830-a033-815fdc1767f9 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:11:01.714938 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39fd10e-5206-4830-a033-815fdc1767f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:11:01.732894 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-a39fd10e-5206-4830-a033-815fdc1767f9 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:11:01.734104 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-a39fd10e-5206-4830-a033-815fdc1767f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:11:01.742435 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 730/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 18:11:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:11:01.779206 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b6898-d21c-4b07-9960-87dea8e6ad78 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:11:01.790265 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b6898-d21c-4b07-9960-87dea8e6ad78 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:11:01.793797 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce706a95-5ff8-49e8-8acc-287093f27700 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:11:01.794421 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce706a95-5ff8-49e8-8acc-287093f27700 service neutron] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:11:01.794699 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce706a95-5ff8-49e8-8acc-287093f27700 service neutron] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:11:01.794972 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce706a95-5ff8-49e8-8acc-287093f27700 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:11:01.804177 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce706a95-5ff8-49e8-8acc-287093f27700 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:11:01.805631 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce706a95-5ff8-49e8-8acc-287093f27700 service neutron] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:11:01.814859 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 731/1461] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:11:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:11:04.058569 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27acfbd6-c7a8-4afd-8448-4c848d303f26 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:11:04.059153 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27acfbd6-c7a8-4afd-8448-4c848d303f26 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:11:04.059153 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27acfbd6-c7a8-4afd-8448-4c848d303f26 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:11:04.060515 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 731/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 18:11:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:11:04.065883 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5d1a2-52e4-465c-91e1-118bcd0b14f6 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:11:04.066325 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5d1a2-52e4-465c-91e1-118bcd0b14f6 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:11:04.066467 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5d1a2-52e4-465c-91e1-118bcd0b14f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:11:04.083760 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-a0d5d1a2-52e4-465c-91e1-118bcd0b14f6 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:11:04.084979 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-a0d5d1a2-52e4-465c-91e1-118bcd0b14f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:11:04.092471 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 732/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 18:11:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:11:04.129817 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27acfbd6-c7a8-4afd-8448-4c848d303f26 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:11:04.140143 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27acfbd6-c7a8-4afd-8448-4c848d303f26 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:11:04.144023 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea04ec-49ee-4e80-a98d-207cd230f8b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:11:04.144707 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea04ec-49ee-4e80-a98d-207cd230f8b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:11:04.144992 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea04ec-49ee-4e80-a98d-207cd230f8b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:11:04.145268 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea04ec-49ee-4e80-a98d-207cd230f8b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:11:04.153856 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eea04ec-49ee-4e80-a98d-207cd230f8b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:11:04.155269 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eea04ec-49ee-4e80-a98d-207cd230f8b3 service neutron] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:11:04.165243 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 732/1464] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:11:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:11:06.459173 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d4566-c3e7-45dd-b84f-e1d33a23c03c None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:11:06.459747 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d4566-c3e7-45dd-b84f-e1d33a23c03c None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:11:06.459747 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d4566-c3e7-45dd-b84f-e1d33a23c03c None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:11:06.461062 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 733/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 18:11:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:11:06.466253 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa17da1-aee3-4293-a6e1-bbce19604bb2 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:11:06.466659 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa17da1-aee3-4293-a6e1-bbce19604bb2 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:11:06.466814 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa17da1-aee3-4293-a6e1-bbce19604bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:11:06.484054 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-eaa17da1-aee3-4293-a6e1-bbce19604bb2 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:11:06.485246 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-eaa17da1-aee3-4293-a6e1-bbce19604bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:11:06.493633 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 733/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 18:11:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:11:06.529676 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5d4566-c3e7-45dd-b84f-e1d33a23c03c None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:11:06.540591 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5d4566-c3e7-45dd-b84f-e1d33a23c03c None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:11:06.544091 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc00c6-8fce-4669-844b-81e9c52204c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:11:06.544711 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc00c6-8fce-4669-844b-81e9c52204c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:11:06.544991 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc00c6-8fce-4669-844b-81e9c52204c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:11:06.545262 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc00c6-8fce-4669-844b-81e9c52204c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:11:06.553982 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bc00c6-8fce-4669-844b-81e9c52204c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:11:06.555397 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bc00c6-8fce-4669-844b-81e9c52204c6 service neutron] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:11:06.565280 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 734/1467] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:11:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:11:08.786431 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e08714-7ddc-433f-9625-0b1323450a45 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:11:08.787033 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e08714-7ddc-433f-9625-0b1323450a45 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:11:08.787033 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e08714-7ddc-433f-9625-0b1323450a45 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:11:08.788337 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 734/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 18:11:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:11:08.793682 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283ed2e-e7c4-499a-946a-d6707b4b9b77 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:11:08.794101 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283ed2e-e7c4-499a-946a-d6707b4b9b77 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:11:08.794208 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283ed2e-e7c4-499a-946a-d6707b4b9b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:11:08.811117 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-5283ed2e-e7c4-499a-946a-d6707b4b9b77 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:11:08.812276 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-5283ed2e-e7c4-499a-946a-d6707b4b9b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:11:08.820928 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 735/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 18:11:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:11:08.856854 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e08714-7ddc-433f-9625-0b1323450a45 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:11:08.868197 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e08714-7ddc-433f-9625-0b1323450a45 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:11:08.871701 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7533b4a0-c7f6-407f-8302-43c56f5f89e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:11:08.872324 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533b4a0-c7f6-407f-8302-43c56f5f89e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:11:08.872597 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533b4a0-c7f6-407f-8302-43c56f5f89e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:11:08.872866 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533b4a0-c7f6-407f-8302-43c56f5f89e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:11:08.882048 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7533b4a0-c7f6-407f-8302-43c56f5f89e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:11:08.883451 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7533b4a0-c7f6-407f-8302-43c56f5f89e5 service neutron] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:11:08.892381 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 735/1470] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:11:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:11:41.949776 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f027e-6143-4aba-b027-255699d10ff5 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:11:41.950382 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f027e-6143-4aba-b027-255699d10ff5 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:11:41.950382 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f027e-6143-4aba-b027-255699d10ff5 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:11:41.951745 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 736/1471] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:11:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:11:41.957870 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4997c3e-ab4c-4d5e-82ac-c5c51fe6b186 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:11:41.958536 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4997c3e-ab4c-4d5e-82ac-c5c51fe6b186 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:11:41.958536 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4997c3e-ab4c-4d5e-82ac-c5c51fe6b186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:11:41.976506 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-d4997c3e-ab4c-4d5e-82ac-c5c51fe6b186 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:11:41.977788 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-d4997c3e-ab4c-4d5e-82ac-c5c51fe6b186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:11:41.986711 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 736/1472] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:11:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:11:42.032873 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1200efa-fbea-483e-bdf3-6ef3f0f196c8 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:11:42.033157 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1200efa-fbea-483e-bdf3-6ef3f0f196c8 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:11:42.033432 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1200efa-fbea-483e-bdf3-6ef3f0f196c8 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:11:42.034795 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 737/1473] 10.222.0.65 () {54 vars in 962 bytes} [Tue May 17 18:11:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:11:42.039366 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490205af-fb34-4b83-a931-687f15fcfbc2 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:11:42.039645 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490205af-fb34-4b83-a931-687f15fcfbc2 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:11:42.039918 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490205af-fb34-4b83-a931-687f15fcfbc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:11:42.057812 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-490205af-fb34-4b83-a931-687f15fcfbc2 None None] MFA Rules not processed for user `ce570634a66b45158d940151828f533a`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:11:42.058974 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-490205af-fb34-4b83-a931-687f15fcfbc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:11:42.065772 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 737/1474] 10.222.0.65 () {58 vars in 1059 bytes} [Tue May 17 18:11:42 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:11:42.073221 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1200efa-fbea-483e-bdf3-6ef3f0f196c8 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:11:42.083312 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1200efa-fbea-483e-bdf3-6ef3f0f196c8 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:11:42.086775 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f490abf-f1af-46f4-8ede-2f493a6679ad service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce570634a66b45158d940151828f533a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:11:42.087334 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f490abf-f1af-46f4-8ede-2f493a6679ad service glance] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:11:42.087609 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f490abf-f1af-46f4-8ede-2f493a6679ad service glance] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:11:42.087876 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f490abf-f1af-46f4-8ede-2f493a6679ad service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:11:42.096286 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f490abf-f1af-46f4-8ede-2f493a6679ad service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:11:42.097727 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f490abf-f1af-46f4-8ede-2f493a6679ad service glance] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:11:42.106691 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 738/1475] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:11:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:11:44.405951 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2910f7-1a53-4001-8662-289d11a740c5 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:11:44.406472 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2910f7-1a53-4001-8662-289d11a740c5 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:11:44.406472 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2910f7-1a53-4001-8662-289d11a740c5 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:11:44.407776 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 738/1476] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:11:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:11:44.413053 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182934d0-efcb-47c9-b644-b578185b9320 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:11:44.413502 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182934d0-efcb-47c9-b644-b578185b9320 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:11:44.413660 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182934d0-efcb-47c9-b644-b578185b9320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:11:44.431303 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-182934d0-efcb-47c9-b644-b578185b9320 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:11:44.432469 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-182934d0-efcb-47c9-b644-b578185b9320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:11:44.440603 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 739/1477] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:11:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:11:44.463291 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2910f7-1a53-4001-8662-289d11a740c5 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:11:44.475782 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2910f7-1a53-4001-8662-289d11a740c5 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:11:44.480164 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad20e9b2-8fb7-40d2-afd7-90d12c7422d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:11:44.480784 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad20e9b2-8fb7-40d2-afd7-90d12c7422d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:11:44.481056 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad20e9b2-8fb7-40d2-afd7-90d12c7422d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:11:44.481323 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad20e9b2-8fb7-40d2-afd7-90d12c7422d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:11:44.482084 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad20e9b2-8fb7-40d2-afd7-90d12c7422d5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:11:44.484394 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: WARNING py.warnings [None req-ad20e9b2-8fb7-40d2-afd7-90d12c7422d5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 18:11:44.484394 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: warnings.warn(msg) May 17 18:11:44.484394 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: May 17 18:11:44.485541 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad20e9b2-8fb7-40d2-afd7-90d12c7422d5 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:11:44.503707 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 739/1478] 10.222.0.65 () {56 vars in 1108 bytes} [Tue May 17 18:11:44 2022] GET /identity/v3/projects => generated 2553 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:11:46.762034 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cceb2b7-e3d6-4afc-8a1e-6f956122cefc None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:11:46.762581 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cceb2b7-e3d6-4afc-8a1e-6f956122cefc None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:11:46.762581 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cceb2b7-e3d6-4afc-8a1e-6f956122cefc None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:11:46.763961 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 740/1479] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:11:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:11:46.769772 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff358b5-d468-49d1-9eda-1648b279c181 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:11:46.770174 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff358b5-d468-49d1-9eda-1648b279c181 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:11:46.770323 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff358b5-d468-49d1-9eda-1648b279c181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:11:46.788462 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-fff358b5-d468-49d1-9eda-1648b279c181 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:11:46.789675 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-fff358b5-d468-49d1-9eda-1648b279c181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:11:46.797200 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 740/1480] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:11:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:11:46.839272 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cceb2b7-e3d6-4afc-8a1e-6f956122cefc None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:11:46.853244 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cceb2b7-e3d6-4afc-8a1e-6f956122cefc None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:11:46.858933 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed27f4a-3b80-4e4e-be7b-da62f5932ca5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b430b739cb54fc7911bc89f8ea2df72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:11:46.859554 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed27f4a-3b80-4e4e-be7b-da62f5932ca5 service nova] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:11:46.859828 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed27f4a-3b80-4e4e-be7b-da62f5932ca5 service nova] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:11:46.860096 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed27f4a-3b80-4e4e-be7b-da62f5932ca5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:11:46.867841 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed27f4a-3b80-4e4e-be7b-da62f5932ca5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:11:46.869406 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed27f4a-3b80-4e4e-be7b-da62f5932ca5 service nova] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:11:46.878969 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 741/1481] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:11:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:11:49.270444 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf3799-9d71-4916-a2d5-baaac928ffb7 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:11:49.271015 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf3799-9d71-4916-a2d5-baaac928ffb7 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:11:49.271130 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf3799-9d71-4916-a2d5-baaac928ffb7 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:11:49.272460 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 741/1482] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:11:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:11:49.277568 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f386157a-b860-4c5b-ba73-4ac51a07d21c None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:11:49.277991 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f386157a-b860-4c5b-ba73-4ac51a07d21c None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:11:49.278112 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f386157a-b860-4c5b-ba73-4ac51a07d21c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:11:49.295015 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-f386157a-b860-4c5b-ba73-4ac51a07d21c None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:11:49.296186 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-f386157a-b860-4c5b-ba73-4ac51a07d21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:11:49.303783 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 742/1483] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:11:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:11:49.340309 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf3799-9d71-4916-a2d5-baaac928ffb7 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:11:49.350834 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf3799-9d71-4916-a2d5-baaac928ffb7 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:11:49.354304 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8d3cc6-9385-4272-98d4-35c4f7ef2070 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:11:49.354921 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d3cc6-9385-4272-98d4-35c4f7ef2070 service neutron] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:11:49.355195 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d3cc6-9385-4272-98d4-35c4f7ef2070 service neutron] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:11:49.355461 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8d3cc6-9385-4272-98d4-35c4f7ef2070 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:11:49.364496 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8d3cc6-9385-4272-98d4-35c4f7ef2070 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:11:49.365935 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8d3cc6-9385-4272-98d4-35c4f7ef2070 service neutron] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:11:49.374925 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 742/1484] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:11:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:11:51.639157 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acbae34-5096-4194-929d-b9b8f597274d None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:11:51.640233 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acbae34-5096-4194-929d-b9b8f597274d None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:11:51.640233 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acbae34-5096-4194-929d-b9b8f597274d None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:11:51.641681 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 743/1485] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:11:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:11:51.647148 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84b4fe-8b25-4f96-8cd5-960ead5cba3a None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:11:51.647562 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84b4fe-8b25-4f96-8cd5-960ead5cba3a None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:11:51.647716 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84b4fe-8b25-4f96-8cd5-960ead5cba3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:11:51.665367 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-dc84b4fe-8b25-4f96-8cd5-960ead5cba3a None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:11:51.666588 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-dc84b4fe-8b25-4f96-8cd5-960ead5cba3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:11:51.674366 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 743/1486] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:11:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:11:51.711804 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acbae34-5096-4194-929d-b9b8f597274d None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:11:51.722802 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acbae34-5096-4194-929d-b9b8f597274d None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:11:51.726238 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b88b15-d9c7-402c-9f0f-78a4738ca08f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:11:51.726858 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b88b15-d9c7-402c-9f0f-78a4738ca08f service neutron] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:11:51.727132 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b88b15-d9c7-402c-9f0f-78a4738ca08f service neutron] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:11:51.727404 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b88b15-d9c7-402c-9f0f-78a4738ca08f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:11:51.735938 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b88b15-d9c7-402c-9f0f-78a4738ca08f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:11:51.737334 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b88b15-d9c7-402c-9f0f-78a4738ca08f service neutron] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:11:51.746453 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 744/1487] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:11:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:11:54.089086 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366ffac-ea11-40b8-93a2-5524d9dde3ec None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:11:54.089648 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366ffac-ea11-40b8-93a2-5524d9dde3ec None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:11:54.089648 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366ffac-ea11-40b8-93a2-5524d9dde3ec None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:11:54.090946 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 744/1488] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 18:11:54.096419 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda1cef-7511-4b0e-9b05-bdb0f400bd84 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:11:54.096870 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda1cef-7511-4b0e-9b05-bdb0f400bd84 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:11:54.096979 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda1cef-7511-4b0e-9b05-bdb0f400bd84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:11:54.114690 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-cfda1cef-7511-4b0e-9b05-bdb0f400bd84 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:11:54.115878 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-cfda1cef-7511-4b0e-9b05-bdb0f400bd84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:11:54.123549 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 745/1489] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:11:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:11:54.163615 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366ffac-ea11-40b8-93a2-5524d9dde3ec None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:11:54.174942 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366ffac-ea11-40b8-93a2-5524d9dde3ec None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:11:54.178415 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b9b153-d759-4709-baf0-4786e29245eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:11:54.179044 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9b153-d759-4709-baf0-4786e29245eb service neutron] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:11:54.179324 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9b153-d759-4709-baf0-4786e29245eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:11:54.179598 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b9b153-d759-4709-baf0-4786e29245eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:11:54.189058 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b9b153-d759-4709-baf0-4786e29245eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:11:54.190569 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b9b153-d759-4709-baf0-4786e29245eb service neutron] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:11:54.200173 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 745/1490] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:11:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:11:56.574268 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54991561-6786-4e5c-9a0b-79f885bb1002 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:11:56.574837 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54991561-6786-4e5c-9a0b-79f885bb1002 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:11:56.574837 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54991561-6786-4e5c-9a0b-79f885bb1002 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:11:56.576089 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 746/1491] 10.222.0.65 () {54 vars in 926 bytes} [Tue May 17 18:11:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:11:56.581841 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31b353-b53f-420b-8626-0faa14721c53 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:11:56.582283 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31b353-b53f-420b-8626-0faa14721c53 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:11:56.582385 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea31b353-b53f-420b-8626-0faa14721c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:11:56.599553 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-ea31b353-b53f-420b-8626-0faa14721c53 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:11:56.600736 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-ea31b353-b53f-420b-8626-0faa14721c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:11:56.608322 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 746/1492] 10.222.0.65 () {58 vars in 1023 bytes} [Tue May 17 18:11:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:11:56.646514 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54991561-6786-4e5c-9a0b-79f885bb1002 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:11:56.656944 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54991561-6786-4e5c-9a0b-79f885bb1002 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:11:56.660402 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43207e4d-32dc-498c-83d2-0e78df4b50e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:11:56.661018 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43207e4d-32dc-498c-83d2-0e78df4b50e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:11:56.661294 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43207e4d-32dc-498c-83d2-0e78df4b50e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:11:56.661602 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43207e4d-32dc-498c-83d2-0e78df4b50e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:11:56.670189 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43207e4d-32dc-498c-83d2-0e78df4b50e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:11:56.671604 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43207e4d-32dc-498c-83d2-0e78df4b50e0 service neutron] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:11:56.680593 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 747/1493] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:11:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:13:47.019818 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999f55c-7b5b-4b22-b600-f233070a0b42 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:47.020386 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999f55c-7b5b-4b22-b600-f233070a0b42 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:47.020386 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999f55c-7b5b-4b22-b600-f233070a0b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:47.038281 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-7999f55c-7b5b-4b22-b600-f233070a0b42 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:47.039479 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-7999f55c-7b5b-4b22-b600-f233070a0b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:47.047761 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 747/1494] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:13:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:13:47.057050 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bfb528-37e0-461c-84dc-f67bb421a961 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:47.057572 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bfb528-37e0-461c-84dc-f67bb421a961 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:47.057692 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bfb528-37e0-461c-84dc-f67bb421a961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:47.075549 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-94bfb528-37e0-461c-84dc-f67bb421a961 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:47.076720 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-94bfb528-37e0-461c-84dc-f67bb421a961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:47.084228 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 748/1495] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:13:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:13:47.088738 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999f55c-7b5b-4b22-b600-f233070a0b42 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:47.098685 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999f55c-7b5b-4b22-b600-f233070a0b42 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:47.103142 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30994bb-0625-4e10-a9ed-11a4b80f0cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:47.103781 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30994bb-0625-4e10-a9ed-11a4b80f0cbf admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:47.104063 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30994bb-0625-4e10-a9ed-11a4b80f0cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:47.104337 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30994bb-0625-4e10-a9ed-11a4b80f0cbf admin admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:47.105051 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30994bb-0625-4e10-a9ed-11a4b80f0cbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:13:47.105371 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30994bb-0625-4e10-a9ed-11a4b80f0cbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:47.106414 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: WARNING py.warnings [None req-f30994bb-0625-4e10-a9ed-11a4b80f0cbf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 18:13:47.106414 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: warnings.warn(msg) May 17 18:13:47.106414 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: May 17 18:13:47.107273 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30994bb-0625-4e10-a9ed-11a4b80f0cbf admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:47.118254 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 748/1496] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 17 18:13:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:13:47.125987 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bfb528-37e0-461c-84dc-f67bb421a961 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:47.134577 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bfb528-37e0-461c-84dc-f67bb421a961 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:47.139470 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb10ad-41ba-4c67-a8c2-b16e788aeaad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:47.140097 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb10ad-41ba-4c67-a8c2-b16e788aeaad admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:47.140371 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb10ad-41ba-4c67-a8c2-b16e788aeaad admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:47.140640 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb10ad-41ba-4c67-a8c2-b16e788aeaad admin admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:47.141315 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bb10ad-41ba-4c67-a8c2-b16e788aeaad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:47.143115 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: WARNING py.warnings [None req-c9bb10ad-41ba-4c67-a8c2-b16e788aeaad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 18:13:47.143115 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: warnings.warn(msg) May 17 18:13:47.143115 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: May 17 18:13:47.144278 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bb10ad-41ba-4c67-a8c2-b16e788aeaad admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:47.184756 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 749/1497] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:13:47 2022] POST /identity/v3/projects => generated 379 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:13:47.186106 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30994bb-0625-4e10-a9ed-11a4b80f0cbf admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:47.197646 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30994bb-0625-4e10-a9ed-11a4b80f0cbf admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:47.250779 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f931b9-95e6-44a1-b7a3-0ad269a61ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:47.251436 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f931b9-95e6-44a1-b7a3-0ad269a61ef9 admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:47.251713 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f931b9-95e6-44a1-b7a3-0ad269a61ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:47.251985 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f931b9-95e6-44a1-b7a3-0ad269a61ef9 admin admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:47.252659 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f931b9-95e6-44a1-b7a3-0ad269a61ef9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:47.253696 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: WARNING py.warnings [None req-28f931b9-95e6-44a1-b7a3-0ad269a61ef9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 18:13:47.253696 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: warnings.warn(msg) May 17 18:13:47.253696 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: May 17 18:13:47.254882 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f931b9-95e6-44a1-b7a3-0ad269a61ef9 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:47.274178 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 749/1498] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:13:47 2022] POST /identity/v3/users => generated 290 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:13:47.278842 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb10ad-41ba-4c67-a8c2-b16e788aeaad admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:47.288590 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb10ad-41ba-4c67-a8c2-b16e788aeaad admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:47.293033 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd10a4-1d65-4a8e-b16b-d2d1d1a05513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:47.293705 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd10a4-1d65-4a8e-b16b-d2d1d1a05513 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:47.293982 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd10a4-1d65-4a8e-b16b-d2d1d1a05513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:47.294248 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd10a4-1d65-4a8e-b16b-d2d1d1a05513 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:47.294955 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd10a4-1d65-4a8e-b16b-d2d1d1a05513 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:47.295953 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: WARNING py.warnings [None req-acfd10a4-1d65-4a8e-b16b-d2d1d1a05513 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 18:13:47.295953 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: warnings.warn(msg) May 17 18:13:47.295953 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: May 17 18:13:47.296896 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd10a4-1d65-4a8e-b16b-d2d1d1a05513 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:47.309310 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 750/1499] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:13:47.313353 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f931b9-95e6-44a1-b7a3-0ad269a61ef9 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:47.323195 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f931b9-95e6-44a1-b7a3-0ad269a61ef9 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:47.328324 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299849f7-d9b2-4075-9a0c-0addf1d1f260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:47.328970 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299849f7-d9b2-4075-9a0c-0addf1d1f260 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:47.329249 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299849f7-d9b2-4075-9a0c-0addf1d1f260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:47.329551 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299849f7-d9b2-4075-9a0c-0addf1d1f260 admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:47.330268 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299849f7-d9b2-4075-9a0c-0addf1d1f260 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:47.331282 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: WARNING py.warnings [None req-299849f7-d9b2-4075-9a0c-0addf1d1f260 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 18:13:47.331282 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: warnings.warn(msg) May 17 18:13:47.331282 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: May 17 18:13:47.332166 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299849f7-d9b2-4075-9a0c-0addf1d1f260 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:47.345877 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 750/1500] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:13:47.350134 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd10a4-1d65-4a8e-b16b-d2d1d1a05513 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:47.360429 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd10a4-1d65-4a8e-b16b-d2d1d1a05513 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:47.365578 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4612ec47-fb43-446b-8aaa-9ed2623fc97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:47.366453 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612ec47-fb43-446b-8aaa-9ed2623fc97d admin admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:47.366732 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612ec47-fb43-446b-8aaa-9ed2623fc97d admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:47.367005 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4612ec47-fb43-446b-8aaa-9ed2623fc97d admin admin] PATH_INFO: `/v3/projects/6b9970dbab3246369aed0d80eb790cf8/users/43be021df53345a68e3bd62119a0ed05/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:47.382506 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4612ec47-fb43-446b-8aaa-9ed2623fc97d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b9970dbab3246369aed0d80eb790cf8, user_id=43be021df53345a68e3bd62119a0ed05, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:47.383666 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: WARNING py.warnings [None req-4612ec47-fb43-446b-8aaa-9ed2623fc97d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 18:13:47.383666 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: warnings.warn(msg) May 17 18:13:47.383666 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: May 17 18:13:47.385680 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4612ec47-fb43-446b-8aaa-9ed2623fc97d admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:47.398832 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 751/1501] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:13:47 2022] PUT /identity/v3/projects/6b9970dbab3246369aed0d80eb790cf8/users/43be021df53345a68e3bd62119a0ed05/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:47.412611 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17560779-5d46-44a9-acbd-d792afbffdb1 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:47.412900 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17560779-5d46-44a9-acbd-d792afbffdb1 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:47.413219 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17560779-5d46-44a9-acbd-d792afbffdb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:47.439133 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-17560779-5d46-44a9-acbd-d792afbffdb1 None None] MFA Rules not processed for user `43be021df53345a68e3bd62119a0ed05`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:47.440377 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-17560779-5d46-44a9-acbd-d792afbffdb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:47.501370 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 751/1502] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:13:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:13:47.514985 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101aba2c-5724-4b27-bc47-919bca1a4190 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:47.515274 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101aba2c-5724-4b27-bc47-919bca1a4190 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:47.515552 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101aba2c-5724-4b27-bc47-919bca1a4190 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:47.516902 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 752/1503] 10.222.0.65 () {54 vars in 963 bytes} [Tue May 17 18:13:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:13:47.521565 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6dcd02-95ad-4483-9c44-4922e9a53b2c None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:47.521858 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6dcd02-95ad-4483-9c44-4922e9a53b2c None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:47.522142 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6dcd02-95ad-4483-9c44-4922e9a53b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:47.539927 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-9c6dcd02-95ad-4483-9c44-4922e9a53b2c None None] MFA Rules not processed for user `769f675c28e34902a079c70dab44dbf8`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:47.541070 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-9c6dcd02-95ad-4483-9c44-4922e9a53b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:47.590480 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 752/1504] 10.222.0.65 () {58 vars in 1060 bytes} [Tue May 17 18:13:47 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:13:47.597967 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101aba2c-5724-4b27-bc47-919bca1a4190 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:47.608161 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101aba2c-5724-4b27-bc47-919bca1a4190 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:47.611599 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f176f0-67fd-4cff-8745-fbb345866413 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:47.612211 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f176f0-67fd-4cff-8745-fbb345866413 service cinder] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:47.612492 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f176f0-67fd-4cff-8745-fbb345866413 service cinder] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:47.612764 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f176f0-67fd-4cff-8745-fbb345866413 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:47.620580 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f176f0-67fd-4cff-8745-fbb345866413 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:47.622516 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f176f0-67fd-4cff-8745-fbb345866413 service cinder] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:47.630788 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 753/1505] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:13:47 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:13:47.676330 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d6314-d302-405b-8438-dcb06ea43fd9 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:47.676625 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d6314-d302-405b-8438-dcb06ea43fd9 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:47.676905 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d6314-d302-405b-8438-dcb06ea43fd9 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:47.678360 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 753/1506] 10.222.0.65 () {52 vars in 829 bytes} [Tue May 17 18:13:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:13:47.682209 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f176f0-67fd-4cff-8745-fbb345866413 service cinder] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:47.742928 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f176f0-67fd-4cff-8745-fbb345866413 service cinder] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:47.747937 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150fd5a3-e246-4ed8-957d-7aee73ffb1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:47.748794 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150fd5a3-e246-4ed8-957d-7aee73ffb1f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:47.749073 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150fd5a3-e246-4ed8-957d-7aee73ffb1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:47.749349 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150fd5a3-e246-4ed8-957d-7aee73ffb1f4 admin admin] PATH_INFO: `/v3/users/43be021df53345a68e3bd62119a0ed05` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:47.750556 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150fd5a3-e246-4ed8-957d-7aee73ffb1f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43be021df53345a68e3bd62119a0ed05)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:47.751564 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: WARNING py.warnings [None req-150fd5a3-e246-4ed8-957d-7aee73ffb1f4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 18:13:47.751564 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: warnings.warn(msg) May 17 18:13:47.751564 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: May 17 18:13:47.752773 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150fd5a3-e246-4ed8-957d-7aee73ffb1f4 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:47.814800 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-150fd5a3-e246-4ed8-957d-7aee73ffb1f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43be021df53345a68e3bd62119a0ed05'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:47.834184 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-150fd5a3-e246-4ed8-957d-7aee73ffb1f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43be021df53345a68e3bd62119a0ed05'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:47.834872 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-150fd5a3-e246-4ed8-957d-7aee73ffb1f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43be021df53345a68e3bd62119a0ed05'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:47.835570 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-150fd5a3-e246-4ed8-957d-7aee73ffb1f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43be021df53345a68e3bd62119a0ed05'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:47.847443 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-150fd5a3-e246-4ed8-957d-7aee73ffb1f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43be021df53345a68e3bd62119a0ed05'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:47.861952 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 754/1507] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:13:47 2022] DELETE /identity/v3/users/43be021df53345a68e3bd62119a0ed05 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:47.866333 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc42be-edc9-4221-83c3-b9012fdfcc33 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:47.866649 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc42be-edc9-4221-83c3-b9012fdfcc33 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:47.866931 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdc42be-edc9-4221-83c3-b9012fdfcc33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:47.884590 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-acdc42be-edc9-4221-83c3-b9012fdfcc33 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:47.885827 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-acdc42be-edc9-4221-83c3-b9012fdfcc33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:47.942393 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 754/1508] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:13:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:13:47.952624 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150fd5a3-e246-4ed8-957d-7aee73ffb1f4 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:47.954063 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-150fd5a3-e246-4ed8-957d-7aee73ffb1f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:48.007607 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150fd5a3-e246-4ed8-957d-7aee73ffb1f4 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:48.011112 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c1e76-5bac-4934-ac27-0bd1230b1285 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:48.012259 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c1e76-5bac-4934-ac27-0bd1230b1285 service neutron] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:48.012529 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c1e76-5bac-4934-ac27-0bd1230b1285 service neutron] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:48.012791 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c1e76-5bac-4934-ac27-0bd1230b1285 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:48.021360 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c1e76-5bac-4934-ac27-0bd1230b1285 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:48.022809 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2c1e76-5bac-4934-ac27-0bd1230b1285 service neutron] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:48.032366 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 755/1509] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:13:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:13:48.357526 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc42be-edc9-4221-83c3-b9012fdfcc33 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:48.358964 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-acdc42be-edc9-4221-83c3-b9012fdfcc33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:48.370491 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdc42be-edc9-4221-83c3-b9012fdfcc33 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:48.376171 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1139bd-301b-4d99-a109-d005c577ce66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:48.377208 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1139bd-301b-4d99-a109-d005c577ce66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:48.377601 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1139bd-301b-4d99-a109-d005c577ce66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:48.378129 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1139bd-301b-4d99-a109-d005c577ce66 admin admin] PATH_INFO: `/v3/projects/6b9970dbab3246369aed0d80eb790cf8` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:48.380275 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1139bd-301b-4d99-a109-d005c577ce66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b9970dbab3246369aed0d80eb790cf8)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:48.380861 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: WARNING py.warnings [None req-fc1139bd-301b-4d99-a109-d005c577ce66 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 18:13:48.380861 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: warnings.warn(msg) May 17 18:13:48.380861 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: May 17 18:13:48.382090 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1139bd-301b-4d99-a109-d005c577ce66 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:48.443238 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-fc1139bd-301b-4d99-a109-d005c577ce66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b9970dbab3246369aed0d80eb790cf8', 'request_id': 'req-fc1139bd-301b-4d99-a109-d005c577ce66'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:48.457010 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-fc1139bd-301b-4d99-a109-d005c577ce66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b9970dbab3246369aed0d80eb790cf8', 'request_id': 'req-fc1139bd-301b-4d99-a109-d005c577ce66'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:48.467313 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-fc1139bd-301b-4d99-a109-d005c577ce66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b9970dbab3246369aed0d80eb790cf8', 'request_id': 'req-fc1139bd-301b-4d99-a109-d005c577ce66'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:48.478429 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-fc1139bd-301b-4d99-a109-d005c577ce66 admin admin] The token cache is being invalidate because project 6b9970dbab3246369aed0d80eb790cf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:13:48.478744 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-fc1139bd-301b-4d99-a109-d005c577ce66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:48.479474 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-fc1139bd-301b-4d99-a109-d005c577ce66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:48.481064 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 755/1510] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:13:48 2022] DELETE /identity/v3/projects/6b9970dbab3246369aed0d80eb790cf8 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:15:27.797013 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db563b5-f7e3-4efb-a794-1055331ed16e None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:27.797625 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db563b5-f7e3-4efb-a794-1055331ed16e None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:27.797625 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db563b5-f7e3-4efb-a794-1055331ed16e None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:27.798964 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 756/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 18:15:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:15:27.803948 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a99f70-df3d-40ac-89d7-376c0ca961f2 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:27.804389 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a99f70-df3d-40ac-89d7-376c0ca961f2 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:27.804525 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a99f70-df3d-40ac-89d7-376c0ca961f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:27.822534 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-f0a99f70-df3d-40ac-89d7-376c0ca961f2 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:15:27.823722 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-f0a99f70-df3d-40ac-89d7-376c0ca961f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:15:27.881312 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 756/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 18:15:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:15:28.056856 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db563b5-f7e3-4efb-a794-1055331ed16e None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:15:28.058883 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-8db563b5-f7e3-4efb-a794-1055331ed16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:15:28.135563 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db563b5-f7e3-4efb-a794-1055331ed16e None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:15:28.142380 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f467ab-f4f7-4b89-90c1-f29b63163448 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b430b739cb54fc7911bc89f8ea2df72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:15:28.143239 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f467ab-f4f7-4b89-90c1-f29b63163448 service nova] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:28.143641 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f467ab-f4f7-4b89-90c1-f29b63163448 service nova] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:28.144098 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f467ab-f4f7-4b89-90c1-f29b63163448 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:28.153955 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f467ab-f4f7-4b89-90c1-f29b63163448 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:15:28.156147 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f467ab-f4f7-4b89-90c1-f29b63163448 service nova] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:15:28.165142 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 757/1513] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:15:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:15:29.091995 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afadb71a-7524-4730-8d38-399ad5aa3ae9 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:29.093050 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afadb71a-7524-4730-8d38-399ad5aa3ae9 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:29.093050 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afadb71a-7524-4730-8d38-399ad5aa3ae9 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:29.094388 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 757/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 18:15:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:15:29.099761 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85efcd-92e3-4a8e-937e-fa104d69356e None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:29.100220 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85efcd-92e3-4a8e-937e-fa104d69356e None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:29.100349 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85efcd-92e3-4a8e-937e-fa104d69356e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:29.118480 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-4c85efcd-92e3-4a8e-937e-fa104d69356e None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:15:29.119666 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-4c85efcd-92e3-4a8e-937e-fa104d69356e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:15:29.127273 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 758/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 18:15:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:15:29.276699 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afadb71a-7524-4730-8d38-399ad5aa3ae9 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:15:29.291682 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afadb71a-7524-4730-8d38-399ad5aa3ae9 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:15:29.297888 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b6046a-dda0-4da7-ad6c-5d1105f23698 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b430b739cb54fc7911bc89f8ea2df72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:15:29.298518 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6046a-dda0-4da7-ad6c-5d1105f23698 service nova] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:29.298796 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6046a-dda0-4da7-ad6c-5d1105f23698 service nova] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:29.299067 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6046a-dda0-4da7-ad6c-5d1105f23698 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:29.307188 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b6046a-dda0-4da7-ad6c-5d1105f23698 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:15:29.308785 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b6046a-dda0-4da7-ad6c-5d1105f23698 service nova] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:15:29.318119 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 758/1516] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:15:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:15:29.648844 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cec3eb-58c0-4944-84ce-6157a48ae5f0 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:29.649132 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cec3eb-58c0-4944-84ce-6157a48ae5f0 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:29.649408 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cec3eb-58c0-4944-84ce-6157a48ae5f0 None None] PATH_INFO: `/v3` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:29.650757 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 759/1517] 10.222.0.59 () {54 vars in 925 bytes} [Tue May 17 18:15:29 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:15:29.659147 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454302ae-f6e1-4f54-87d4-c70d48377d80 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:29.659437 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454302ae-f6e1-4f54-87d4-c70d48377d80 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:29.659718 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454302ae-f6e1-4f54-87d4-c70d48377d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:29.677982 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-454302ae-f6e1-4f54-87d4-c70d48377d80 None None] MFA Rules not processed for user `33ddf11ac3e14d03b1159868b3b73fa4`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:15:29.679174 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-454302ae-f6e1-4f54-87d4-c70d48377d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:15:29.742957 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 759/1518] 10.222.0.59 () {58 vars in 1015 bytes} [Tue May 17 18:15:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:15:33.739238 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797bef03-067a-4230-b20c-fab25bb42b63 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:33.739771 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797bef03-067a-4230-b20c-fab25bb42b63 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:33.739771 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797bef03-067a-4230-b20c-fab25bb42b63 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:33.741098 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 760/1519] 10.222.0.65 () {54 vars in 960 bytes} [Tue May 17 18:15:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:15:33.746028 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d779490-79d4-4cd9-abdd-d15ceab287d7 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:33.746494 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d779490-79d4-4cd9-abdd-d15ceab287d7 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:33.746599 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d779490-79d4-4cd9-abdd-d15ceab287d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:33.763853 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-0d779490-79d4-4cd9-abdd-d15ceab287d7 None None] MFA Rules not processed for user `33ddf11ac3e14d03b1159868b3b73fa4`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:15:33.765033 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-0d779490-79d4-4cd9-abdd-d15ceab287d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:15:33.773588 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 760/1520] 10.222.0.65 () {58 vars in 1057 bytes} [Tue May 17 18:15:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:15:33.782620 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797bef03-067a-4230-b20c-fab25bb42b63 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:15:33.796290 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797bef03-067a-4230-b20c-fab25bb42b63 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:15:33.801178 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e97963c-e0ed-439b-82c0-61223d679156 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ddf11ac3e14d03b1159868b3b73fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:15:33.801835 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97963c-e0ed-439b-82c0-61223d679156 service placement] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:33.802118 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97963c-e0ed-439b-82c0-61223d679156 service placement] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:33.802391 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97963c-e0ed-439b-82c0-61223d679156 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:33.810425 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e97963c-e0ed-439b-82c0-61223d679156 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:15:33.812038 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e97963c-e0ed-439b-82c0-61223d679156 service placement] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:15:33.821376 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 761/1521] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:15:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:15:40.646988 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d95855-2d43-4721-b16c-2f8d927c0bdb None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:40.647589 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d95855-2d43-4721-b16c-2f8d927c0bdb None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:40.647589 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d95855-2d43-4721-b16c-2f8d927c0bdb None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:40.648913 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 761/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 18:15:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 18:15:40.653687 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f7843-abda-4f9f-a6e1-537839ac9255 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:40.654133 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f7843-abda-4f9f-a6e1-537839ac9255 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:40.654271 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f7843-abda-4f9f-a6e1-537839ac9255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:40.673068 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-454f7843-abda-4f9f-a6e1-537839ac9255 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:15:40.674293 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-454f7843-abda-4f9f-a6e1-537839ac9255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:15:40.682022 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 762/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 18:15:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:15:40.830750 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d95855-2d43-4721-b16c-2f8d927c0bdb None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:15:40.846483 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d95855-2d43-4721-b16c-2f8d927c0bdb None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:15:40.851919 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae6bd6-0ab1-4b52-a443-e7922dd62893 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b430b739cb54fc7911bc89f8ea2df72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:15:40.852550 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae6bd6-0ab1-4b52-a443-e7922dd62893 service nova] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:40.852833 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae6bd6-0ab1-4b52-a443-e7922dd62893 service nova] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:40.853111 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae6bd6-0ab1-4b52-a443-e7922dd62893 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:40.861122 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ae6bd6-0ab1-4b52-a443-e7922dd62893 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:15:40.862746 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ae6bd6-0ab1-4b52-a443-e7922dd62893 service nova] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:15:40.872093 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 762/1524] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:15:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:15:41.775581 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901d0be-513c-480c-b647-8fb0e7fffb06 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:41.776186 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901d0be-513c-480c-b647-8fb0e7fffb06 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:41.776186 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901d0be-513c-480c-b647-8fb0e7fffb06 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:41.777485 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 763/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 18:15:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:15:41.782788 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b947bdec-9554-422a-9da5-c638e9faad2c None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:41.783190 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b947bdec-9554-422a-9da5-c638e9faad2c None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:41.783322 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b947bdec-9554-422a-9da5-c638e9faad2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:41.801203 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-b947bdec-9554-422a-9da5-c638e9faad2c None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:15:41.802415 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-b947bdec-9554-422a-9da5-c638e9faad2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:15:41.809985 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 763/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 18:15:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:15:41.960696 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901d0be-513c-480c-b647-8fb0e7fffb06 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:15:41.975079 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901d0be-513c-480c-b647-8fb0e7fffb06 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:15:41.980355 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d558ecbe-c73e-4bef-a576-3b9be70869b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b430b739cb54fc7911bc89f8ea2df72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:15:41.980977 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558ecbe-c73e-4bef-a576-3b9be70869b8 service nova] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:41.981258 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558ecbe-c73e-4bef-a576-3b9be70869b8 service nova] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:41.981566 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558ecbe-c73e-4bef-a576-3b9be70869b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:41.990201 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d558ecbe-c73e-4bef-a576-3b9be70869b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:15:41.991844 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d558ecbe-c73e-4bef-a576-3b9be70869b8 service nova] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:15:42.001191 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 764/1527] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:15:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:15:45.921311 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f81af-99d2-490a-ae74-12e3311f2cb5 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:45.921898 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f81af-99d2-490a-ae74-12e3311f2cb5 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:45.921898 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f81af-99d2-490a-ae74-12e3311f2cb5 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:45.923242 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 764/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 18:15:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:15:45.928258 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8661c50-10db-4f7c-8db8-279b8aa7e71e None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:45.928687 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8661c50-10db-4f7c-8db8-279b8aa7e71e None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:45.928795 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8661c50-10db-4f7c-8db8-279b8aa7e71e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:45.946192 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-f8661c50-10db-4f7c-8db8-279b8aa7e71e None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:15:45.947628 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-f8661c50-10db-4f7c-8db8-279b8aa7e71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:15:45.955753 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 765/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 18:15:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:15:45.991731 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582f81af-99d2-490a-ae74-12e3311f2cb5 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:15:45.993382 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-582f81af-99d2-490a-ae74-12e3311f2cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:15:46.049751 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582f81af-99d2-490a-ae74-12e3311f2cb5 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:15:46.053228 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb299afd-66a1-4253-96d9-991a15fbfc32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:15:46.053887 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb299afd-66a1-4253-96d9-991a15fbfc32 service neutron] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:46.054168 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb299afd-66a1-4253-96d9-991a15fbfc32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:46.054443 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb299afd-66a1-4253-96d9-991a15fbfc32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:46.063553 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb299afd-66a1-4253-96d9-991a15fbfc32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:15:46.065038 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb299afd-66a1-4253-96d9-991a15fbfc32 service neutron] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:15:46.074482 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 765/1530] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:15:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:15:48.258331 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb8f99-286f-4c62-9293-c57ff45efd19 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:48.258743 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb8f99-286f-4c62-9293-c57ff45efd19 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:48.258950 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb8f99-286f-4c62-9293-c57ff45efd19 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:48.260227 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 766/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 18:15:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:15:48.265714 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb17979-e8f6-4de5-9c54-cd42f656218c None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:48.266190 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb17979-e8f6-4de5-9c54-cd42f656218c None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:48.266290 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb17979-e8f6-4de5-9c54-cd42f656218c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:48.284160 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-2eb17979-e8f6-4de5-9c54-cd42f656218c None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:15:48.285349 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-2eb17979-e8f6-4de5-9c54-cd42f656218c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:15:48.292984 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 766/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 18:15:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:15:48.329279 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb8f99-286f-4c62-9293-c57ff45efd19 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:15:48.340521 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb8f99-286f-4c62-9293-c57ff45efd19 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:15:48.343931 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1fb70-6f33-4773-9bd5-96ccec30c835 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:15:48.344579 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1fb70-6f33-4773-9bd5-96ccec30c835 service neutron] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:48.344860 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1fb70-6f33-4773-9bd5-96ccec30c835 service neutron] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:48.345130 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1fb70-6f33-4773-9bd5-96ccec30c835 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:48.353818 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e1fb70-6f33-4773-9bd5-96ccec30c835 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:15:48.355236 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e1fb70-6f33-4773-9bd5-96ccec30c835 service neutron] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:15:48.364692 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 767/1533] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:15:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:15:52.046219 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112b7fc-8f92-4158-9cf9-0a10a73cfc19 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:52.046774 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112b7fc-8f92-4158-9cf9-0a10a73cfc19 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:52.046774 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112b7fc-8f92-4158-9cf9-0a10a73cfc19 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:52.048168 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 767/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 18:15:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:15:52.053451 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600eaf76-fb2a-4edf-85af-c1cb862888cd None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:52.053890 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600eaf76-fb2a-4edf-85af-c1cb862888cd None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:52.054015 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600eaf76-fb2a-4edf-85af-c1cb862888cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:52.072025 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-600eaf76-fb2a-4edf-85af-c1cb862888cd None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:15:52.073505 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-600eaf76-fb2a-4edf-85af-c1cb862888cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:15:52.081235 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 768/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 18:15:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:15:52.359807 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1112b7fc-8f92-4158-9cf9-0a10a73cfc19 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:15:52.361516 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-1112b7fc-8f92-4158-9cf9-0a10a73cfc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:15:52.416503 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1112b7fc-8f92-4158-9cf9-0a10a73cfc19 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:15:52.420604 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45716d47-bd3c-4a44-bf3f-14ea29ce2c5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:15:52.421267 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45716d47-bd3c-4a44-bf3f-14ea29ce2c5a service cinder] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:52.421565 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45716d47-bd3c-4a44-bf3f-14ea29ce2c5a service cinder] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:52.421838 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45716d47-bd3c-4a44-bf3f-14ea29ce2c5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:52.430717 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45716d47-bd3c-4a44-bf3f-14ea29ce2c5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:15:52.432125 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45716d47-bd3c-4a44-bf3f-14ea29ce2c5a service cinder] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:15:52.441255 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 768/1536] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:15:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:15:54.741073 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a81e1c-11e3-43b1-9f62-edcdf1b0d1cc None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:54.741702 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a81e1c-11e3-43b1-9f62-edcdf1b0d1cc None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:54.741702 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a81e1c-11e3-43b1-9f62-edcdf1b0d1cc None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:54.743014 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 769/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 18:15:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:15:54.748285 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34617ddb-a06c-4571-a466-b3b6a2647a8e None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:54.748715 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34617ddb-a06c-4571-a466-b3b6a2647a8e None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:54.748830 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34617ddb-a06c-4571-a466-b3b6a2647a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:54.767115 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-34617ddb-a06c-4571-a466-b3b6a2647a8e None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:15:54.768844 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-34617ddb-a06c-4571-a466-b3b6a2647a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:15:54.779088 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 769/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 18:15:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:15:55.048139 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a81e1c-11e3-43b1-9f62-edcdf1b0d1cc None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:15:55.049834 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-d4a81e1c-11e3-43b1-9f62-edcdf1b0d1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:15:55.062476 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a81e1c-11e3-43b1-9f62-edcdf1b0d1cc None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:15:55.065925 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67a8dc8-8adf-4561-bbf5-0aadc3451953 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:15:55.066556 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a8dc8-8adf-4561-bbf5-0aadc3451953 service cinder] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:55.066834 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a8dc8-8adf-4561-bbf5-0aadc3451953 service cinder] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:55.067109 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a8dc8-8adf-4561-bbf5-0aadc3451953 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:55.076770 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67a8dc8-8adf-4561-bbf5-0aadc3451953 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:15:55.078219 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67a8dc8-8adf-4561-bbf5-0aadc3451953 service cinder] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:15:55.087207 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 770/1539] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:15:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:17:24.818041 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd6805-912a-4147-be7c-08d011c6b281 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:24.818721 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd6805-912a-4147-be7c-08d011c6b281 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:24.818721 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd6805-912a-4147-be7c-08d011c6b281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:24.855808 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60415d21-1ead-4774-ae8b-7c8e46f39585 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:24.856426 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60415d21-1ead-4774-ae8b-7c8e46f39585 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:24.856426 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60415d21-1ead-4774-ae8b-7c8e46f39585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:24.857835 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-d7bd6805-912a-4147-be7c-08d011c6b281 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:24.859483 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-d7bd6805-912a-4147-be7c-08d011c6b281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:24.880096 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 770/1540] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:17:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:17:24.889395 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-60415d21-1ead-4774-ae8b-7c8e46f39585 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:24.890656 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-60415d21-1ead-4774-ae8b-7c8e46f39585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:24.891306 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad540720-34af-4ae8-a781-b788729cd0c1 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:24.891816 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad540720-34af-4ae8-a781-b788729cd0c1 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:24.892309 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad540720-34af-4ae8-a781-b788729cd0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:24.912903 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 771/1541] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:17:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:17:24.920182 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b148c0-3a05-491d-b4bf-01a1515837eb None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:24.920531 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b148c0-3a05-491d-b4bf-01a1515837eb None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:24.920749 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b148c0-3a05-491d-b4bf-01a1515837eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:24.924093 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-ad540720-34af-4ae8-a781-b788729cd0c1 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:24.930635 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-ad540720-34af-4ae8-a781-b788729cd0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:24.952308 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 771/1542] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:17:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:17:24.956997 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad540720-34af-4ae8-a781-b788729cd0c1 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:24.968865 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-d6b148c0-3a05-491d-b4bf-01a1515837eb None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:24.971725 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-d6b148c0-3a05-491d-b4bf-01a1515837eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:24.976529 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad540720-34af-4ae8-a781-b788729cd0c1 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:24.988204 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056fc81c-5993-4689-9d7b-2ce958e2936d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:24.989962 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056fc81c-5993-4689-9d7b-2ce958e2936d admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:24.991775 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 772/1543] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:17:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:17:24.992323 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056fc81c-5993-4689-9d7b-2ce958e2936d admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:24.992835 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056fc81c-5993-4689-9d7b-2ce958e2936d admin admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:24.993966 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056fc81c-5993-4689-9d7b-2ce958e2936d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:17:24.995456 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056fc81c-5993-4689-9d7b-2ce958e2936d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:24.997321 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056fc81c-5993-4689-9d7b-2ce958e2936d admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:24.998211 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc831769-ab99-4d48-a913-7b3c4667abb7 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:24.998727 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc831769-ab99-4d48-a913-7b3c4667abb7 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:24.999216 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc831769-ab99-4d48-a913-7b3c4667abb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:25.025485 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 772/1544] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 17 18:17:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:17:25.027782 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011deb8-52a8-4010-ba6c-45f2362c5cea None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:25.029873 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011deb8-52a8-4010-ba6c-45f2362c5cea None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:25.030395 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c011deb8-52a8-4010-ba6c-45f2362c5cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:25.038629 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-dc831769-ab99-4d48-a913-7b3c4667abb7 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:25.041230 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-dc831769-ab99-4d48-a913-7b3c4667abb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:25.060657 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 773/1545] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:17:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:17:25.061670 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc831769-ab99-4d48-a913-7b3c4667abb7 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:25.062987 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-c011deb8-52a8-4010-ba6c-45f2362c5cea None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:25.064431 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-c011deb8-52a8-4010-ba6c-45f2362c5cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:25.077997 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc831769-ab99-4d48-a913-7b3c4667abb7 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:25.079155 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 773/1546] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:17:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:17:25.079889 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c011deb8-52a8-4010-ba6c-45f2362c5cea None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:25.092089 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abdf6a8-b131-4a07-889e-734f48f1a6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:25.092739 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c011deb8-52a8-4010-ba6c-45f2362c5cea None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:25.092872 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abdf6a8-b131-4a07-889e-734f48f1a6b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:25.093267 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abdf6a8-b131-4a07-889e-734f48f1a6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:25.093576 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abdf6a8-b131-4a07-889e-734f48f1a6b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:25.094308 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abdf6a8-b131-4a07-889e-734f48f1a6b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:17:25.094613 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abdf6a8-b131-4a07-889e-734f48f1a6b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:25.095758 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: WARNING py.warnings [None req-4abdf6a8-b131-4a07-889e-734f48f1a6b4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 18:17:25.095758 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: warnings.warn(msg) May 17 18:17:25.095758 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: May 17 18:17:25.096676 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abdf6a8-b131-4a07-889e-734f48f1a6b4 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:25.097695 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc5436-92ad-4661-8181-d78749eefb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:25.098426 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc5436-92ad-4661-8181-d78749eefb75 admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:25.098710 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc5436-92ad-4661-8181-d78749eefb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:25.099268 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc5436-92ad-4661-8181-d78749eefb75 admin admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:25.099960 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dc5436-92ad-4661-8181-d78749eefb75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:25.100984 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: WARNING py.warnings [None req-97dc5436-92ad-4661-8181-d78749eefb75 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 18:17:25.100984 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: warnings.warn(msg) May 17 18:17:25.100984 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: May 17 18:17:25.102227 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dc5436-92ad-4661-8181-d78749eefb75 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:25.112816 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 774/1547] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 17 18:17:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:17:25.112816 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe4f282-5991-4074-8e15-36d3d8469e0a None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:25.112816 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe4f282-5991-4074-8e15-36d3d8469e0a None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:25.112816 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe4f282-5991-4074-8e15-36d3d8469e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:25.135332 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 774/1548] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:17:25 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:17:25.135332 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9c257-d3cc-4402-b83e-168ea20a0718 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:25.135332 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9c257-d3cc-4402-b83e-168ea20a0718 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:25.135332 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9c257-d3cc-4402-b83e-168ea20a0718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:25.136292 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-0fe4f282-5991-4074-8e15-36d3d8469e0a None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:25.137274 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-0fe4f282-5991-4074-8e15-36d3d8469e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:25.152866 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-98a9c257-d3cc-4402-b83e-168ea20a0718 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:25.154629 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-98a9c257-d3cc-4402-b83e-168ea20a0718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:25.199258 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 775/1549] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:17:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:17:25.200697 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d9e2d-e904-4c15-a1a3-120c0d4e9922 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:25.200992 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d9e2d-e904-4c15-a1a3-120c0d4e9922 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:25.201279 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d9e2d-e904-4c15-a1a3-120c0d4e9922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:25.212333 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 775/1550] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:17:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:17:25.213669 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b13595-f23c-41aa-a485-21bb8cb6d4c6 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:25.214559 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b13595-f23c-41aa-a485-21bb8cb6d4c6 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:25.214783 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b13595-f23c-41aa-a485-21bb8cb6d4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:25.224136 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-aa3d9e2d-e904-4c15-a1a3-120c0d4e9922 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:25.225450 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-aa3d9e2d-e904-4c15-a1a3-120c0d4e9922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:25.232066 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-f0b13595-f23c-41aa-a485-21bb8cb6d4c6 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:25.233258 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-f0b13595-f23c-41aa-a485-21bb8cb6d4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:25.233576 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 776/1551] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:17:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:17:25.235332 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699326d-9bd9-4941-8b2d-f223af56a137 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:25.235578 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699326d-9bd9-4941-8b2d-f223af56a137 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:25.235857 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699326d-9bd9-4941-8b2d-f223af56a137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:25.241185 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 776/1552] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:17:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:17:25.241995 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b13595-f23c-41aa-a485-21bb8cb6d4c6 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:25.254676 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b13595-f23c-41aa-a485-21bb8cb6d4c6 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:25.255880 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-f699326d-9bd9-4941-8b2d-f223af56a137 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:25.257124 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-f699326d-9bd9-4941-8b2d-f223af56a137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:25.259439 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5192bb-4f66-4aed-9cac-e40b61e35728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:25.260105 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5192bb-4f66-4aed-9cac-e40b61e35728 admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:25.260348 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5192bb-4f66-4aed-9cac-e40b61e35728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:25.260622 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5192bb-4f66-4aed-9cac-e40b61e35728 admin admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:25.261899 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5192bb-4f66-4aed-9cac-e40b61e35728 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:25.263805 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5192bb-4f66-4aed-9cac-e40b61e35728 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:25.265638 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 777/1553] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:17:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:17:25.266990 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d38617-a3a1-4f72-8f71-8eca00801fcf None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:25.267281 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d38617-a3a1-4f72-8f71-8eca00801fcf None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:25.267857 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d38617-a3a1-4f72-8f71-8eca00801fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:25.286194 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-36d38617-a3a1-4f72-8f71-8eca00801fcf None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:25.287525 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-36d38617-a3a1-4f72-8f71-8eca00801fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:25.289006 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 777/1554] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:17:25 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:17:25.289855 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5192bb-4f66-4aed-9cac-e40b61e35728 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:25.346905 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 778/1555] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:17:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:17:25.348097 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94645132-1572-4403-8a71-d3b4390ec8bc None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:25.348384 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94645132-1572-4403-8a71-d3b4390ec8bc None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:25.348653 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94645132-1572-4403-8a71-d3b4390ec8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:25.353406 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5192bb-4f66-4aed-9cac-e40b61e35728 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:25.358703 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba860c8-211e-4044-8bac-17de07a4591d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:25.359385 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba860c8-211e-4044-8bac-17de07a4591d admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:25.359659 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba860c8-211e-4044-8bac-17de07a4591d admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:25.359927 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba860c8-211e-4044-8bac-17de07a4591d admin admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:25.360606 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba860c8-211e-4044-8bac-17de07a4591d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:25.362560 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba860c8-211e-4044-8bac-17de07a4591d admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:25.365805 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-94645132-1572-4403-8a71-d3b4390ec8bc None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:25.366984 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-94645132-1572-4403-8a71-d3b4390ec8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:25.375975 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 779/1556] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:17:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:17:25.377201 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe4d22-981f-43cb-976e-366514befb6d None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:25.377558 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe4d22-981f-43cb-976e-366514befb6d None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:25.377854 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe4d22-981f-43cb-976e-366514befb6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:25.387836 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 778/1557] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:17:25 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:17:25.387836 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba860c8-211e-4044-8bac-17de07a4591d admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:25.395597 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-7abe4d22-981f-43cb-976e-366514befb6d None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:25.395757 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba860c8-211e-4044-8bac-17de07a4591d admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:25.396770 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-7abe4d22-981f-43cb-976e-366514befb6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:25.400501 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80429291-c4e1-420b-99a7-668989b27511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:25.401161 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80429291-c4e1-420b-99a7-668989b27511 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:25.401540 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80429291-c4e1-420b-99a7-668989b27511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:25.401765 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80429291-c4e1-420b-99a7-668989b27511 admin admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:25.402474 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80429291-c4e1-420b-99a7-668989b27511 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:17:25.402771 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80429291-c4e1-420b-99a7-668989b27511 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:25.404375 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80429291-c4e1-420b-99a7-668989b27511 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:25.404805 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 780/1558] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:17:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:17:25.405599 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe4d22-981f-43cb-976e-366514befb6d None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:25.414384 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe4d22-981f-43cb-976e-366514befb6d None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:25.418821 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f071a8ab-5e40-4d17-9a30-1225906f5748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:25.419442 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f071a8ab-5e40-4d17-9a30-1225906f5748 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:25.419541 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 779/1559] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 17 18:17:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:17:25.419727 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f071a8ab-5e40-4d17-9a30-1225906f5748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:25.419998 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f071a8ab-5e40-4d17-9a30-1225906f5748 admin admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:25.420706 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f071a8ab-5e40-4d17-9a30-1225906f5748 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:17:25.420821 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61990e5-6183-45e9-b7d8-86e4fa66569d None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:25.421008 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f071a8ab-5e40-4d17-9a30-1225906f5748 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:25.421118 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61990e5-6183-45e9-b7d8-86e4fa66569d None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:25.421357 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61990e5-6183-45e9-b7d8-86e4fa66569d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:25.422760 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f071a8ab-5e40-4d17-9a30-1225906f5748 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:25.444142 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 781/1560] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 17 18:17:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:17:25.444142 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f071a8ab-5e40-4d17-9a30-1225906f5748 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:25.444441 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-e61990e5-6183-45e9-b7d8-86e4fa66569d None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:25.444441 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-e61990e5-6183-45e9-b7d8-86e4fa66569d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:25.447569 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f071a8ab-5e40-4d17-9a30-1225906f5748 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:25.449489 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 780/1561] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:17:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:17:25.450758 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62439c2-57c0-4191-acd8-d801621e8fe0 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:25.451043 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62439c2-57c0-4191-acd8-d801621e8fe0 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:25.451928 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62439c2-57c0-4191-acd8-d801621e8fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:25.453351 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84215f35-791d-49c1-80d2-d6b6bcaad402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:25.454158 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84215f35-791d-49c1-80d2-d6b6bcaad402 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:25.454433 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84215f35-791d-49c1-80d2-d6b6bcaad402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:25.454707 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84215f35-791d-49c1-80d2-d6b6bcaad402 admin admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:25.455375 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84215f35-791d-49c1-80d2-d6b6bcaad402 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:25.456376 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: WARNING py.warnings [None req-84215f35-791d-49c1-80d2-d6b6bcaad402 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 18:17:25.456376 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: warnings.warn(msg) May 17 18:17:25.456376 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: May 17 18:17:25.457589 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84215f35-791d-49c1-80d2-d6b6bcaad402 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:25.471444 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-e62439c2-57c0-4191-acd8-d801621e8fe0 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:25.472786 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-e62439c2-57c0-4191-acd8-d801621e8fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:25.477810 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 782/1562] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:17:25 2022] POST /identity/v3/users => generated 292 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:17:25.480776 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 781/1563] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:17:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:17:25.481577 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62439c2-57c0-4191-acd8-d801621e8fe0 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:25.481711 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84215f35-791d-49c1-80d2-d6b6bcaad402 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:25.490868 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62439c2-57c0-4191-acd8-d801621e8fe0 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:25.493234 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84215f35-791d-49c1-80d2-d6b6bcaad402 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:25.495946 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55157af0-e8db-45b3-97c9-dd1556c2b6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:25.496584 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55157af0-e8db-45b3-97c9-dd1556c2b6d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:25.496862 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55157af0-e8db-45b3-97c9-dd1556c2b6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:25.497135 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55157af0-e8db-45b3-97c9-dd1556c2b6d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:25.497904 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55157af0-e8db-45b3-97c9-dd1556c2b6d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:25.498365 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee4a314-ce9f-409e-adc8-6a006154fa24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:25.499501 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55157af0-e8db-45b3-97c9-dd1556c2b6d0 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:25.499627 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4a314-ce9f-409e-adc8-6a006154fa24 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:25.499913 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4a314-ce9f-409e-adc8-6a006154fa24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:25.500185 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee4a314-ce9f-409e-adc8-6a006154fa24 admin admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:25.500896 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee4a314-ce9f-409e-adc8-6a006154fa24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:17:25.501193 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee4a314-ce9f-409e-adc8-6a006154fa24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:25.502801 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee4a314-ce9f-409e-adc8-6a006154fa24 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:25.509567 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 782/1564] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:17:25 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:17:25.510349 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55157af0-e8db-45b3-97c9-dd1556c2b6d0 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:25.518364 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 783/1565] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 17 18:17:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:17:25.519326 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee4a314-ce9f-409e-adc8-6a006154fa24 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:25.525853 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55157af0-e8db-45b3-97c9-dd1556c2b6d0 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:25.528693 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee4a314-ce9f-409e-adc8-6a006154fa24 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:25.530522 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad0c204-7cd8-45c7-a4b7-e4b0ced43f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:25.531156 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0c204-7cd8-45c7-a4b7-e4b0ced43f49 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:25.531436 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0c204-7cd8-45c7-a4b7-e4b0ced43f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:25.531706 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0c204-7cd8-45c7-a4b7-e4b0ced43f49 admin admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:25.532416 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad0c204-7cd8-45c7-a4b7-e4b0ced43f49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:17:25.532721 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad0c204-7cd8-45c7-a4b7-e4b0ced43f49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:25.533331 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec923cc-c22f-486b-ace8-f9ccc13f0962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:25.534052 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec923cc-c22f-486b-ace8-f9ccc13f0962 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:25.534335 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad0c204-7cd8-45c7-a4b7-e4b0ced43f49 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:25.534439 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec923cc-c22f-486b-ace8-f9ccc13f0962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:25.534807 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec923cc-c22f-486b-ace8-f9ccc13f0962 admin admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:25.535513 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec923cc-c22f-486b-ace8-f9ccc13f0962 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:25.537375 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec923cc-c22f-486b-ace8-f9ccc13f0962 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:25.546219 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 783/1566] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 17 18:17:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:17:25.547014 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad0c204-7cd8-45c7-a4b7-e4b0ced43f49 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:25.564296 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad0c204-7cd8-45c7-a4b7-e4b0ced43f49 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:25.567909 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 784/1567] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:17:25 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:17:25.567909 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec923cc-c22f-486b-ace8-f9ccc13f0962 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:25.622194 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e525b-04ce-47b5-bc2b-2baa6829b04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:25.622838 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e525b-04ce-47b5-bc2b-2baa6829b04a admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:25.623053 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e525b-04ce-47b5-bc2b-2baa6829b04a admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:25.623322 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e525b-04ce-47b5-bc2b-2baa6829b04a admin admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:25.624080 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586e525b-04ce-47b5-bc2b-2baa6829b04a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:25.624846 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec923cc-c22f-486b-ace8-f9ccc13f0962 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:25.625997 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586e525b-04ce-47b5-bc2b-2baa6829b04a admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:25.629415 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683ca6a-4243-49a2-beac-2ef6eccc2dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:25.630080 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683ca6a-4243-49a2-beac-2ef6eccc2dc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:25.630353 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683ca6a-4243-49a2-beac-2ef6eccc2dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:25.630620 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683ca6a-4243-49a2-beac-2ef6eccc2dc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:25.631332 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3683ca6a-4243-49a2-beac-2ef6eccc2dc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:17:25.631631 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3683ca6a-4243-49a2-beac-2ef6eccc2dc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:25.633214 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3683ca6a-4243-49a2-beac-2ef6eccc2dc8 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:25.646441 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 785/1568] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 17 18:17:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:17:25.646441 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683ca6a-4243-49a2-beac-2ef6eccc2dc8 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:25.653699 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 784/1569] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:17:25 2022] POST /identity/v3/projects => generated 391 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:17:25.653699 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e525b-04ce-47b5-bc2b-2baa6829b04a admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:25.658016 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683ca6a-4243-49a2-beac-2ef6eccc2dc8 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:25.712144 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd06c9a-dea2-46d9-8357-7a7d8a911a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:25.712837 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd06c9a-dea2-46d9-8357-7a7d8a911a62 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:25.713115 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd06c9a-dea2-46d9-8357-7a7d8a911a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:25.713436 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd06c9a-dea2-46d9-8357-7a7d8a911a62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:25.714207 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd06c9a-dea2-46d9-8357-7a7d8a911a62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:25.714748 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e525b-04ce-47b5-bc2b-2baa6829b04a admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:25.716048 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd06c9a-dea2-46d9-8357-7a7d8a911a62 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:25.719358 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6293072d-642b-435b-9111-efe9d4da3dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:25.720001 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293072d-642b-435b-9111-efe9d4da3dcf admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:25.720277 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293072d-642b-435b-9111-efe9d4da3dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:25.720549 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293072d-642b-435b-9111-efe9d4da3dcf admin admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:25.721286 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6293072d-642b-435b-9111-efe9d4da3dcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:17:25.721635 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6293072d-642b-435b-9111-efe9d4da3dcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:25.723200 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6293072d-642b-435b-9111-efe9d4da3dcf admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:25.725771 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 786/1570] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:17:25 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:17:25.726766 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd06c9a-dea2-46d9-8357-7a7d8a911a62 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:25.736666 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd06c9a-dea2-46d9-8357-7a7d8a911a62 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:25.738266 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 785/1571] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 17 18:17:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:17:25.739300 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6293072d-642b-435b-9111-efe9d4da3dcf admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:25.747283 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c4f492-7395-4a8b-8f5e-b97ea7091f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:25.747948 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4f492-7395-4a8b-8f5e-b97ea7091f5e admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:25.748226 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4f492-7395-4a8b-8f5e-b97ea7091f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:25.748496 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4f492-7395-4a8b-8f5e-b97ea7091f5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:25.749219 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c4f492-7395-4a8b-8f5e-b97ea7091f5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:25.749625 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6293072d-642b-435b-9111-efe9d4da3dcf admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:25.750887 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c4f492-7395-4a8b-8f5e-b97ea7091f5e admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:25.754387 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2523b4f2-1d4c-4ee1-b164-5c5b14657d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:25.755022 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523b4f2-1d4c-4ee1-b164-5c5b14657d26 admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:25.755298 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523b4f2-1d4c-4ee1-b164-5c5b14657d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:25.755588 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523b4f2-1d4c-4ee1-b164-5c5b14657d26 admin admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:25.756912 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2523b4f2-1d4c-4ee1-b164-5c5b14657d26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:25.759052 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2523b4f2-1d4c-4ee1-b164-5c5b14657d26 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:25.760891 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 787/1572] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:17:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:17:25.761758 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c4f492-7395-4a8b-8f5e-b97ea7091f5e admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:25.772815 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c4f492-7395-4a8b-8f5e-b97ea7091f5e admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:25.777530 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804945e-36cd-45c5-8418-d73b623ca665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:25.778186 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804945e-36cd-45c5-8418-d73b623ca665 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:25.778458 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804945e-36cd-45c5-8418-d73b623ca665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:25.778725 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804945e-36cd-45c5-8418-d73b623ca665 admin admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:25.779393 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c804945e-36cd-45c5-8418-d73b623ca665 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:25.781269 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c804945e-36cd-45c5-8418-d73b623ca665 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:25.785244 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 786/1573] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:17:25 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:17:25.786260 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2523b4f2-1d4c-4ee1-b164-5c5b14657d26 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:25.808455 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 788/1574] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:17:25 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:17:25.809260 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804945e-36cd-45c5-8418-d73b623ca665 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:25.848824 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2523b4f2-1d4c-4ee1-b164-5c5b14657d26 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:25.868090 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804945e-36cd-45c5-8418-d73b623ca665 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:25.873133 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c9655-135b-4655-a0fd-7ef2be1d6911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:25.873763 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c9655-135b-4655-a0fd-7ef2be1d6911 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:25.874041 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c9655-135b-4655-a0fd-7ef2be1d6911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:25.874308 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c9655-135b-4655-a0fd-7ef2be1d6911 admin admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:25.874986 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347c9655-135b-4655-a0fd-7ef2be1d6911 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:25.876861 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347c9655-135b-4655-a0fd-7ef2be1d6911 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:25.901485 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 789/1575] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:17:25 2022] POST /identity/v3/projects => generated 377 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:17:25.902384 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c9655-135b-4655-a0fd-7ef2be1d6911 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:25.904115 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f41f0b4-91d6-4507-a0bf-81c8ac9a9143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:25.904786 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41f0b4-91d6-4507-a0bf-81c8ac9a9143 admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:25.905064 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41f0b4-91d6-4507-a0bf-81c8ac9a9143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:25.905336 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41f0b4-91d6-4507-a0bf-81c8ac9a9143 admin admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:25.906049 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f41f0b4-91d6-4507-a0bf-81c8ac9a9143 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:25.908269 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f41f0b4-91d6-4507-a0bf-81c8ac9a9143 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:25.928869 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 787/1576] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:17:25 2022] POST /identity/v3/users => generated 283 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:17:25.932631 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f41f0b4-91d6-4507-a0bf-81c8ac9a9143 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:25.941707 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f41f0b4-91d6-4507-a0bf-81c8ac9a9143 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:25.963117 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c9655-135b-4655-a0fd-7ef2be1d6911 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:25.967718 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f963a0-52b4-4699-9ad6-642475241f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:25.968381 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f963a0-52b4-4699-9ad6-642475241f7f admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:25.968662 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f963a0-52b4-4699-9ad6-642475241f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:25.968940 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f963a0-52b4-4699-9ad6-642475241f7f admin admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:25.969654 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f963a0-52b4-4699-9ad6-642475241f7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:25.971557 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f963a0-52b4-4699-9ad6-642475241f7f admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:25.992105 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 790/1577] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:17:25 2022] POST /identity/v3/users => generated 296 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:17:25.992958 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f963a0-52b4-4699-9ad6-642475241f7f admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:25.997681 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0213e162-8e92-47e1-b0a4-84ea2841183b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:25.998352 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213e162-8e92-47e1-b0a4-84ea2841183b admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:25.998633 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213e162-8e92-47e1-b0a4-84ea2841183b admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:25.998906 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213e162-8e92-47e1-b0a4-84ea2841183b admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:25.999628 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0213e162-8e92-47e1-b0a4-84ea2841183b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:26.001225 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0213e162-8e92-47e1-b0a4-84ea2841183b admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:26.002392 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f963a0-52b4-4699-9ad6-642475241f7f admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:26.006893 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb3abb-018d-4c2b-9e61-4d25839e1007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:26.007542 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb3abb-018d-4c2b-9e61-4d25839e1007 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:26.007825 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb3abb-018d-4c2b-9e61-4d25839e1007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:26.008377 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb3abb-018d-4c2b-9e61-4d25839e1007 admin admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:26.009048 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bb3abb-018d-4c2b-9e61-4d25839e1007 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:26.010971 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bb3abb-018d-4c2b-9e61-4d25839e1007 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:26.011357 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 788/1578] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:17:25 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:17:26.012260 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0213e162-8e92-47e1-b0a4-84ea2841183b admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:26.021850 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0213e162-8e92-47e1-b0a4-84ea2841183b admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:26.027032 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0afc2b6-f127-4f01-9089-1918e90af850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:26.028143 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0afc2b6-f127-4f01-9089-1918e90af850 admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:26.028462 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0afc2b6-f127-4f01-9089-1918e90af850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:26.028768 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0afc2b6-f127-4f01-9089-1918e90af850 admin admin] PATH_INFO: `/v3/projects/4de85b5a9fd04a9ba5d16da6d4816235/users/82a34231bf8e43808d6cb1cb55d93060/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:26.037549 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 791/1579] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:17:25 2022] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:17:26.038509 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb3abb-018d-4c2b-9e61-4d25839e1007 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:26.044901 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0afc2b6-f127-4f01-9089-1918e90af850 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4de85b5a9fd04a9ba5d16da6d4816235, user_id=82a34231bf8e43808d6cb1cb55d93060, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:26.045969 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: WARNING py.warnings [None req-c0afc2b6-f127-4f01-9089-1918e90af850 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 18:17:26.045969 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: warnings.warn(msg) May 17 18:17:26.045969 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: May 17 18:17:26.047906 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0afc2b6-f127-4f01-9089-1918e90af850 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:26.060528 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 789/1580] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:17:26 2022] PUT /identity/v3/projects/4de85b5a9fd04a9ba5d16da6d4816235/users/82a34231bf8e43808d6cb1cb55d93060/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:17:26.061372 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0afc2b6-f127-4f01-9089-1918e90af850 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:26.106145 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb3abb-018d-4c2b-9e61-4d25839e1007 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:26.121653 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0afc2b6-f127-4f01-9089-1918e90af850 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:26.126326 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cf3489-c8b5-4620-8cdc-5b91a0b32c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:26.126958 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf3489-c8b5-4620-8cdc-5b91a0b32c83 admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:26.127237 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf3489-c8b5-4620-8cdc-5b91a0b32c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:26.127694 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf3489-c8b5-4620-8cdc-5b91a0b32c83 admin admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:26.128315 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cf3489-c8b5-4620-8cdc-5b91a0b32c83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:26.130250 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cf3489-c8b5-4620-8cdc-5b91a0b32c83 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:26.149959 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 790/1581] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:17:26 2022] POST /identity/v3/users => generated 289 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:17:26.153793 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cf3489-c8b5-4620-8cdc-5b91a0b32c83 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:26.160347 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cf3489-c8b5-4620-8cdc-5b91a0b32c83 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:26.163157 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c053be-9df1-4038-be92-2a67860faa05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:26.163902 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c053be-9df1-4038-be92-2a67860faa05 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:26.164187 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c053be-9df1-4038-be92-2a67860faa05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:26.164466 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c053be-9df1-4038-be92-2a67860faa05 admin admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:26.164844 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a76663-caa1-4c16-9fa0-169c7fd3fe52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:26.165203 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c053be-9df1-4038-be92-2a67860faa05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:26.165482 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a76663-caa1-4c16-9fa0-169c7fd3fe52 admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:26.165770 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a76663-caa1-4c16-9fa0-169c7fd3fe52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:26.166041 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a76663-caa1-4c16-9fa0-169c7fd3fe52 admin admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:26.166699 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a76663-caa1-4c16-9fa0-169c7fd3fe52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:26.167295 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c053be-9df1-4038-be92-2a67860faa05 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:26.168658 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a76663-caa1-4c16-9fa0-169c7fd3fe52 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:26.188648 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 792/1582] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:17:26 2022] POST /identity/v3/users => generated 293 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:17:26.189113 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 791/1583] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:17:26 2022] POST /identity/v3/users => generated 289 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:17:26.189958 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a76663-caa1-4c16-9fa0-169c7fd3fe52 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:26.190782 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c053be-9df1-4038-be92-2a67860faa05 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:26.201724 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c053be-9df1-4038-be92-2a67860faa05 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:26.202095 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a76663-caa1-4c16-9fa0-169c7fd3fe52 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:26.206241 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091c13fc-9e66-47db-94ca-ba5698de7faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:26.206598 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecaf7f3-08e8-4ae2-9b2b-6a8e85227d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:26.206890 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091c13fc-9e66-47db-94ca-ba5698de7faa admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:26.207169 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091c13fc-9e66-47db-94ca-ba5698de7faa admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:26.207264 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecaf7f3-08e8-4ae2-9b2b-6a8e85227d01 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:26.207490 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecaf7f3-08e8-4ae2-9b2b-6a8e85227d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:26.207590 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091c13fc-9e66-47db-94ca-ba5698de7faa admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:26.207760 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecaf7f3-08e8-4ae2-9b2b-6a8e85227d01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:26.208303 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091c13fc-9e66-47db-94ca-ba5698de7faa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:26.208470 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecaf7f3-08e8-4ae2-9b2b-6a8e85227d01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:26.209934 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091c13fc-9e66-47db-94ca-ba5698de7faa admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:26.210350 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecaf7f3-08e8-4ae2-9b2b-6a8e85227d01 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:26.219971 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 793/1584] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:17:26.223335 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 792/1585] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:17:26.223335 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecaf7f3-08e8-4ae2-9b2b-6a8e85227d01 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:26.223637 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091c13fc-9e66-47db-94ca-ba5698de7faa admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:26.230679 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecaf7f3-08e8-4ae2-9b2b-6a8e85227d01 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:26.232969 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091c13fc-9e66-47db-94ca-ba5698de7faa admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:26.235146 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cf0df6-657b-438a-bfc6-369895be348c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:26.235774 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf0df6-657b-438a-bfc6-369895be348c admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:26.236054 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf0df6-657b-438a-bfc6-369895be348c admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:26.236330 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf0df6-657b-438a-bfc6-369895be348c admin admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:26.237002 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cf0df6-657b-438a-bfc6-369895be348c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:26.237723 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84eca6d-fd11-496a-9d57-0cf1231e6cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:26.238576 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84eca6d-fd11-496a-9d57-0cf1231e6cae admin admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:26.238928 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cf0df6-657b-438a-bfc6-369895be348c admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:26.239045 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84eca6d-fd11-496a-9d57-0cf1231e6cae admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:26.239219 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84eca6d-fd11-496a-9d57-0cf1231e6cae admin admin] PATH_INFO: `/v3/projects/37a912f3b6fa407bb4495fb6462250e8/users/13b4ec46d3cb49faba3f063dcfd644c3/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:26.255740 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84eca6d-fd11-496a-9d57-0cf1231e6cae admin admin] RBAC: Authorizing `identity:create_grant(project_id=37a912f3b6fa407bb4495fb6462250e8, user_id=13b4ec46d3cb49faba3f063dcfd644c3, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:26.258479 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84eca6d-fd11-496a-9d57-0cf1231e6cae admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:26.263111 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 793/1586] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:17:26 2022] POST /identity/v3/users => generated 294 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:17:26.263111 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cea743-7e53-4cbf-bd11-5c9b5a9e29c2 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:26.263111 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cea743-7e53-4cbf-bd11-5c9b5a9e29c2 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:26.263111 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cea743-7e53-4cbf-bd11-5c9b5a9e29c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:26.272481 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 794/1587] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:17:26 2022] PUT /identity/v3/projects/37a912f3b6fa407bb4495fb6462250e8/users/13b4ec46d3cb49faba3f063dcfd644c3/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:17:26.273276 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84eca6d-fd11-496a-9d57-0cf1231e6cae admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:26.288789 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-99cea743-7e53-4cbf-bd11-5c9b5a9e29c2 None None] MFA Rules not processed for user `82a34231bf8e43808d6cb1cb55d93060`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:26.290038 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-99cea743-7e53-4cbf-bd11-5c9b5a9e29c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:26.334975 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84eca6d-fd11-496a-9d57-0cf1231e6cae admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:26.339703 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19f3a70-3201-431a-8c23-a51677136c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:26.340365 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f3a70-3201-431a-8c23-a51677136c88 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:26.340639 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f3a70-3201-431a-8c23-a51677136c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:26.340909 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f3a70-3201-431a-8c23-a51677136c88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:26.341655 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19f3a70-3201-431a-8c23-a51677136c88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:26.343251 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19f3a70-3201-431a-8c23-a51677136c88 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:26.352684 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 795/1588] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:17:26.353485 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19f3a70-3201-431a-8c23-a51677136c88 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:26.357141 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 794/1589] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:17:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:17:26.357141 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cea743-7e53-4cbf-bd11-5c9b5a9e29c2 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:26.363152 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19f3a70-3201-431a-8c23-a51677136c88 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:26.368689 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dded17-547b-453f-9c97-274c1e05907b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:26.369338 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dded17-547b-453f-9c97-274c1e05907b admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:26.369501 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cea743-7e53-4cbf-bd11-5c9b5a9e29c2 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:26.369699 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dded17-547b-453f-9c97-274c1e05907b admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:26.369921 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dded17-547b-453f-9c97-274c1e05907b admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:26.371488 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dded17-547b-453f-9c97-274c1e05907b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:26.373059 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dded17-547b-453f-9c97-274c1e05907b admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:26.374812 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ccac70-1e82-45e1-b8ff-5ab98184f706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:26.375467 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ccac70-1e82-45e1-b8ff-5ab98184f706 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:26.375748 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ccac70-1e82-45e1-b8ff-5ab98184f706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:26.376023 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ccac70-1e82-45e1-b8ff-5ab98184f706 admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:26.376794 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ccac70-1e82-45e1-b8ff-5ab98184f706 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:26.378385 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ccac70-1e82-45e1-b8ff-5ab98184f706 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:26.382877 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 796/1590] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:17:26.383759 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dded17-547b-453f-9c97-274c1e05907b admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:26.391957 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 795/1591] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:17:26.391957 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ccac70-1e82-45e1-b8ff-5ab98184f706 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:26.393440 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dded17-547b-453f-9c97-274c1e05907b admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:26.398039 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939e659-2c42-4705-be87-794d40a72681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:26.398670 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939e659-2c42-4705-be87-794d40a72681 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:26.398951 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939e659-2c42-4705-be87-794d40a72681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:26.399098 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ccac70-1e82-45e1-b8ff-5ab98184f706 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:26.399305 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939e659-2c42-4705-be87-794d40a72681 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:26.399920 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9939e659-2c42-4705-be87-794d40a72681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:26.401543 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9939e659-2c42-4705-be87-794d40a72681 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:26.403658 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2b4756-fd23-45fb-a55f-2aa2ff7e416e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:26.404281 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b4756-fd23-45fb-a55f-2aa2ff7e416e admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:26.404563 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b4756-fd23-45fb-a55f-2aa2ff7e416e admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:26.404841 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2b4756-fd23-45fb-a55f-2aa2ff7e416e admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:26.405575 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2b4756-fd23-45fb-a55f-2aa2ff7e416e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:26.407119 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2b4756-fd23-45fb-a55f-2aa2ff7e416e admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:26.412004 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 797/1592] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:17:26.412886 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939e659-2c42-4705-be87-794d40a72681 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:26.417946 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 796/1593] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:17:26.419044 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbfdf39-d0b7-45c2-99f3-f2811228380f None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:26.419332 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbfdf39-d0b7-45c2-99f3-f2811228380f None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:26.419612 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbfdf39-d0b7-45c2-99f3-f2811228380f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:26.423049 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939e659-2c42-4705-be87-794d40a72681 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:26.427660 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc8eafb-3b1a-48c2-89ba-aafa3e2485bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:26.428370 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8eafb-3b1a-48c2-89ba-aafa3e2485bb admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:26.428654 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8eafb-3b1a-48c2-89ba-aafa3e2485bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:26.428953 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8eafb-3b1a-48c2-89ba-aafa3e2485bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:26.429688 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc8eafb-3b1a-48c2-89ba-aafa3e2485bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:26.431269 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc8eafb-3b1a-48c2-89ba-aafa3e2485bb admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:26.436452 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-dfbfdf39-d0b7-45c2-99f3-f2811228380f None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:26.437675 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-dfbfdf39-d0b7-45c2-99f3-f2811228380f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:26.440895 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 798/1594] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:17:26.441791 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc8eafb-3b1a-48c2-89ba-aafa3e2485bb admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:26.446201 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 797/1595] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:17:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:17:26.448944 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a4129-57c9-4b35-99e1-002bebc56c13 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:26.449388 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a4129-57c9-4b35-99e1-002bebc56c13 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:26.450656 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a4129-57c9-4b35-99e1-002bebc56c13 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:26.451941 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc8eafb-3b1a-48c2-89ba-aafa3e2485bb admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:26.452776 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 798/1596] 10.222.0.65 () {54 vars in 961 bytes} [Tue May 17 18:17:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:17:26.453379 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646a4129-57c9-4b35-99e1-002bebc56c13 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:26.459155 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c1fb58-6283-4dd9-8977-f55a6b364271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:26.459821 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1fb58-6283-4dd9-8977-f55a6b364271 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:26.460105 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1fb58-6283-4dd9-8977-f55a6b364271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:26.460384 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1fb58-6283-4dd9-8977-f55a6b364271 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:26.461104 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c1fb58-6283-4dd9-8977-f55a6b364271 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:26.463106 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c1fb58-6283-4dd9-8977-f55a6b364271 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:26.468354 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646a4129-57c9-4b35-99e1-002bebc56c13 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:26.472922 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e9858-2de7-48d4-a68b-79f4e273dc66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:26.473401 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 799/1597] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:17:26.473636 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e9858-2de7-48d4-a68b-79f4e273dc66 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:26.473868 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e9858-2de7-48d4-a68b-79f4e273dc66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:26.474139 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e9858-2de7-48d4-a68b-79f4e273dc66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:26.474858 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301e9858-2de7-48d4-a68b-79f4e273dc66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:26.476441 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301e9858-2de7-48d4-a68b-79f4e273dc66 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:26.477485 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c1fb58-6283-4dd9-8977-f55a6b364271 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:26.486358 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 799/1598] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:17:26.486644 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c1fb58-6283-4dd9-8977-f55a6b364271 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:26.487115 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e9858-2de7-48d4-a68b-79f4e273dc66 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:26.493235 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5273f6-63d4-4cd3-b012-c509175ee858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:26.493908 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5273f6-63d4-4cd3-b012-c509175ee858 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:26.494188 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5273f6-63d4-4cd3-b012-c509175ee858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:26.494463 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5273f6-63d4-4cd3-b012-c509175ee858 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:26.495201 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5273f6-63d4-4cd3-b012-c509175ee858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:26.496777 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5273f6-63d4-4cd3-b012-c509175ee858 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:26.496898 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e9858-2de7-48d4-a68b-79f4e273dc66 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:26.501934 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777beee1-dfbe-4fd5-96d5-55fcf6d3d212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:26.503111 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777beee1-dfbe-4fd5-96d5-55fcf6d3d212 admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:26.503391 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777beee1-dfbe-4fd5-96d5-55fcf6d3d212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:26.503664 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777beee1-dfbe-4fd5-96d5-55fcf6d3d212 admin admin] PATH_INFO: `/v3/projects/b7d713a65f9e4071988e5df2fbf90b17/users/5e6f035cadd24a59803eec21c7b9e2c5/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:26.508586 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 800/1599] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:17:26.508586 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5273f6-63d4-4cd3-b012-c509175ee858 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:26.519860 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5273f6-63d4-4cd3-b012-c509175ee858 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:26.521395 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777beee1-dfbe-4fd5-96d5-55fcf6d3d212 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7d713a65f9e4071988e5df2fbf90b17, user_id=5e6f035cadd24a59803eec21c7b9e2c5, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:26.524103 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777beee1-dfbe-4fd5-96d5-55fcf6d3d212 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:26.525160 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c9178-c0d3-4ee7-ba1e-ab9f4e094fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:26.526073 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c9178-c0d3-4ee7-ba1e-ab9f4e094fbb admin admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:26.526408 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c9178-c0d3-4ee7-ba1e-ab9f4e094fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:26.527293 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c9178-c0d3-4ee7-ba1e-ab9f4e094fbb admin admin] PATH_INFO: `/v3/projects/62a2bceca9214b5f8b057df5e3b6e2c7/users/0f1db2b9cd974e268fd8be67814d5373/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:26.537378 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 800/1600] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:17:26 2022] PUT /identity/v3/projects/b7d713a65f9e4071988e5df2fbf90b17/users/5e6f035cadd24a59803eec21c7b9e2c5/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:17:26.538220 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777beee1-dfbe-4fd5-96d5-55fcf6d3d212 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:26.542885 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710c9178-c0d3-4ee7-ba1e-ab9f4e094fbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=62a2bceca9214b5f8b057df5e3b6e2c7, user_id=0f1db2b9cd974e268fd8be67814d5373, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:26.545784 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710c9178-c0d3-4ee7-ba1e-ab9f4e094fbb admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:26.558566 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 801/1601] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:17:26 2022] PUT /identity/v3/projects/62a2bceca9214b5f8b057df5e3b6e2c7/users/0f1db2b9cd974e268fd8be67814d5373/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:17:26.559397 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c9178-c0d3-4ee7-ba1e-ab9f4e094fbb admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:26.561092 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-710c9178-c0d3-4ee7-ba1e-ab9f4e094fbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:26.600638 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777beee1-dfbe-4fd5-96d5-55fcf6d3d212 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:26.616849 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c9178-c0d3-4ee7-ba1e-ab9f4e094fbb admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:26.620387 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cf944b-0bda-4b93-80b8-b28cb69bc390 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:26.621015 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf944b-0bda-4b93-80b8-b28cb69bc390 service neutron] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:26.621289 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf944b-0bda-4b93-80b8-b28cb69bc390 service neutron] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:26.621591 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cf944b-0bda-4b93-80b8-b28cb69bc390 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:26.655124 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75c69dd-9035-41d7-9132-e9603ceec55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:26.655787 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c69dd-9035-41d7-9132-e9603ceec55a admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:26.656059 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c69dd-9035-41d7-9132-e9603ceec55a admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:26.656324 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c69dd-9035-41d7-9132-e9603ceec55a admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:26.657066 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75c69dd-9035-41d7-9132-e9603ceec55a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:26.658673 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75c69dd-9035-41d7-9132-e9603ceec55a admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:26.668841 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 801/1602] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:17:26.670094 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d8b2a-c827-4b0b-bd8f-22ca6feefb6c None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:26.670360 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d8b2a-c827-4b0b-bd8f-22ca6feefb6c None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:26.670633 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6d8b2a-c827-4b0b-bd8f-22ca6feefb6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:26.684215 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cf944b-0bda-4b93-80b8-b28cb69bc390 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:26.685739 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9cf944b-0bda-4b93-80b8-b28cb69bc390 service neutron] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:26.687372 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-8a6d8b2a-c827-4b0b-bd8f-22ca6feefb6c None None] MFA Rules not processed for user `5b430b739cb54fc7911bc89f8ea2df72`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:26.688540 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-8a6d8b2a-c827-4b0b-bd8f-22ca6feefb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:26.695587 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 802/1603] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:17:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:17:26.696378 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cf944b-0bda-4b93-80b8-b28cb69bc390 service neutron] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:26.706359 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9cf944b-0bda-4b93-80b8-b28cb69bc390 service neutron] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:26.710971 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b526b0-19bf-4a12-b9b1-b1d7531cba72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:26.711842 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b526b0-19bf-4a12-b9b1-b1d7531cba72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:26.712117 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b526b0-19bf-4a12-b9b1-b1d7531cba72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:26.712385 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b526b0-19bf-4a12-b9b1-b1d7531cba72 admin admin] PATH_INFO: `/v3/projects/cd7eb45f1cd74f84943f4b991986973d/users/356af648841c44eeab0bd9c7f78f600a/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:26.728415 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b526b0-19bf-4a12-b9b1-b1d7531cba72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd7eb45f1cd74f84943f4b991986973d, user_id=356af648841c44eeab0bd9c7f78f600a, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:26.731632 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b526b0-19bf-4a12-b9b1-b1d7531cba72 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:26.748870 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 803/1604] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:17:26 2022] PUT /identity/v3/projects/cd7eb45f1cd74f84943f4b991986973d/users/356af648841c44eeab0bd9c7f78f600a/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:17:26.748870 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b526b0-19bf-4a12-b9b1-b1d7531cba72 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:26.762120 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 802/1605] 10.222.0.65 () {58 vars in 1058 bytes} [Tue May 17 18:17:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:17:26.763195 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6d8b2a-c827-4b0b-bd8f-22ca6feefb6c None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:26.774417 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6d8b2a-c827-4b0b-bd8f-22ca6feefb6c None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:26.809735 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b526b0-19bf-4a12-b9b1-b1d7531cba72 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:26.814387 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad91571-46e9-49ae-9f0d-7ea43a66448e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:26.815291 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad91571-46e9-49ae-9f0d-7ea43a66448e admin admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:26.815600 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad91571-46e9-49ae-9f0d-7ea43a66448e admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:26.815834 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad91571-46e9-49ae-9f0d-7ea43a66448e admin admin] PATH_INFO: `/v3/projects/29655206dbba479eaf93e154247f5025/users/35039474282847a79ce6997fb52b31ff/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:26.832740 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad91571-46e9-49ae-9f0d-7ea43a66448e admin admin] RBAC: Authorizing `identity:create_grant(project_id=29655206dbba479eaf93e154247f5025, user_id=35039474282847a79ce6997fb52b31ff, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:26.837234 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad91571-46e9-49ae-9f0d-7ea43a66448e admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:26.839605 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6444c2c9-bd10-40ae-8d22-37b115bd0ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:26.840758 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444c2c9-bd10-40ae-8d22-37b115bd0ae5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:26.841033 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444c2c9-bd10-40ae-8d22-37b115bd0ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:26.841621 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6444c2c9-bd10-40ae-8d22-37b115bd0ae5 admin admin] PATH_INFO: `/v3/projects/230486e6ce974ab89147f39cbf941839/users/e64bccabbf334667a3e8de9f1b7bb878/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:26.857782 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 804/1606] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:17:26 2022] PUT /identity/v3/projects/29655206dbba479eaf93e154247f5025/users/35039474282847a79ce6997fb52b31ff/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:17:26.857978 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787de86-cb27-46ad-9025-0264dc535188 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:26.865858 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787de86-cb27-46ad-9025-0264dc535188 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:26.865858 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f787de86-cb27-46ad-9025-0264dc535188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:26.866036 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6444c2c9-bd10-40ae-8d22-37b115bd0ae5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=230486e6ce974ab89147f39cbf941839, user_id=e64bccabbf334667a3e8de9f1b7bb878, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:26.866593 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6444c2c9-bd10-40ae-8d22-37b115bd0ae5 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:26.885180 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 803/1607] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:17:26 2022] PUT /identity/v3/projects/230486e6ce974ab89147f39cbf941839/users/e64bccabbf334667a3e8de9f1b7bb878/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:17:26.887490 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-f787de86-cb27-46ad-9025-0264dc535188 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:26.888044 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14494dec-842d-4ed2-b5ad-062117e5792d None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:26.888538 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14494dec-842d-4ed2-b5ad-062117e5792d None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:26.888754 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-f787de86-cb27-46ad-9025-0264dc535188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:26.889702 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14494dec-842d-4ed2-b5ad-062117e5792d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:26.917865 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-14494dec-842d-4ed2-b5ad-062117e5792d None None] MFA Rules not processed for user `0f1db2b9cd974e268fd8be67814d5373`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:26.919354 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-14494dec-842d-4ed2-b5ad-062117e5792d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:26.964294 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 805/1608] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:17:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:17:26.965276 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f787de86-cb27-46ad-9025-0264dc535188 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:26.978015 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f787de86-cb27-46ad-9025-0264dc535188 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:26.984469 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d70844-ad1c-45e3-ba47-508301ce0aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:26.985726 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d70844-ad1c-45e3-ba47-508301ce0aff admin admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:26.986015 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d70844-ad1c-45e3-ba47-508301ce0aff admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:26.986291 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d70844-ad1c-45e3-ba47-508301ce0aff admin admin] PATH_INFO: `/v3/projects/379adfd2520a4d2dba04fca7fa3a1d95/users/43620937739e45d3bb7849f98d0e6cce/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:27.002090 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 804/1609] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:17:26 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:17:27.004710 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d70844-ad1c-45e3-ba47-508301ce0aff admin admin] RBAC: Authorizing `identity:create_grant(project_id=379adfd2520a4d2dba04fca7fa3a1d95, user_id=43620937739e45d3bb7849f98d0e6cce, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:27.007025 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09184847-1bc1-402c-a5aa-ec78a59c5c48 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:27.007420 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09184847-1bc1-402c-a5aa-ec78a59c5c48 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:27.007709 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d70844-ad1c-45e3-ba47-508301ce0aff admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:27.007821 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09184847-1bc1-402c-a5aa-ec78a59c5c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:27.032545 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-09184847-1bc1-402c-a5aa-ec78a59c5c48 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:27.032683 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 806/1610] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:17:26 2022] PUT /identity/v3/projects/379adfd2520a4d2dba04fca7fa3a1d95/users/43620937739e45d3bb7849f98d0e6cce/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:17:27.033795 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-09184847-1bc1-402c-a5aa-ec78a59c5c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:27.037574 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d70844-ad1c-45e3-ba47-508301ce0aff admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:27.116997 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d70844-ad1c-45e3-ba47-508301ce0aff admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:27.119169 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 805/1611] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:17:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:17:27.121688 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aeb46e-bd33-4adb-965c-049bd9d74ac8 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:27.121935 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aeb46e-bd33-4adb-965c-049bd9d74ac8 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:27.122186 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aeb46e-bd33-4adb-965c-049bd9d74ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:27.126011 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba186069-8365-4dad-bce7-d9abc883d704 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b430b739cb54fc7911bc89f8ea2df72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:27.126665 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba186069-8365-4dad-bce7-d9abc883d704 service nova] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:27.127046 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba186069-8365-4dad-bce7-d9abc883d704 service nova] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:27.127367 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba186069-8365-4dad-bce7-d9abc883d704 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:27.150682 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-60aeb46e-bd33-4adb-965c-049bd9d74ac8 None None] MFA Rules not processed for user `35039474282847a79ce6997fb52b31ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:27.152043 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-60aeb46e-bd33-4adb-965c-049bd9d74ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:27.195567 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba186069-8365-4dad-bce7-d9abc883d704 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:27.198601 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba186069-8365-4dad-bce7-d9abc883d704 service nova] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:27.210894 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 807/1612] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:17:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:17:27.212389 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90929764-5316-4b5d-8443-4dc127d7c02c None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:27.212683 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90929764-5316-4b5d-8443-4dc127d7c02c None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:27.213094 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90929764-5316-4b5d-8443-4dc127d7c02c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:27.231618 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-90929764-5316-4b5d-8443-4dc127d7c02c None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:27.232831 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-90929764-5316-4b5d-8443-4dc127d7c02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:27.238064 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 806/1613] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:17:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:17:27.239390 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aeb46e-bd33-4adb-965c-049bd9d74ac8 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:27.254819 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 808/1614] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:17:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:17:27.255882 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90929764-5316-4b5d-8443-4dc127d7c02c None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:27.310713 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aeb46e-bd33-4adb-965c-049bd9d74ac8 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:27.316189 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779178aa-bd7c-436b-94f8-67d233271a57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:27.316840 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779178aa-bd7c-436b-94f8-67d233271a57 service neutron] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:27.317247 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779178aa-bd7c-436b-94f8-67d233271a57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:27.317553 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779178aa-bd7c-436b-94f8-67d233271a57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:27.326898 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90929764-5316-4b5d-8443-4dc127d7c02c None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:27.329316 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779178aa-bd7c-436b-94f8-67d233271a57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:27.331367 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779178aa-bd7c-436b-94f8-67d233271a57 service neutron] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:27.333232 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c52f5b1-0d85-4a1e-a74e-185ca1959b0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:27.334128 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52f5b1-0d85-4a1e-a74e-185ca1959b0c service cinder] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:27.334582 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52f5b1-0d85-4a1e-a74e-185ca1959b0c service cinder] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:27.335196 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52f5b1-0d85-4a1e-a74e-185ca1959b0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:27.343648 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 807/1615] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:17:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:17:27.345014 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a078c-7f76-4cf3-b815-009dde8c8ded None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:27.345316 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a078c-7f76-4cf3-b815-009dde8c8ded None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:27.345618 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a078c-7f76-4cf3-b815-009dde8c8ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:27.364963 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-f94a078c-7f76-4cf3-b815-009dde8c8ded None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:27.366244 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-f94a078c-7f76-4cf3-b815-009dde8c8ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:27.383541 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 808/1616] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:17:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:17:27.383541 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a078c-7f76-4cf3-b815-009dde8c8ded None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:27.410771 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a078c-7f76-4cf3-b815-009dde8c8ded None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:27.420096 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26697fac-c009-4bc0-aa01-df44d1b46803 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:27.420757 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26697fac-c009-4bc0-aa01-df44d1b46803 service neutron] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:27.421035 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26697fac-c009-4bc0-aa01-df44d1b46803 service neutron] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:27.423520 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26697fac-c009-4bc0-aa01-df44d1b46803 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:27.441636 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26697fac-c009-4bc0-aa01-df44d1b46803 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:27.443567 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26697fac-c009-4bc0-aa01-df44d1b46803 service neutron] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:27.444683 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c52f5b1-0d85-4a1e-a74e-185ca1959b0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:27.449607 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c52f5b1-0d85-4a1e-a74e-185ca1959b0c service cinder] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:27.457724 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 809/1617] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:17:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:17:27.460842 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26697fac-c009-4bc0-aa01-df44d1b46803 service neutron] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:27.474261 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26697fac-c009-4bc0-aa01-df44d1b46803 service neutron] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:27.479023 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 809/1618] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:17:27 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:17:27.479848 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c52f5b1-0d85-4a1e-a74e-185ca1959b0c service cinder] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:27.481423 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f44347c-0341-476a-93cb-f12232e94cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:27.482359 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44347c-0341-476a-93cb-f12232e94cb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:27.483121 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44347c-0341-476a-93cb-f12232e94cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:27.483663 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44347c-0341-476a-93cb-f12232e94cb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:27.484654 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f44347c-0341-476a-93cb-f12232e94cb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:27.487198 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f44347c-0341-476a-93cb-f12232e94cb8 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:27.514551 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c52f5b1-0d85-4a1e-a74e-185ca1959b0c service cinder] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:27.520333 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 810/1619] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:17:27 2022] POST /identity/v3/projects => generated 387 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:17:27.521317 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f44347c-0341-476a-93cb-f12232e94cb8 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:27.525808 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0843361-7458-4b94-a009-5fdc7e08794a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:27.526504 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0843361-7458-4b94-a009-5fdc7e08794a service neutron] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:27.526781 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0843361-7458-4b94-a009-5fdc7e08794a service neutron] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:27.527032 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0843361-7458-4b94-a009-5fdc7e08794a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:27.544325 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0843361-7458-4b94-a009-5fdc7e08794a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:27.545854 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0843361-7458-4b94-a009-5fdc7e08794a service neutron] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:27.571286 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 810/1620] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:17:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:17:27.572111 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0843361-7458-4b94-a009-5fdc7e08794a service neutron] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:27.587745 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0843361-7458-4b94-a009-5fdc7e08794a service neutron] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:27.652548 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f44347c-0341-476a-93cb-f12232e94cb8 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:27.662115 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8664c3-d369-4cda-b4e3-496fe07563cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:27.664117 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8664c3-d369-4cda-b4e3-496fe07563cf service neutron] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:27.664671 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8664c3-d369-4cda-b4e3-496fe07563cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:27.665857 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8664c3-d369-4cda-b4e3-496fe07563cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:27.702971 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab99352-94f3-4a08-bc1c-bf35c3893ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:27.703561 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab99352-94f3-4a08-bc1c-bf35c3893ae8 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:27.703834 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab99352-94f3-4a08-bc1c-bf35c3893ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:27.704099 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab99352-94f3-4a08-bc1c-bf35c3893ae8 admin admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:27.704788 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab99352-94f3-4a08-bc1c-bf35c3893ae8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:27.706741 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab99352-94f3-4a08-bc1c-bf35c3893ae8 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:27.745556 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 811/1621] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:17:27 2022] POST /identity/v3/users => generated 300 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:17:27.749698 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab99352-94f3-4a08-bc1c-bf35c3893ae8 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:27.765083 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab99352-94f3-4a08-bc1c-bf35c3893ae8 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:27.776942 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fee7de-97a7-47d2-a5cb-b81d76e3c715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:27.779454 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fee7de-97a7-47d2-a5cb-b81d76e3c715 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:27.779892 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fee7de-97a7-47d2-a5cb-b81d76e3c715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:27.780290 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fee7de-97a7-47d2-a5cb-b81d76e3c715 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:27.782680 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fee7de-97a7-47d2-a5cb-b81d76e3c715 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:27.786526 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fee7de-97a7-47d2-a5cb-b81d76e3c715 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:27.806556 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8664c3-d369-4cda-b4e3-496fe07563cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:27.808328 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8664c3-d369-4cda-b4e3-496fe07563cf service neutron] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:27.811192 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 812/1622] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:17:27 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:17:27.815204 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fee7de-97a7-47d2-a5cb-b81d76e3c715 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:27.842825 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fee7de-97a7-47d2-a5cb-b81d76e3c715 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:27.849940 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 811/1623] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:17:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:17:27.857954 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e5fe0e-5580-4ade-bae2-66187dfd3eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:27.859049 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5fe0e-5580-4ade-bae2-66187dfd3eab admin admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:27.859467 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5fe0e-5580-4ade-bae2-66187dfd3eab admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:27.859840 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5fe0e-5580-4ade-bae2-66187dfd3eab admin admin] PATH_INFO: `/v3/projects/0e76b4235ff849db87dc6c26d578f7fa/users/3d278ddf8f08431483c89206cb8e91f6/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:27.892380 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e5fe0e-5580-4ade-bae2-66187dfd3eab admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e76b4235ff849db87dc6c26d578f7fa, user_id=3d278ddf8f08431483c89206cb8e91f6, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:27.896370 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e5fe0e-5580-4ade-bae2-66187dfd3eab admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:27.917509 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 813/1624] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:17:27 2022] PUT /identity/v3/projects/0e76b4235ff849db87dc6c26d578f7fa/users/3d278ddf8f08431483c89206cb8e91f6/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:17:27.922031 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8664c3-d369-4cda-b4e3-496fe07563cf service neutron] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:27.936286 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8664c3-d369-4cda-b4e3-496fe07563cf service neutron] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:28.038745 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d311401-dc8c-4ee9-b4eb-f4596fd2bc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:28.039482 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d311401-dc8c-4ee9-b4eb-f4596fd2bc56 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:28.039763 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d311401-dc8c-4ee9-b4eb-f4596fd2bc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:28.040037 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d311401-dc8c-4ee9-b4eb-f4596fd2bc56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:28.040904 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d311401-dc8c-4ee9-b4eb-f4596fd2bc56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:28.042718 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d311401-dc8c-4ee9-b4eb-f4596fd2bc56 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:28.075369 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 812/1625] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:17:27 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:17:28.083345 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e5fe0e-5580-4ade-bae2-66187dfd3eab admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:28.105836 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e5fe0e-5580-4ade-bae2-66187dfd3eab admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:28.112891 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e28f92-0b7c-4633-90f3-d5f864d13fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:28.114324 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e28f92-0b7c-4633-90f3-d5f864d13fc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:28.114605 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e28f92-0b7c-4633-90f3-d5f864d13fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:28.114932 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e28f92-0b7c-4633-90f3-d5f864d13fc7 admin admin] PATH_INFO: `/v3/projects/0e76b4235ff849db87dc6c26d578f7fa/users/3d278ddf8f08431483c89206cb8e91f6/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:28.117343 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e28f92-0b7c-4633-90f3-d5f864d13fc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e76b4235ff849db87dc6c26d578f7fa, user_id=3d278ddf8f08431483c89206cb8e91f6, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:28.121279 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e28f92-0b7c-4633-90f3-d5f864d13fc7 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:28.138153 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 814/1626] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:17:28 2022] PUT /identity/v3/projects/0e76b4235ff849db87dc6c26d578f7fa/users/3d278ddf8f08431483c89206cb8e91f6/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:17:28.149677 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55ae01-7146-4e2d-aaaf-340ad99a562f None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:28.150279 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55ae01-7146-4e2d-aaaf-340ad99a562f None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:28.150838 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55ae01-7146-4e2d-aaaf-340ad99a562f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:28.182381 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-0b55ae01-7146-4e2d-aaaf-340ad99a562f None None] MFA Rules not processed for user `3d278ddf8f08431483c89206cb8e91f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:28.184592 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-0b55ae01-7146-4e2d-aaaf-340ad99a562f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:28.201591 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73eff2-5c30-4a0a-a434-aff0613e2150 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:28.202175 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73eff2-5c30-4a0a-a434-aff0613e2150 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:28.202722 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73eff2-5c30-4a0a-a434-aff0613e2150 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:28.204943 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 815/1627] 10.222.0.65 () {54 vars in 961 bytes} [Tue May 17 18:17:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:17:28.211157 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d44d18-17b7-49ca-a61a-fa1620188ec3 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:28.211795 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d44d18-17b7-49ca-a61a-fa1620188ec3 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:28.212308 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d44d18-17b7-49ca-a61a-fa1620188ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:28.259649 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-c1d44d18-17b7-49ca-a61a-fa1620188ec3 None None] MFA Rules not processed for user `5b430b739cb54fc7911bc89f8ea2df72`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:28.263299 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-c1d44d18-17b7-49ca-a61a-fa1620188ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:28.361738 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 813/1628] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:17:28 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:17:28.374901 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55ae01-7146-4e2d-aaaf-340ad99a562f None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:28.464455 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 816/1629] 10.222.0.65 () {58 vars in 1058 bytes} [Tue May 17 18:17:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:17:28.478275 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79eb27f-1e4c-4148-a188-711bf540a1cf None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:28.478573 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79eb27f-1e4c-4148-a188-711bf540a1cf None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:28.478855 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79eb27f-1e4c-4148-a188-711bf540a1cf None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:28.484693 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 817/1630] 10.222.0.65 () {54 vars in 912 bytes} [Tue May 17 18:17:28 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:17:28.487777 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1ab72-8ffc-4379-a5d9-1910c28a117c None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:28.488062 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1ab72-8ffc-4379-a5d9-1910c28a117c None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:28.488338 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1ab72-8ffc-4379-a5d9-1910c28a117c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:28.555667 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-7ec1ab72-8ffc-4379-a5d9-1910c28a117c None None] MFA Rules not processed for user `5b430b739cb54fc7911bc89f8ea2df72`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:28.557363 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-7ec1ab72-8ffc-4379-a5d9-1910c28a117c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:28.568152 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55ae01-7146-4e2d-aaaf-340ad99a562f None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:28.579654 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1970ab16-e054-42ca-aa52-36dd380c37be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:28.580480 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970ab16-e054-42ca-aa52-36dd380c37be service cinder] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:28.580784 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970ab16-e054-42ca-aa52-36dd380c37be service cinder] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:28.581112 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970ab16-e054-42ca-aa52-36dd380c37be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:28.584718 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 818/1631] 10.222.0.65 () {58 vars in 1009 bytes} [Tue May 17 18:17:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:17:28.595337 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1970ab16-e054-42ca-aa52-36dd380c37be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:28.597349 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1970ab16-e054-42ca-aa52-36dd380c37be service cinder] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:28.607794 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec1ab72-8ffc-4379-a5d9-1910c28a117c None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:28.619618 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec1ab72-8ffc-4379-a5d9-1910c28a117c None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:28.623344 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 814/1632] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:17:28 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:17:28.626035 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d833829c-f565-45ad-8ba3-8a583659a320 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:28.626689 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833829c-f565-45ad-8ba3-8a583659a320 service cinder] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:28.627102 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833829c-f565-45ad-8ba3-8a583659a320 service cinder] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:28.627378 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833829c-f565-45ad-8ba3-8a583659a320 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:28.646861 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d833829c-f565-45ad-8ba3-8a583659a320 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:28.648572 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d833829c-f565-45ad-8ba3-8a583659a320 service cinder] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:28.669879 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 819/1633] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:17:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:17:28.818306 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e03eb1-b2dc-431a-8b2c-5a471a619372 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:28.818609 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e03eb1-b2dc-431a-8b2c-5a471a619372 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:28.818945 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e03eb1-b2dc-431a-8b2c-5a471a619372 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:28.820462 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 815/1634] 10.222.0.65 () {54 vars in 912 bytes} [Tue May 17 18:17:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:17:28.827298 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba530e-9e5b-43b6-956a-1bd52f1d9029 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:28.827589 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba530e-9e5b-43b6-956a-1bd52f1d9029 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:28.827867 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba530e-9e5b-43b6-956a-1bd52f1d9029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:28.870678 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-88ba530e-9e5b-43b6-956a-1bd52f1d9029 None None] MFA Rules not processed for user `5b430b739cb54fc7911bc89f8ea2df72`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:28.871908 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-88ba530e-9e5b-43b6-956a-1bd52f1d9029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:28.884194 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 820/1635] 10.222.0.65 () {58 vars in 1009 bytes} [Tue May 17 18:17:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:17:28.903234 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e03eb1-b2dc-431a-8b2c-5a471a619372 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:28.922406 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e03eb1-b2dc-431a-8b2c-5a471a619372 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:28.935141 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b048e-0383-4e7a-bc20-ba017f19a871 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:28.936011 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b048e-0383-4e7a-bc20-ba017f19a871 service cinder] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:28.936398 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b048e-0383-4e7a-bc20-ba017f19a871 service cinder] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:28.937185 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b048e-0383-4e7a-bc20-ba017f19a871 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:28.974025 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859b048e-0383-4e7a-bc20-ba017f19a871 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:28.975577 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859b048e-0383-4e7a-bc20-ba017f19a871 service cinder] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:28.989486 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 816/1636] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:17:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:17:29.016126 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ba530e-9e5b-43b6-956a-1bd52f1d9029 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:29.107851 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ba530e-9e5b-43b6-956a-1bd52f1d9029 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:29.112985 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140709a-b049-4cf1-be74-ee72da7481f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:29.114530 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140709a-b049-4cf1-be74-ee72da7481f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:29.115043 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140709a-b049-4cf1-be74-ee72da7481f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:29.115494 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140709a-b049-4cf1-be74-ee72da7481f3 admin admin] PATH_INFO: `/v3/users/35039474282847a79ce6997fb52b31ff` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:29.116963 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f140709a-b049-4cf1-be74-ee72da7481f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35039474282847a79ce6997fb52b31ff)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:29.119376 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f140709a-b049-4cf1-be74-ee72da7481f3 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:29.201953 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-f140709a-b049-4cf1-be74-ee72da7481f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35039474282847a79ce6997fb52b31ff'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:29.224891 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-f140709a-b049-4cf1-be74-ee72da7481f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35039474282847a79ce6997fb52b31ff'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:29.225796 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-f140709a-b049-4cf1-be74-ee72da7481f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35039474282847a79ce6997fb52b31ff'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:29.226418 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-f140709a-b049-4cf1-be74-ee72da7481f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35039474282847a79ce6997fb52b31ff'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:29.243267 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-f140709a-b049-4cf1-be74-ee72da7481f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35039474282847a79ce6997fb52b31ff'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:29.294170 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 821/1637] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:17:29 2022] DELETE /identity/v3/users/35039474282847a79ce6997fb52b31ff => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:17:29.298613 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c83e17-3ee0-42c8-bda0-fbf1ffc3f1f3 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:29.299225 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c83e17-3ee0-42c8-bda0-fbf1ffc3f1f3 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:29.299809 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c83e17-3ee0-42c8-bda0-fbf1ffc3f1f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:29.333236 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-77c83e17-3ee0-42c8-bda0-fbf1ffc3f1f3 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:29.334537 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-77c83e17-3ee0-42c8-bda0-fbf1ffc3f1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:29.469658 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140709a-b049-4cf1-be74-ee72da7481f3 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:29.471248 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-f140709a-b049-4cf1-be74-ee72da7481f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:29.537091 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 817/1638] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:17:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:17:29.576293 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c83e17-3ee0-42c8-bda0-fbf1ffc3f1f3 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:29.579516 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-77c83e17-3ee0-42c8-bda0-fbf1ffc3f1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:29.684285 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140709a-b049-4cf1-be74-ee72da7481f3 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:29.699412 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67286f7f-8f5f-42aa-aff8-c2dbdb68a383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:29.702554 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67286f7f-8f5f-42aa-aff8-c2dbdb68a383 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:29.702843 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67286f7f-8f5f-42aa-aff8-c2dbdb68a383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:29.703171 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67286f7f-8f5f-42aa-aff8-c2dbdb68a383 admin admin] PATH_INFO: `/v3/users/82a34231bf8e43808d6cb1cb55d93060` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:29.707997 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67286f7f-8f5f-42aa-aff8-c2dbdb68a383 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82a34231bf8e43808d6cb1cb55d93060)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:29.712390 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67286f7f-8f5f-42aa-aff8-c2dbdb68a383 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:29.769896 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c83e17-3ee0-42c8-bda0-fbf1ffc3f1f3 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:29.789656 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec8eba-a07d-4242-966d-ec9728acfe8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:29.793227 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec8eba-a07d-4242-966d-ec9728acfe8a service neutron] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:29.794411 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec8eba-a07d-4242-966d-ec9728acfe8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:29.794701 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec8eba-a07d-4242-966d-ec9728acfe8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:29.824551 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ec8eba-a07d-4242-966d-ec9728acfe8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:29.829671 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ec8eba-a07d-4242-966d-ec9728acfe8a service neutron] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:29.850756 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-67286f7f-8f5f-42aa-aff8-c2dbdb68a383 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82a34231bf8e43808d6cb1cb55d93060'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:29.864993 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 818/1639] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:17:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:17:29.872459 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-67286f7f-8f5f-42aa-aff8-c2dbdb68a383 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82a34231bf8e43808d6cb1cb55d93060'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:29.873343 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-67286f7f-8f5f-42aa-aff8-c2dbdb68a383 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82a34231bf8e43808d6cb1cb55d93060'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:29.874043 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-67286f7f-8f5f-42aa-aff8-c2dbdb68a383 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82a34231bf8e43808d6cb1cb55d93060'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:29.882335 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-67286f7f-8f5f-42aa-aff8-c2dbdb68a383 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82a34231bf8e43808d6cb1cb55d93060'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:29.904332 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 822/1640] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:17:29 2022] DELETE /identity/v3/users/82a34231bf8e43808d6cb1cb55d93060 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:17:29.910299 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcfd45e-4acf-4750-8c39-dd6051ff60ea None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:29.910678 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcfd45e-4acf-4750-8c39-dd6051ff60ea None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:29.911797 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcfd45e-4acf-4750-8c39-dd6051ff60ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:29.961684 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac7229-42e5-4630-9419-09d23e9a0d15 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:29.961970 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac7229-42e5-4630-9419-09d23e9a0d15 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:29.962247 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac7229-42e5-4630-9419-09d23e9a0d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:29.971666 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-ebcfd45e-4acf-4750-8c39-dd6051ff60ea None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:29.973034 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-ebcfd45e-4acf-4750-8c39-dd6051ff60ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:30.002681 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-35ac7229-42e5-4630-9419-09d23e9a0d15 None None] MFA Rules not processed for user `e64bccabbf334667a3e8de9f1b7bb878`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:30.004283 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-35ac7229-42e5-4630-9419-09d23e9a0d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:30.097833 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 819/1641] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:17:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:17:30.099259 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 823/1642] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:17:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:17:30.103714 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6e6ce-ca2d-49d3-9e59-514bc909ad45 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:30.103914 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac7229-42e5-4630-9419-09d23e9a0d15 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:30.104958 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6e6ce-ca2d-49d3-9e59-514bc909ad45 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:30.105239 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6e6ce-ca2d-49d3-9e59-514bc909ad45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:30.114575 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-35ac7229-42e5-4630-9419-09d23e9a0d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:30.128811 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-b4a6e6ce-ca2d-49d3-9e59-514bc909ad45 None None] MFA Rules not processed for user `e64bccabbf334667a3e8de9f1b7bb878`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:30.130504 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-b4a6e6ce-ca2d-49d3-9e59-514bc909ad45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:30.145506 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 820/1643] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:17:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:17:30.179517 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a6e6ce-ca2d-49d3-9e59-514bc909ad45 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:30.180927 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-b4a6e6ce-ca2d-49d3-9e59-514bc909ad45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:30.212253 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac7229-42e5-4630-9419-09d23e9a0d15 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:30.216541 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8b390-60e9-4dc9-b765-6716ec0b04a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:30.218096 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8b390-60e9-4dc9-b765-6716ec0b04a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:30.218488 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8b390-60e9-4dc9-b765-6716ec0b04a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:30.218838 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8b390-60e9-4dc9-b765-6716ec0b04a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:30.235212 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f8b390-60e9-4dc9-b765-6716ec0b04a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:30.237482 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f8b390-60e9-4dc9-b765-6716ec0b04a4 service neutron] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:30.256270 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 824/1644] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:17:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:17:30.331312 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a6e6ce-ca2d-49d3-9e59-514bc909ad45 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:30.342177 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac3307-7cf8-4462-8665-7af4a03a8376 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b430b739cb54fc7911bc89f8ea2df72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:30.346025 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac3307-7cf8-4462-8665-7af4a03a8376 service nova] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:30.347396 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac3307-7cf8-4462-8665-7af4a03a8376 service nova] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:30.347843 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac3307-7cf8-4462-8665-7af4a03a8376 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:30.375100 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aac3307-7cf8-4462-8665-7af4a03a8376 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:30.378536 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aac3307-7cf8-4462-8665-7af4a03a8376 service nova] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:30.390929 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 821/1645] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:17:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:17:31.038313 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8b390-60e9-4dc9-b765-6716ec0b04a4 service neutron] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:31.040319 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-20f8b390-60e9-4dc9-b765-6716ec0b04a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:31.063116 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8b390-60e9-4dc9-b765-6716ec0b04a4 service neutron] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:31.074013 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871a715-e7a2-46dc-bb14-6c7d69379dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:31.074889 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871a715-e7a2-46dc-bb14-6c7d69379dcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:31.075162 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871a715-e7a2-46dc-bb14-6c7d69379dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:31.075430 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871a715-e7a2-46dc-bb14-6c7d69379dcd admin admin] PATH_INFO: `/v3/projects/4de85b5a9fd04a9ba5d16da6d4816235` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:31.078251 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9871a715-e7a2-46dc-bb14-6c7d69379dcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4de85b5a9fd04a9ba5d16da6d4816235)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:31.079295 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: WARNING py.warnings [None req-9871a715-e7a2-46dc-bb14-6c7d69379dcd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 18:17:31.079295 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: warnings.warn(msg) May 17 18:17:31.079295 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: May 17 18:17:31.080490 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9871a715-e7a2-46dc-bb14-6c7d69379dcd admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:31.126515 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ae444-59f3-42fe-b98c-f346e2001244 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:31.127113 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ae444-59f3-42fe-b98c-f346e2001244 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:31.127113 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ae444-59f3-42fe-b98c-f346e2001244 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:31.128713 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 822/1646] 10.222.0.65 () {54 vars in 912 bytes} [Tue May 17 18:17:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 18:17:31.136110 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3e89d-7bc6-4f7d-88a3-aaff742d8644 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:31.136385 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3e89d-7bc6-4f7d-88a3-aaff742d8644 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:31.136660 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3e89d-7bc6-4f7d-88a3-aaff742d8644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:31.257116 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-88c3e89d-7bc6-4f7d-88a3-aaff742d8644 None None] MFA Rules not processed for user `83430939ae474ad6bab37dfb6fc8da78`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:31.258366 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-88c3e89d-7bc6-4f7d-88a3-aaff742d8644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:31.284025 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-9871a715-e7a2-46dc-bb14-6c7d69379dcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4de85b5a9fd04a9ba5d16da6d4816235', 'request_id': 'req-9871a715-e7a2-46dc-bb14-6c7d69379dcd'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:31.318178 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-9871a715-e7a2-46dc-bb14-6c7d69379dcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4de85b5a9fd04a9ba5d16da6d4816235', 'request_id': 'req-9871a715-e7a2-46dc-bb14-6c7d69379dcd'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:31.343516 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-9871a715-e7a2-46dc-bb14-6c7d69379dcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4de85b5a9fd04a9ba5d16da6d4816235', 'request_id': 'req-9871a715-e7a2-46dc-bb14-6c7d69379dcd'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:31.372654 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-9871a715-e7a2-46dc-bb14-6c7d69379dcd admin admin] The token cache is being invalidate because project 4de85b5a9fd04a9ba5d16da6d4816235 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:17:31.372952 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-9871a715-e7a2-46dc-bb14-6c7d69379dcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:31.378027 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-9871a715-e7a2-46dc-bb14-6c7d69379dcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:31.382267 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 825/1647] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:17:31 2022] DELETE /identity/v3/projects/4de85b5a9fd04a9ba5d16da6d4816235 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:17:31.397554 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2a925-b83f-4473-987a-2b2e217e4adf None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:31.398695 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2a925-b83f-4473-987a-2b2e217e4adf None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:31.399116 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd2a925-b83f-4473-987a-2b2e217e4adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:31.435158 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 823/1648] 10.222.0.65 () {58 vars in 1009 bytes} [Tue May 17 18:17:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) May 17 18:17:31.455980 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-4bd2a925-b83f-4473-987a-2b2e217e4adf None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:31.457283 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-4bd2a925-b83f-4473-987a-2b2e217e4adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:31.496707 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3e89d-7bc6-4f7d-88a3-aaff742d8644 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:31.498626 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-88c3e89d-7bc6-4f7d-88a3-aaff742d8644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:31.516922 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3e89d-7bc6-4f7d-88a3-aaff742d8644 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:31.531488 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85103bcd-2b62-44f8-8b93-bedce0b19b51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:31.532237 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85103bcd-2b62-44f8-8b93-bedce0b19b51 service neutron] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:31.533673 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85103bcd-2b62-44f8-8b93-bedce0b19b51 service neutron] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:31.535174 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85103bcd-2b62-44f8-8b93-bedce0b19b51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:31.558029 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85103bcd-2b62-44f8-8b93-bedce0b19b51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:31.563283 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85103bcd-2b62-44f8-8b93-bedce0b19b51 service neutron] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:31.587218 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 824/1649] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:17:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:17:31.612559 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 826/1650] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:17:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:17:31.613541 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd0b25-3f92-4f65-8fb6-478d4dde776b None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:31.613830 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd0b25-3f92-4f65-8fb6-478d4dde776b None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:31.614107 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd0b25-3f92-4f65-8fb6-478d4dde776b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:31.648604 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-72cd0b25-3f92-4f65-8fb6-478d4dde776b None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:31.649922 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-72cd0b25-3f92-4f65-8fb6-478d4dde776b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:31.676552 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 825/1651] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:17:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:17:31.682091 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd2a925-b83f-4473-987a-2b2e217e4adf None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:31.698014 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd2a925-b83f-4473-987a-2b2e217e4adf None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:31.712311 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2be6b-4c13-4ba6-9366-7dabfd8c4488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:31.715532 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2be6b-4c13-4ba6-9366-7dabfd8c4488 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:31.717312 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2be6b-4c13-4ba6-9366-7dabfd8c4488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:31.717679 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2be6b-4c13-4ba6-9366-7dabfd8c4488 admin admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:31.720790 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2be6b-4c13-4ba6-9366-7dabfd8c4488 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:17:31.730772 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2be6b-4c13-4ba6-9366-7dabfd8c4488 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:31.733439 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2be6b-4c13-4ba6-9366-7dabfd8c4488 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:31.760499 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 827/1652] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 17 18:17:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:17:31.761310 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd0b25-3f92-4f65-8fb6-478d4dde776b None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:31.774194 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd0b25-3f92-4f65-8fb6-478d4dde776b None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:31.799601 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3216c91f-8361-4719-839d-f3eee94e1836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:31.815832 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216c91f-8361-4719-839d-f3eee94e1836 admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:31.817148 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216c91f-8361-4719-839d-f3eee94e1836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:31.817449 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216c91f-8361-4719-839d-f3eee94e1836 admin admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:31.818254 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3216c91f-8361-4719-839d-f3eee94e1836 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:31.827208 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3216c91f-8361-4719-839d-f3eee94e1836 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:31.918201 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 826/1653] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:17:31 2022] POST /identity/v3/projects => generated 373 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:17:31.920918 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2be6b-4c13-4ba6-9366-7dabfd8c4488 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:31.935989 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2be6b-4c13-4ba6-9366-7dabfd8c4488 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:32.085729 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b746507-56e2-49ca-9eb5-9f0f42fdeed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:32.086321 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b746507-56e2-49ca-9eb5-9f0f42fdeed1 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:32.086599 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b746507-56e2-49ca-9eb5-9f0f42fdeed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:32.086872 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b746507-56e2-49ca-9eb5-9f0f42fdeed1 admin admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:32.087567 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b746507-56e2-49ca-9eb5-9f0f42fdeed1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:32.090461 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b746507-56e2-49ca-9eb5-9f0f42fdeed1 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:32.118475 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 828/1654] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:17:31 2022] POST /identity/v3/users => generated 287 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:17:32.119149 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3216c91f-8361-4719-839d-f3eee94e1836 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:32.136610 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3216c91f-8361-4719-839d-f3eee94e1836 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:32.149132 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c5711-50bb-41ba-aa9b-d0123cf36a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:32.149969 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c5711-50bb-41ba-aa9b-d0123cf36a89 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:32.150271 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c5711-50bb-41ba-aa9b-d0123cf36a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:32.150651 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c5711-50bb-41ba-aa9b-d0123cf36a89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:32.151545 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305c5711-50bb-41ba-aa9b-d0123cf36a89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:32.165907 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305c5711-50bb-41ba-aa9b-d0123cf36a89 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:32.175895 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 827/1655] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:17:32 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:17:32.177206 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b746507-56e2-49ca-9eb5-9f0f42fdeed1 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:32.196842 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b746507-56e2-49ca-9eb5-9f0f42fdeed1 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:32.204979 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db73be3d-8c32-4bc7-8fe9-9b9f6ed351ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:32.205979 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73be3d-8c32-4bc7-8fe9-9b9f6ed351ee admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:32.206482 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73be3d-8c32-4bc7-8fe9-9b9f6ed351ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:32.206960 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db73be3d-8c32-4bc7-8fe9-9b9f6ed351ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:32.207915 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db73be3d-8c32-4bc7-8fe9-9b9f6ed351ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:32.210036 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db73be3d-8c32-4bc7-8fe9-9b9f6ed351ee admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:32.253985 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 829/1656] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:17:32 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:17:32.255667 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c5711-50bb-41ba-aa9b-d0123cf36a89 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:32.281919 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c5711-50bb-41ba-aa9b-d0123cf36a89 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:32.287270 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47b18a-5d34-447c-9534-892d287aca30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:32.288716 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47b18a-5d34-447c-9534-892d287aca30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:32.289120 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47b18a-5d34-447c-9534-892d287aca30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:32.289577 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47b18a-5d34-447c-9534-892d287aca30 admin admin] PATH_INFO: `/v3/projects/0446fa575c604072bfc1809616c042f8/users/a524e077a0c84850b2af69c76e2b5017/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:32.328267 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf47b18a-5d34-447c-9534-892d287aca30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0446fa575c604072bfc1809616c042f8, user_id=a524e077a0c84850b2af69c76e2b5017, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:32.333345 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf47b18a-5d34-447c-9534-892d287aca30 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:32.346197 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db73be3d-8c32-4bc7-8fe9-9b9f6ed351ee admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:32.348155 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-db73be3d-8c32-4bc7-8fe9-9b9f6ed351ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:32.358779 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 828/1657] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:17:32 2022] PUT /identity/v3/projects/0446fa575c604072bfc1809616c042f8/users/a524e077a0c84850b2af69c76e2b5017/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:17:32.370889 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322215dd-42e5-4b63-b7df-12c653f88c17 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:32.371880 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322215dd-42e5-4b63-b7df-12c653f88c17 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:32.372136 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322215dd-42e5-4b63-b7df-12c653f88c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:32.379234 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db73be3d-8c32-4bc7-8fe9-9b9f6ed351ee admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:32.458688 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-322215dd-42e5-4b63-b7df-12c653f88c17 None None] MFA Rules not processed for user `a524e077a0c84850b2af69c76e2b5017`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:32.459976 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-322215dd-42e5-4b63-b7df-12c653f88c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:32.603715 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a38d5-a8e8-412d-ac8d-1bf07606941e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:32.609574 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a38d5-a8e8-412d-ac8d-1bf07606941e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:32.612601 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a38d5-a8e8-412d-ac8d-1bf07606941e admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:32.613362 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a38d5-a8e8-412d-ac8d-1bf07606941e admin admin] PATH_INFO: `/v3/projects/29655206dbba479eaf93e154247f5025` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:32.619163 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8a38d5-a8e8-412d-ac8d-1bf07606941e admin admin] RBAC: Authorizing `identity:delete_project(project_id=29655206dbba479eaf93e154247f5025)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:32.621922 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8a38d5-a8e8-412d-ac8d-1bf07606941e admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:32.684419 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 829/1658] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:17:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:17:32.697503 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322215dd-42e5-4b63-b7df-12c653f88c17 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:32.719155 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322215dd-42e5-4b63-b7df-12c653f88c17 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:32.723997 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-0a8a38d5-a8e8-412d-ac8d-1bf07606941e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29655206dbba479eaf93e154247f5025', 'request_id': 'req-0a8a38d5-a8e8-412d-ac8d-1bf07606941e'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:32.732431 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-0a8a38d5-a8e8-412d-ac8d-1bf07606941e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29655206dbba479eaf93e154247f5025', 'request_id': 'req-0a8a38d5-a8e8-412d-ac8d-1bf07606941e'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:32.759393 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-0a8a38d5-a8e8-412d-ac8d-1bf07606941e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29655206dbba479eaf93e154247f5025', 'request_id': 'req-0a8a38d5-a8e8-412d-ac8d-1bf07606941e'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:32.787565 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-0a8a38d5-a8e8-412d-ac8d-1bf07606941e admin admin] The token cache is being invalidate because project 29655206dbba479eaf93e154247f5025 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:17:32.788610 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-0a8a38d5-a8e8-412d-ac8d-1bf07606941e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:32.789056 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-0a8a38d5-a8e8-412d-ac8d-1bf07606941e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:32.793902 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 830/1659] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:17:32 2022] DELETE /identity/v3/projects/29655206dbba479eaf93e154247f5025 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:17:32.798421 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a38d5-a8e8-412d-ac8d-1bf07606941e admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:32.808843 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-0a8a38d5-a8e8-412d-ac8d-1bf07606941e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:32.943006 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f37fb-cb6f-47e0-a458-5871dca2626a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:32.944050 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f37fb-cb6f-47e0-a458-5871dca2626a admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:32.944583 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f37fb-cb6f-47e0-a458-5871dca2626a admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:32.946266 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f37fb-cb6f-47e0-a458-5871dca2626a admin admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:32.947253 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3f37fb-cb6f-47e0-a458-5871dca2626a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:32.950316 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3f37fb-cb6f-47e0-a458-5871dca2626a admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:32.966344 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a38d5-a8e8-412d-ac8d-1bf07606941e admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:32.988517 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a79a7-7ce5-46e4-ba7c-5761eced41fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:32.989392 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a79a7-7ce5-46e4-ba7c-5761eced41fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:32.989746 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a79a7-7ce5-46e4-ba7c-5761eced41fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:32.990023 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a79a7-7ce5-46e4-ba7c-5761eced41fc admin admin] PATH_INFO: `/v3/users/3d278ddf8f08431483c89206cb8e91f6` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:32.992621 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37a79a7-7ce5-46e4-ba7c-5761eced41fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d278ddf8f08431483c89206cb8e91f6)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:32.999112 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 830/1660] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:17:32 2022] POST /identity/v3/projects => generated 371 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:17:33.002701 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab69e7e-8910-4939-b15a-ef15ae30513f None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:33.003728 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab69e7e-8910-4939-b15a-ef15ae30513f None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:33.004558 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab69e7e-8910-4939-b15a-ef15ae30513f None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:33.008325 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37a79a7-7ce5-46e4-ba7c-5761eced41fc admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:33.009330 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 831/1661] 10.222.0.65 () {54 vars in 960 bytes} [Tue May 17 18:17:32 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:17:33.011367 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab69e7e-8910-4939-b15a-ef15ae30513f None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:33.017741 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-5ab69e7e-8910-4939-b15a-ef15ae30513f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:33.098274 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-b37a79a7-7ce5-46e4-ba7c-5761eced41fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d278ddf8f08431483c89206cb8e91f6'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:33.129269 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-b37a79a7-7ce5-46e4-ba7c-5761eced41fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d278ddf8f08431483c89206cb8e91f6'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:33.131933 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-b37a79a7-7ce5-46e4-ba7c-5761eced41fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d278ddf8f08431483c89206cb8e91f6'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:33.138043 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-b37a79a7-7ce5-46e4-ba7c-5761eced41fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d278ddf8f08431483c89206cb8e91f6'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:33.166339 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab69e7e-8910-4939-b15a-ef15ae30513f None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:33.166963 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-b37a79a7-7ce5-46e4-ba7c-5761eced41fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d278ddf8f08431483c89206cb8e91f6'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:33.192739 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07abc963-5e65-4a5b-a602-3c1360942575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:33.193437 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07abc963-5e65-4a5b-a602-3c1360942575 admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:33.193933 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07abc963-5e65-4a5b-a602-3c1360942575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:33.194220 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07abc963-5e65-4a5b-a602-3c1360942575 admin admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:33.195149 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07abc963-5e65-4a5b-a602-3c1360942575 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:33.199371 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07abc963-5e65-4a5b-a602-3c1360942575 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:33.199508 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 831/1662] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:17:32 2022] DELETE /identity/v3/users/3d278ddf8f08431483c89206cb8e91f6 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:17:33.200813 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956da91f-5bf6-4abd-93d1-0add5f993b61 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:33.205663 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956da91f-5bf6-4abd-93d1-0add5f993b61 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:33.206105 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956da91f-5bf6-4abd-93d1-0add5f993b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:33.235200 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 832/1663] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:17:33 2022] POST /identity/v3/users => generated 292 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:17:33.238919 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07abc963-5e65-4a5b-a602-3c1360942575 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:33.244336 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-07abc963-5e65-4a5b-a602-3c1360942575 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:33.247142 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-956da91f-5bf6-4abd-93d1-0add5f993b61 None None] MFA Rules not processed for user `33ddf11ac3e14d03b1159868b3b73fa4`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:33.248719 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-956da91f-5bf6-4abd-93d1-0add5f993b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:33.281570 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07abc963-5e65-4a5b-a602-3c1360942575 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:33.361775 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 832/1664] 10.222.0.65 () {58 vars in 1057 bytes} [Tue May 17 18:17:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:17:33.362966 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956da91f-5bf6-4abd-93d1-0add5f993b61 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:33.391769 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956da91f-5bf6-4abd-93d1-0add5f993b61 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:33.414608 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20aa28-db1c-4860-a6f1-a1e67787b22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:33.415750 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20aa28-db1c-4860-a6f1-a1e67787b22c admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:33.415863 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a596525f-c581-4162-bf53-5240c0e3c63c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ddf11ac3e14d03b1159868b3b73fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:33.416289 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20aa28-db1c-4860-a6f1-a1e67787b22c admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:33.416397 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596525f-c581-4162-bf53-5240c0e3c63c service placement] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:33.416560 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20aa28-db1c-4860-a6f1-a1e67787b22c admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:33.417352 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e20aa28-db1c-4860-a6f1-a1e67787b22c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:33.418592 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596525f-c581-4162-bf53-5240c0e3c63c service placement] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:33.418886 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596525f-c581-4162-bf53-5240c0e3c63c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:33.419168 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e20aa28-db1c-4860-a6f1-a1e67787b22c admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:33.424002 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-a596525f-c581-4162-bf53-5240c0e3c63c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:33.455778 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 833/1665] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:17:33 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:17:33.459612 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20aa28-db1c-4860-a6f1-a1e67787b22c admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:33.462797 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a596525f-c581-4162-bf53-5240c0e3c63c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:33.469676 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a596525f-c581-4162-bf53-5240c0e3c63c service placement] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:33.472083 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20aa28-db1c-4860-a6f1-a1e67787b22c admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:33.479276 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6cde47-8cae-4a10-a2fb-03fa643aebce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:33.480465 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6cde47-8cae-4a10-a2fb-03fa643aebce admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:33.480748 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6cde47-8cae-4a10-a2fb-03fa643aebce admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:33.481062 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6cde47-8cae-4a10-a2fb-03fa643aebce admin admin] PATH_INFO: `/v3/projects/d011ffd5f11c4580ad499e44230281fa/users/56a7e0697eeb433eb0124d16491b0533/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:33.501591 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 833/1666] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:17:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:17:33.526981 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6cde47-8cae-4a10-a2fb-03fa643aebce admin admin] RBAC: Authorizing `identity:create_grant(project_id=d011ffd5f11c4580ad499e44230281fa, user_id=56a7e0697eeb433eb0124d16491b0533, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:33.536999 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6cde47-8cae-4a10-a2fb-03fa643aebce admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:33.584482 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 834/1667] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:17:33 2022] PUT /identity/v3/projects/d011ffd5f11c4580ad499e44230281fa/users/56a7e0697eeb433eb0124d16491b0533/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:17:33.585721 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a596525f-c581-4162-bf53-5240c0e3c63c service placement] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:33.604048 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a596525f-c581-4162-bf53-5240c0e3c63c service placement] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:33.767184 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48daf3e1-8256-4ed7-8792-6f812e472f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:33.768063 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48daf3e1-8256-4ed7-8792-6f812e472f47 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:33.768354 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48daf3e1-8256-4ed7-8792-6f812e472f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:33.768627 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48daf3e1-8256-4ed7-8792-6f812e472f47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:33.769524 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48daf3e1-8256-4ed7-8792-6f812e472f47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:33.771138 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48daf3e1-8256-4ed7-8792-6f812e472f47 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:33.797835 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 834/1668] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:17:33 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:17:33.804016 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6cde47-8cae-4a10-a2fb-03fa643aebce admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:33.819093 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6cde47-8cae-4a10-a2fb-03fa643aebce admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:33.836014 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a6ccb-4d94-48d5-bb2f-d6242e585e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:33.837528 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a6ccb-4d94-48d5-bb2f-d6242e585e15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:33.839313 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a6ccb-4d94-48d5-bb2f-d6242e585e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:33.839843 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a6ccb-4d94-48d5-bb2f-d6242e585e15 admin admin] PATH_INFO: `/v3/projects/d011ffd5f11c4580ad499e44230281fa/users/56a7e0697eeb433eb0124d16491b0533/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:33.851220 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21a6ccb-4d94-48d5-bb2f-d6242e585e15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d011ffd5f11c4580ad499e44230281fa, user_id=56a7e0697eeb433eb0124d16491b0533, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:33.859277 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21a6ccb-4d94-48d5-bb2f-d6242e585e15 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:33.894483 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 835/1669] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:17:33 2022] PUT /identity/v3/projects/d011ffd5f11c4580ad499e44230281fa/users/56a7e0697eeb433eb0124d16491b0533/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:17:33.905979 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc27414-7fab-4d3a-a351-3c18d19f48ac None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:33.906281 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc27414-7fab-4d3a-a351-3c18d19f48ac None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:33.906562 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc27414-7fab-4d3a-a351-3c18d19f48ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:33.962294 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-ffc27414-7fab-4d3a-a351-3c18d19f48ac None None] MFA Rules not processed for user `56a7e0697eeb433eb0124d16491b0533`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:33.966395 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-ffc27414-7fab-4d3a-a351-3c18d19f48ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:34.165214 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 835/1670] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:17:33 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:17:34.173313 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a6ccb-4d94-48d5-bb2f-d6242e585e15 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:34.175270 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-e21a6ccb-4d94-48d5-bb2f-d6242e585e15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:34.334981 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a6ccb-4d94-48d5-bb2f-d6242e585e15 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:34.340959 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c992f762-5db8-45b6-8e97-36c69ebcacb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:34.341828 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c992f762-5db8-45b6-8e97-36c69ebcacb8 service cinder] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:34.342213 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c992f762-5db8-45b6-8e97-36c69ebcacb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:34.342590 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c992f762-5db8-45b6-8e97-36c69ebcacb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:34.354887 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c992f762-5db8-45b6-8e97-36c69ebcacb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:34.356749 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c992f762-5db8-45b6-8e97-36c69ebcacb8 service cinder] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:34.383859 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 836/1671] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:17:34 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:17:34.521281 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc27414-7fab-4d3a-a351-3c18d19f48ac None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:34.540604 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc27414-7fab-4d3a-a351-3c18d19f48ac None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:34.548780 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a81e63c-8459-4684-9034-0c5224e7343c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:34.553218 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81e63c-8459-4684-9034-0c5224e7343c service cinder] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:34.555031 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81e63c-8459-4684-9034-0c5224e7343c service cinder] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:34.555610 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a81e63c-8459-4684-9034-0c5224e7343c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:34.565341 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-5a81e63c-8459-4684-9034-0c5224e7343c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:34.755136 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a81e63c-8459-4684-9034-0c5224e7343c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:34.756639 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a81e63c-8459-4684-9034-0c5224e7343c service cinder] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:34.774014 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 836/1672] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:17:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:17:36.052140 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c992f762-5db8-45b6-8e97-36c69ebcacb8 service cinder] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:36.053716 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-c992f762-5db8-45b6-8e97-36c69ebcacb8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:36.293039 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c992f762-5db8-45b6-8e97-36c69ebcacb8 service cinder] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:36.312921 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec23454-0a48-4cbb-9d3f-ee77aad47c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:36.314235 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec23454-0a48-4cbb-9d3f-ee77aad47c44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:36.315044 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec23454-0a48-4cbb-9d3f-ee77aad47c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:36.316037 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec23454-0a48-4cbb-9d3f-ee77aad47c44 admin admin] PATH_INFO: `/v3/projects/0e76b4235ff849db87dc6c26d578f7fa` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:36.319601 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec23454-0a48-4cbb-9d3f-ee77aad47c44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e76b4235ff849db87dc6c26d578f7fa)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:36.325535 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec23454-0a48-4cbb-9d3f-ee77aad47c44 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:36.501636 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-cec23454-0a48-4cbb-9d3f-ee77aad47c44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e76b4235ff849db87dc6c26d578f7fa', 'request_id': 'req-cec23454-0a48-4cbb-9d3f-ee77aad47c44'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:36.535146 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-cec23454-0a48-4cbb-9d3f-ee77aad47c44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e76b4235ff849db87dc6c26d578f7fa', 'request_id': 'req-cec23454-0a48-4cbb-9d3f-ee77aad47c44'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:36.569396 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-cec23454-0a48-4cbb-9d3f-ee77aad47c44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e76b4235ff849db87dc6c26d578f7fa', 'request_id': 'req-cec23454-0a48-4cbb-9d3f-ee77aad47c44'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:36.642640 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-cec23454-0a48-4cbb-9d3f-ee77aad47c44 admin admin] The token cache is being invalidate because project 0e76b4235ff849db87dc6c26d578f7fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:17:36.644084 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-cec23454-0a48-4cbb-9d3f-ee77aad47c44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:36.646409 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-cec23454-0a48-4cbb-9d3f-ee77aad47c44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:36.668553 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ba8af-ec9a-479c-b8a8-ee458f233da7 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:36.668553 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ba8af-ec9a-479c-b8a8-ee458f233da7 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:36.671819 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ba8af-ec9a-479c-b8a8-ee458f233da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:36.672865 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 837/1673] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:17:36 2022] DELETE /identity/v3/projects/0e76b4235ff849db87dc6c26d578f7fa => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:17:36.754727 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-331ba8af-ec9a-479c-b8a8-ee458f233da7 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:36.766296 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-331ba8af-ec9a-479c-b8a8-ee458f233da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:36.942061 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096a03e-fae7-42ca-81da-b7c4c85d0317 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:36.942356 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096a03e-fae7-42ca-81da-b7c4c85d0317 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:36.942638 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096a03e-fae7-42ca-81da-b7c4c85d0317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:36.991494 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-d096a03e-fae7-42ca-81da-b7c4c85d0317 None None] MFA Rules not processed for user `f370e353067848b5843c5650183be347`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:36.993283 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-d096a03e-fae7-42ca-81da-b7c4c85d0317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:37.030898 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 837/1674] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:17:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:17:37.032506 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1b550c-c468-46e8-abf2-749b17fd7070 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:37.036325 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1b550c-c468-46e8-abf2-749b17fd7070 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:37.036599 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1b550c-c468-46e8-abf2-749b17fd7070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:37.114906 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-8b1b550c-c468-46e8-abf2-749b17fd7070 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:37.117524 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-8b1b550c-c468-46e8-abf2-749b17fd7070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:37.155462 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 838/1675] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:17:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:17:37.156451 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1b550c-c468-46e8-abf2-749b17fd7070 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:37.211959 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1b550c-c468-46e8-abf2-749b17fd7070 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:37.233233 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d3e92-2d9b-42a8-97e4-5cc3c907c463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:37.233941 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d3e92-2d9b-42a8-97e4-5cc3c907c463 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:37.234217 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d3e92-2d9b-42a8-97e4-5cc3c907c463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:37.237440 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d3e92-2d9b-42a8-97e4-5cc3c907c463 admin admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:37.238270 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3d3e92-2d9b-42a8-97e4-5cc3c907c463 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:17:37.238578 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3d3e92-2d9b-42a8-97e4-5cc3c907c463 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:37.252824 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3d3e92-2d9b-42a8-97e4-5cc3c907c463 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:37.267341 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 838/1676] 10.222.0.65 () {58 vars in 1009 bytes} [Tue May 17 18:17:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:17:37.298147 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d096a03e-fae7-42ca-81da-b7c4c85d0317 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:37.298547 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 839/1677] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 17 18:17:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:17:37.350322 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d096a03e-fae7-42ca-81da-b7c4c85d0317 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:37.366149 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c89c31-dd99-4d35-95e8-dea040be2112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:37.367095 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c89c31-dd99-4d35-95e8-dea040be2112 admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:37.367512 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c89c31-dd99-4d35-95e8-dea040be2112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:37.367943 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c89c31-dd99-4d35-95e8-dea040be2112 admin admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:37.368770 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c89c31-dd99-4d35-95e8-dea040be2112 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:37.377579 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c89c31-dd99-4d35-95e8-dea040be2112 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:37.436768 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 839/1678] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:17:37 2022] POST /identity/v3/projects => generated 367 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:17:37.440944 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d3e92-2d9b-42a8-97e4-5cc3c907c463 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:37.455375 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d3e92-2d9b-42a8-97e4-5cc3c907c463 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:37.592668 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d5eebe-cf0e-4553-b831-2fec7ffc858e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:37.593645 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5eebe-cf0e-4553-b831-2fec7ffc858e admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:37.594073 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5eebe-cf0e-4553-b831-2fec7ffc858e admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:37.594655 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5eebe-cf0e-4553-b831-2fec7ffc858e admin admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:37.595521 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d5eebe-cf0e-4553-b831-2fec7ffc858e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:37.600904 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d5eebe-cf0e-4553-b831-2fec7ffc858e admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:37.670043 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c89c31-dd99-4d35-95e8-dea040be2112 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:37.672429 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-31c89c31-dd99-4d35-95e8-dea040be2112 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:37.684815 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 840/1679] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:17:37 2022] POST /identity/v3/users => generated 284 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:17:37.688546 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d5eebe-cf0e-4553-b831-2fec7ffc858e admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:37.722952 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d5eebe-cf0e-4553-b831-2fec7ffc858e admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:37.757591 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7e965-7b08-4a61-b88d-1bbe77c7fba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:37.758550 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7e965-7b08-4a61-b88d-1bbe77c7fba7 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:37.759192 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7e965-7b08-4a61-b88d-1bbe77c7fba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:37.759610 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7e965-7b08-4a61-b88d-1bbe77c7fba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:37.761029 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f7e965-7b08-4a61-b88d-1bbe77c7fba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:37.763549 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f7e965-7b08-4a61-b88d-1bbe77c7fba7 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:37.790314 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 841/1680] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:17:37 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:17:37.806037 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7e965-7b08-4a61-b88d-1bbe77c7fba7 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:37.843284 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7e965-7b08-4a61-b88d-1bbe77c7fba7 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:37.864555 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e6ea1-3ce9-4dd6-8ec3-ff71d41a0a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:37.866512 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e6ea1-3ce9-4dd6-8ec3-ff71d41a0a64 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:37.867738 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e6ea1-3ce9-4dd6-8ec3-ff71d41a0a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:37.868410 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e6ea1-3ce9-4dd6-8ec3-ff71d41a0a64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:37.870810 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793e6ea1-3ce9-4dd6-8ec3-ff71d41a0a64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:37.878375 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793e6ea1-3ce9-4dd6-8ec3-ff71d41a0a64 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:37.915642 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 842/1681] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:17:37 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:17:37.921594 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e6ea1-3ce9-4dd6-8ec3-ff71d41a0a64 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:37.923364 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c89c31-dd99-4d35-95e8-dea040be2112 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:37.937600 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e215f1-7473-48b9-86cd-29a56a9a473d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1464e84a3a2d4321a98b98d398bc7be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:37.938511 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e215f1-7473-48b9-86cd-29a56a9a473d service swift] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:37.938926 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e215f1-7473-48b9-86cd-29a56a9a473d service swift] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:37.939361 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e215f1-7473-48b9-86cd-29a56a9a473d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:37.944230 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e6ea1-3ce9-4dd6-8ec3-ff71d41a0a64 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:37.956386 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffcf033-3cf6-4c17-bcb3-e48142b10edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:37.957300 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffcf033-3cf6-4c17-bcb3-e48142b10edc admin admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:37.958698 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffcf033-3cf6-4c17-bcb3-e48142b10edc admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:37.959185 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffcf033-3cf6-4c17-bcb3-e48142b10edc admin admin] PATH_INFO: `/v3/projects/8ee052d8909048e99f3fe5da586cc06d/users/9a9d5122517b48669144298be241c62a/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:38.000067 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffcf033-3cf6-4c17-bcb3-e48142b10edc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ee052d8909048e99f3fe5da586cc06d, user_id=9a9d5122517b48669144298be241c62a, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:38.005615 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffcf033-3cf6-4c17-bcb3-e48142b10edc admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:38.041114 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 843/1682] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:17:37 2022] PUT /identity/v3/projects/8ee052d8909048e99f3fe5da586cc06d/users/9a9d5122517b48669144298be241c62a/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:17:38.051349 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e41e26-b774-4057-8892-4813ad5f747b None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:38.051804 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e41e26-b774-4057-8892-4813ad5f747b None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:38.052106 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e41e26-b774-4057-8892-4813ad5f747b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:38.100928 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e215f1-7473-48b9-86cd-29a56a9a473d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:38.102786 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e215f1-7473-48b9-86cd-29a56a9a473d service swift] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:38.103067 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-22e41e26-b774-4057-8892-4813ad5f747b None None] MFA Rules not processed for user `9a9d5122517b48669144298be241c62a`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:38.104332 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-22e41e26-b774-4057-8892-4813ad5f747b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:38.121712 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 840/1683] 10.222.0.65 () {60 vars in 1384 bytes} [Tue May 17 18:17:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 18:17:38.307163 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 844/1684] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:17:38 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:17:38.312990 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e215f1-7473-48b9-86cd-29a56a9a473d service swift] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:38.327952 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e215f1-7473-48b9-86cd-29a56a9a473d service swift] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:38.535205 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50d024-35a4-480b-8627-7392b04a5d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:38.536303 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50d024-35a4-480b-8627-7392b04a5d38 admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:38.536722 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50d024-35a4-480b-8627-7392b04a5d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:38.537129 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50d024-35a4-480b-8627-7392b04a5d38 admin admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:38.538064 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e50d024-35a4-480b-8627-7392b04a5d38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:38.545565 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e50d024-35a4-480b-8627-7392b04a5d38 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:38.625267 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 841/1685] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:17:38 2022] POST /identity/v3/projects => generated 365 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:17:38.626390 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e41e26-b774-4057-8892-4813ad5f747b None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:38.652001 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e41e26-b774-4057-8892-4813ad5f747b None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:38.796946 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a6e31-8246-4a50-9af0-174b091b1343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:38.798358 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a6e31-8246-4a50-9af0-174b091b1343 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:38.798797 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a6e31-8246-4a50-9af0-174b091b1343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:38.799255 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a6e31-8246-4a50-9af0-174b091b1343 admin admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:38.800117 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524a6e31-8246-4a50-9af0-174b091b1343 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:38.810340 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524a6e31-8246-4a50-9af0-174b091b1343 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:38.855464 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 845/1686] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:17:38 2022] POST /identity/v3/users => generated 289 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:17:38.859712 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50d024-35a4-480b-8627-7392b04a5d38 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:38.882064 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50d024-35a4-480b-8627-7392b04a5d38 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:38.895913 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b764a6bf-32bd-4f7c-8f51-acd6b3c7cb97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:38.897731 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764a6bf-32bd-4f7c-8f51-acd6b3c7cb97 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:38.900030 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764a6bf-32bd-4f7c-8f51-acd6b3c7cb97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:38.900350 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764a6bf-32bd-4f7c-8f51-acd6b3c7cb97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:38.901110 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b764a6bf-32bd-4f7c-8f51-acd6b3c7cb97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:38.915407 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b764a6bf-32bd-4f7c-8f51-acd6b3c7cb97 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:38.949804 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 842/1687] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:17:38.954893 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a6e31-8246-4a50-9af0-174b091b1343 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:38.965010 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a6e31-8246-4a50-9af0-174b091b1343 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:38.982205 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22827fd2-4d1d-4e02-bb0a-564a6609ef61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:38.983104 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22827fd2-4d1d-4e02-bb0a-564a6609ef61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:38.983539 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22827fd2-4d1d-4e02-bb0a-564a6609ef61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:38.983950 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22827fd2-4d1d-4e02-bb0a-564a6609ef61 admin admin] PATH_INFO: `/v3/projects/04144520c06a44cf8e4890ae29dfc50f/users/d10b8faea02c408ea6bb6a7acf82429b/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:39.027498 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22827fd2-4d1d-4e02-bb0a-564a6609ef61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04144520c06a44cf8e4890ae29dfc50f, user_id=d10b8faea02c408ea6bb6a7acf82429b, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:39.032082 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22827fd2-4d1d-4e02-bb0a-564a6609ef61 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:39.069981 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b764a6bf-32bd-4f7c-8f51-acd6b3c7cb97 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:39.070588 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 846/1688] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:17:38 2022] PUT /identity/v3/projects/04144520c06a44cf8e4890ae29dfc50f/users/d10b8faea02c408ea6bb6a7acf82429b/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:17:39.084317 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b764a6bf-32bd-4f7c-8f51-acd6b3c7cb97 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:39.272911 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f46ce-6295-4046-915b-38a554366643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:39.277182 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f46ce-6295-4046-915b-38a554366643 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:39.279374 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f46ce-6295-4046-915b-38a554366643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:39.281908 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f46ce-6295-4046-915b-38a554366643 admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:39.282886 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7f46ce-6295-4046-915b-38a554366643 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:39.292550 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7f46ce-6295-4046-915b-38a554366643 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:39.337519 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22827fd2-4d1d-4e02-bb0a-564a6609ef61 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:39.339885 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 843/1689] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:17:39.363542 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22827fd2-4d1d-4e02-bb0a-564a6609ef61 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:39.388784 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c31d8-a791-4bbc-884d-d0227d244c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:39.393353 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c31d8-a791-4bbc-884d-d0227d244c0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:39.395415 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c31d8-a791-4bbc-884d-d0227d244c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:39.397573 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c31d8-a791-4bbc-884d-d0227d244c0f admin admin] PATH_INFO: `/v3/projects/04144520c06a44cf8e4890ae29dfc50f/users/d10b8faea02c408ea6bb6a7acf82429b/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:39.418589 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87c31d8-a791-4bbc-884d-d0227d244c0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=04144520c06a44cf8e4890ae29dfc50f, user_id=d10b8faea02c408ea6bb6a7acf82429b, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:39.428870 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87c31d8-a791-4bbc-884d-d0227d244c0f admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:39.481105 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 847/1690] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:17:39 2022] PUT /identity/v3/projects/04144520c06a44cf8e4890ae29dfc50f/users/d10b8faea02c408ea6bb6a7acf82429b/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:17:39.496524 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce0e98-1e77-47d6-9769-d4edb5207775 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:39.496814 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce0e98-1e77-47d6-9769-d4edb5207775 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:39.497093 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce0e98-1e77-47d6-9769-d4edb5207775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:39.598957 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-3fce0e98-1e77-47d6-9769-d4edb5207775 None None] MFA Rules not processed for user `d10b8faea02c408ea6bb6a7acf82429b`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:39.603570 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-3fce0e98-1e77-47d6-9769-d4edb5207775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:39.894306 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 844/1691] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:17:39 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:17:39.911356 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c31d8-a791-4bbc-884d-d0227d244c0f admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:39.914157 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-d87c31d8-a791-4bbc-884d-d0227d244c0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:40.095352 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c31d8-a791-4bbc-884d-d0227d244c0f admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:40.106879 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ad1b3e-a4fb-4d2d-9d56-7c29e42601be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:40.107683 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad1b3e-a4fb-4d2d-9d56-7c29e42601be service cinder] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:40.111966 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad1b3e-a4fb-4d2d-9d56-7c29e42601be service cinder] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:40.112541 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad1b3e-a4fb-4d2d-9d56-7c29e42601be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:40.136687 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ad1b3e-a4fb-4d2d-9d56-7c29e42601be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:40.139349 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ad1b3e-a4fb-4d2d-9d56-7c29e42601be service cinder] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:40.171040 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 848/1692] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:17:39 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:17:40.359782 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce0e98-1e77-47d6-9769-d4edb5207775 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:40.377720 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce0e98-1e77-47d6-9769-d4edb5207775 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:40.388177 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b1848-7661-475e-bc8a-81d06f64ab2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:40.388858 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b1848-7661-475e-bc8a-81d06f64ab2b service cinder] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:40.390917 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b1848-7661-475e-bc8a-81d06f64ab2b service cinder] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:40.391894 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b1848-7661-475e-bc8a-81d06f64ab2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:40.552500 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b1848-7661-475e-bc8a-81d06f64ab2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:40.554223 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b1848-7661-475e-bc8a-81d06f64ab2b service cinder] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:40.601296 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 845/1693] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:17:40 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:17:44.036990 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7ae3a-8f3c-4a5c-9faa-6c3f2aea1ff6 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:44.037508 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7ae3a-8f3c-4a5c-9faa-6c3f2aea1ff6 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:44.037508 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd7ae3a-8f3c-4a5c-9faa-6c3f2aea1ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:44.107155 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b8987-e08b-430d-a333-c3e6d41691e6 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:44.107758 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b8987-e08b-430d-a333-c3e6d41691e6 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:44.107758 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b8987-e08b-430d-a333-c3e6d41691e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:44.171782 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-cdd7ae3a-8f3c-4a5c-9faa-6c3f2aea1ff6 None None] MFA Rules not processed for user `13b4ec46d3cb49faba3f063dcfd644c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:44.173033 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-cdd7ae3a-8f3c-4a5c-9faa-6c3f2aea1ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:44.181199 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-d59b8987-e08b-430d-a333-c3e6d41691e6 None None] MFA Rules not processed for user `356af648841c44eeab0bd9c7f78f600a`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:44.184809 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-d59b8987-e08b-430d-a333-c3e6d41691e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:44.347167 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 846/1694] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:17:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:17:44.375001 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 849/1695] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:17:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:17:44.390947 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b8987-e08b-430d-a333-c3e6d41691e6 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:44.392645 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-d59b8987-e08b-430d-a333-c3e6d41691e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:44.436902 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd7ae3a-8f3c-4a5c-9faa-6c3f2aea1ff6 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:44.438866 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-cdd7ae3a-8f3c-4a5c-9faa-6c3f2aea1ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:44.572480 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b8987-e08b-430d-a333-c3e6d41691e6 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:44.583079 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d9dd61-f347-436a-a9ea-06e626e79404 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b430b739cb54fc7911bc89f8ea2df72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:44.585073 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9dd61-f347-436a-a9ea-06e626e79404 service nova] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:44.585728 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9dd61-f347-436a-a9ea-06e626e79404 service nova] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:44.586349 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9dd61-f347-436a-a9ea-06e626e79404 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:44.610531 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d9dd61-f347-436a-a9ea-06e626e79404 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:44.615571 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d9dd61-f347-436a-a9ea-06e626e79404 service nova] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:44.627096 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 847/1696] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:17:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:17:44.655089 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd7ae3a-8f3c-4a5c-9faa-6c3f2aea1ff6 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:44.667638 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a895a4c-2540-4a63-9f33-4d7f2dc9ee0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b430b739cb54fc7911bc89f8ea2df72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:44.668308 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a895a4c-2540-4a63-9f33-4d7f2dc9ee0b service nova] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:44.668587 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a895a4c-2540-4a63-9f33-4d7f2dc9ee0b service nova] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:44.668880 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a895a4c-2540-4a63-9f33-4d7f2dc9ee0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:44.694366 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a895a4c-2540-4a63-9f33-4d7f2dc9ee0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:44.697350 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a895a4c-2540-4a63-9f33-4d7f2dc9ee0b service nova] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:44.734139 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 850/1697] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:17:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:17:46.584544 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27e22e-fa4d-424d-98a1-e8bd441431c9 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:46.585625 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27e22e-fa4d-424d-98a1-e8bd441431c9 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:46.586057 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27e22e-fa4d-424d-98a1-e8bd441431c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:46.678612 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-7e27e22e-fa4d-424d-98a1-e8bd441431c9 None None] MFA Rules not processed for user `43620937739e45d3bb7849f98d0e6cce`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:46.679861 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-7e27e22e-fa4d-424d-98a1-e8bd441431c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:46.924539 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 848/1698] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:17:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:17:46.940537 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a895a4c-2540-4a63-9f33-4d7f2dc9ee0b service nova] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:46.960475 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a895a4c-2540-4a63-9f33-4d7f2dc9ee0b service nova] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:46.973309 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95fafd0-7247-4cbe-8cf1-cea5bc403b01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b430b739cb54fc7911bc89f8ea2df72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:46.974246 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fafd0-7247-4cbe-8cf1-cea5bc403b01 service nova] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:46.976455 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fafd0-7247-4cbe-8cf1-cea5bc403b01 service nova] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:46.977004 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95fafd0-7247-4cbe-8cf1-cea5bc403b01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:47.006952 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95fafd0-7247-4cbe-8cf1-cea5bc403b01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:47.015045 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95fafd0-7247-4cbe-8cf1-cea5bc403b01 service nova] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:47.061860 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 851/1699] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:17:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:17:47.294988 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4afea-1e71-4ec1-b3fa-de984d012f55 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:47.295279 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4afea-1e71-4ec1-b3fa-de984d012f55 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:47.295569 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4afea-1e71-4ec1-b3fa-de984d012f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:47.357119 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-82e4afea-1e71-4ec1-b3fa-de984d012f55 None None] MFA Rules not processed for user `83430939ae474ad6bab37dfb6fc8da78`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:47.369151 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-82e4afea-1e71-4ec1-b3fa-de984d012f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:47.570688 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 849/1700] 10.222.0.59 () {58 vars in 1015 bytes} [Tue May 17 18:17:47 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:17:47.824427 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95fafd0-7247-4cbe-8cf1-cea5bc403b01 service nova] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:47.827008 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-f95fafd0-7247-4cbe-8cf1-cea5bc403b01 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:47.853708 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95fafd0-7247-4cbe-8cf1-cea5bc403b01 service nova] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:47.863479 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1138af2e-c5e7-4930-a43c-0ec2f0c68f91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:47.864080 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1138af2e-c5e7-4930-a43c-0ec2f0c68f91 service neutron] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:47.864360 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1138af2e-c5e7-4930-a43c-0ec2f0c68f91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:47.864637 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1138af2e-c5e7-4930-a43c-0ec2f0c68f91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:47.884342 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1138af2e-c5e7-4930-a43c-0ec2f0c68f91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:47.889411 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1138af2e-c5e7-4930-a43c-0ec2f0c68f91 service neutron] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:47.915612 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 852/1701] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:17:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:17:48.331382 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4afea-1e71-4ec1-b3fa-de984d012f55 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:48.333124 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-82e4afea-1e71-4ec1-b3fa-de984d012f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:48.598348 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4afea-1e71-4ec1-b3fa-de984d012f55 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:48.615672 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8120a786-c5d2-4097-918a-cc071fb49116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:48.624926 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120a786-c5d2-4097-918a-cc071fb49116 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:48.625250 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120a786-c5d2-4097-918a-cc071fb49116 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:48.625585 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8120a786-c5d2-4097-918a-cc071fb49116 admin admin] PATH_INFO: `/v3/users/0f1db2b9cd974e268fd8be67814d5373` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:48.637269 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8120a786-c5d2-4097-918a-cc071fb49116 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f1db2b9cd974e268fd8be67814d5373)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:48.641688 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: WARNING py.warnings [None req-8120a786-c5d2-4097-918a-cc071fb49116 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 18:17:48.641688 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: warnings.warn(msg) May 17 18:17:48.641688 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: May 17 18:17:48.645143 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8120a786-c5d2-4097-918a-cc071fb49116 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:48.924744 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-8120a786-c5d2-4097-918a-cc071fb49116 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f1db2b9cd974e268fd8be67814d5373'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:48.968332 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-8120a786-c5d2-4097-918a-cc071fb49116 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f1db2b9cd974e268fd8be67814d5373'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:48.971031 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-8120a786-c5d2-4097-918a-cc071fb49116 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f1db2b9cd974e268fd8be67814d5373'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:48.988244 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-8120a786-c5d2-4097-918a-cc071fb49116 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f1db2b9cd974e268fd8be67814d5373'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:48.989106 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-8120a786-c5d2-4097-918a-cc071fb49116 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f1db2b9cd974e268fd8be67814d5373'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:49.056129 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 850/1702] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:17:48 2022] DELETE /identity/v3/users/0f1db2b9cd974e268fd8be67814d5373 => generated 0 bytes in 725 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:17:49.062626 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec88a1a6-b58c-4ec8-b56c-fe67c460e200 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:49.063033 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec88a1a6-b58c-4ec8-b56c-fe67c460e200 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:49.063143 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec88a1a6-b58c-4ec8-b56c-fe67c460e200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:49.130441 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-ec88a1a6-b58c-4ec8-b56c-fe67c460e200 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:49.133300 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-ec88a1a6-b58c-4ec8-b56c-fe67c460e200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:49.285842 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 853/1703] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:17:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:17:49.370025 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8120a786-c5d2-4097-918a-cc071fb49116 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:49.371573 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-8120a786-c5d2-4097-918a-cc071fb49116 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:49.615151 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8120a786-c5d2-4097-918a-cc071fb49116 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:49.628257 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09af135-993a-455b-8913-d22544233547 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:49.629298 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09af135-993a-455b-8913-d22544233547 service neutron] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:49.629825 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09af135-993a-455b-8913-d22544233547 service neutron] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:49.630546 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09af135-993a-455b-8913-d22544233547 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:49.654871 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09af135-993a-455b-8913-d22544233547 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:49.656639 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09af135-993a-455b-8913-d22544233547 service neutron] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:49.707322 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 851/1704] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:17:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:17:51.375910 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274162c-4d8c-4bd7-b239-90a6ad3aabee None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:51.376797 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274162c-4d8c-4bd7-b239-90a6ad3aabee None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:51.377254 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7274162c-4d8c-4bd7-b239-90a6ad3aabee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:51.446632 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-7274162c-4d8c-4bd7-b239-90a6ad3aabee None None] MFA Rules not processed for user `5e6f035cadd24a59803eec21c7b9e2c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:51.450797 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-7274162c-4d8c-4bd7-b239-90a6ad3aabee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:51.655279 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 854/1705] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:17:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:17:51.667723 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c32c3f-0362-4864-9a98-abb8309b368c None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:51.668292 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c32c3f-0362-4864-9a98-abb8309b368c None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:51.668677 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c32c3f-0362-4864-9a98-abb8309b368c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:51.719262 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-86c32c3f-0362-4864-9a98-abb8309b368c None None] MFA Rules not processed for user `5e6f035cadd24a59803eec21c7b9e2c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:51.726200 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-86c32c3f-0362-4864-9a98-abb8309b368c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:51.738222 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 852/1706] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:17:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:17:51.753798 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7274162c-4d8c-4bd7-b239-90a6ad3aabee None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:51.755636 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-7274162c-4d8c-4bd7-b239-90a6ad3aabee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:52.046111 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7274162c-4d8c-4bd7-b239-90a6ad3aabee None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:52.058093 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9fd883-1a6d-4961-9a13-3503ef0f5984 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b430b739cb54fc7911bc89f8ea2df72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:52.059280 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fd883-1a6d-4961-9a13-3503ef0f5984 service nova] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:52.059559 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fd883-1a6d-4961-9a13-3503ef0f5984 service nova] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:52.059845 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fd883-1a6d-4961-9a13-3503ef0f5984 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:52.071736 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9fd883-1a6d-4961-9a13-3503ef0f5984 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:52.074581 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9fd883-1a6d-4961-9a13-3503ef0f5984 service nova] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:52.088783 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 855/1707] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:17:51 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:17:52.137433 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c488a5e-97d9-42d9-ad82-6def3fbb6cba None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:52.137972 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c488a5e-97d9-42d9-ad82-6def3fbb6cba None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:52.138569 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c488a5e-97d9-42d9-ad82-6def3fbb6cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:52.207971 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-2c488a5e-97d9-42d9-ad82-6def3fbb6cba None None] MFA Rules not processed for user `13b4ec46d3cb49faba3f063dcfd644c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:52.211779 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-2c488a5e-97d9-42d9-ad82-6def3fbb6cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:52.295118 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e5d41-768d-4012-994a-59f3f8d6b421 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:52.295459 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e5d41-768d-4012-994a-59f3f8d6b421 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:52.295766 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e5d41-768d-4012-994a-59f3f8d6b421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:52.316649 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-8e8e5d41-768d-4012-994a-59f3f8d6b421 None None] MFA Rules not processed for user `356af648841c44eeab0bd9c7f78f600a`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:52.318493 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-8e8e5d41-768d-4012-994a-59f3f8d6b421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:52.551539 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 853/1708] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:17:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:17:52.558088 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 856/1709] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:17:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:17:53.190571 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c488a5e-97d9-42d9-ad82-6def3fbb6cba None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:53.194521 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-2c488a5e-97d9-42d9-ad82-6def3fbb6cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:53.241763 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73bc3a-9ff2-41cd-a318-79c555118628 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:53.245243 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73bc3a-9ff2-41cd-a318-79c555118628 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:53.245243 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73bc3a-9ff2-41cd-a318-79c555118628 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:53.245896 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 857/1710] 10.222.0.65 () {54 vars in 921 bytes} [Tue May 17 18:17:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:17:53.265828 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c488a5e-97d9-42d9-ad82-6def3fbb6cba None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:53.284498 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f1b6a-8761-4aa9-afc7-e35072ad205f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:53.285384 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f1b6a-8761-4aa9-afc7-e35072ad205f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:53.285688 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f1b6a-8761-4aa9-afc7-e35072ad205f admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:53.285963 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f1b6a-8761-4aa9-afc7-e35072ad205f admin admin] PATH_INFO: `/v3/projects/62a2bceca9214b5f8b057df5e3b6e2c7` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:53.292576 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57f1b6a-8761-4aa9-afc7-e35072ad205f admin admin] RBAC: Authorizing `identity:delete_project(project_id=62a2bceca9214b5f8b057df5e3b6e2c7)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:53.294584 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57f1b6a-8761-4aa9-afc7-e35072ad205f admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:53.326954 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c81c0c-589b-42ea-bd60-e2ff489ff000 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:53.327386 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c81c0c-589b-42ea-bd60-e2ff489ff000 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:53.327772 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c81c0c-589b-42ea-bd60-e2ff489ff000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:53.386778 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-50c81c0c-589b-42ea-bd60-e2ff489ff000 None None] MFA Rules not processed for user `5b430b739cb54fc7911bc89f8ea2df72`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:53.394786 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-50c81c0c-589b-42ea-bd60-e2ff489ff000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:53.437182 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 858/1711] 10.222.0.65 () {58 vars in 1018 bytes} [Tue May 17 18:17:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:17:53.439470 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716bb9c-45c7-4bc8-aa54-b5e367cbc062 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:53.446447 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716bb9c-45c7-4bc8-aa54-b5e367cbc062 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:53.448198 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716bb9c-45c7-4bc8-aa54-b5e367cbc062 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:53.456519 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 859/1712] 10.222.0.65 () {54 vars in 912 bytes} [Tue May 17 18:17:53 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:17:53.458344 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316c2b7-bd07-4e08-b697-954fbc594f52 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:53.461901 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316c2b7-bd07-4e08-b697-954fbc594f52 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:53.462492 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316c2b7-bd07-4e08-b697-954fbc594f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:53.494028 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-d57f1b6a-8761-4aa9-afc7-e35072ad205f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62a2bceca9214b5f8b057df5e3b6e2c7', 'request_id': 'req-d57f1b6a-8761-4aa9-afc7-e35072ad205f'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:53.512308 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-6316c2b7-bd07-4e08-b697-954fbc594f52 None None] MFA Rules not processed for user `83430939ae474ad6bab37dfb6fc8da78`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:53.517035 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-d57f1b6a-8761-4aa9-afc7-e35072ad205f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62a2bceca9214b5f8b057df5e3b6e2c7', 'request_id': 'req-d57f1b6a-8761-4aa9-afc7-e35072ad205f'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:53.517449 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-6316c2b7-bd07-4e08-b697-954fbc594f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:53.537412 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-d57f1b6a-8761-4aa9-afc7-e35072ad205f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62a2bceca9214b5f8b057df5e3b6e2c7', 'request_id': 'req-d57f1b6a-8761-4aa9-afc7-e35072ad205f'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:53.612917 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-d57f1b6a-8761-4aa9-afc7-e35072ad205f admin admin] The token cache is being invalidate because project 62a2bceca9214b5f8b057df5e3b6e2c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:17:53.613373 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-d57f1b6a-8761-4aa9-afc7-e35072ad205f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:53.620065 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-d57f1b6a-8761-4aa9-afc7-e35072ad205f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:53.631037 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 854/1713] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:17:53 2022] DELETE /identity/v3/projects/62a2bceca9214b5f8b057df5e3b6e2c7 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:17:53.632902 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdedf86-d8b1-4367-a907-e980dad5ac28 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:53.633648 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdedf86-d8b1-4367-a907-e980dad5ac28 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:53.634926 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdedf86-d8b1-4367-a907-e980dad5ac28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:53.680727 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-5cdedf86-d8b1-4367-a907-e980dad5ac28 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:53.683036 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-5cdedf86-d8b1-4367-a907-e980dad5ac28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:53.710546 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 860/1714] 10.222.0.65 () {58 vars in 1009 bytes} [Tue May 17 18:17:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:17:53.730122 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316c2b7-bd07-4e08-b697-954fbc594f52 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:53.735572 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-6316c2b7-bd07-4e08-b697-954fbc594f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:53.761327 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316c2b7-bd07-4e08-b697-954fbc594f52 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:53.778979 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0373a3-9d24-4420-9eab-13251a7ed11c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:53.780124 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0373a3-9d24-4420-9eab-13251a7ed11c service neutron] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:53.780620 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0373a3-9d24-4420-9eab-13251a7ed11c service neutron] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:53.781130 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0373a3-9d24-4420-9eab-13251a7ed11c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:53.808694 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0373a3-9d24-4420-9eab-13251a7ed11c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:53.814423 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0373a3-9d24-4420-9eab-13251a7ed11c service neutron] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:53.833876 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 861/1715] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:17:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:17:54.179484 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0373a3-9d24-4420-9eab-13251a7ed11c service neutron] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:54.182823 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-dc0373a3-9d24-4420-9eab-13251a7ed11c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:54.230123 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 855/1716] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:17:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 598 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:17:54.240990 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dabaf4-2a90-41c1-9452-43fe5d633154 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:54.242128 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dabaf4-2a90-41c1-9452-43fe5d633154 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:54.243990 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dabaf4-2a90-41c1-9452-43fe5d633154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:54.279121 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-f0dabaf4-2a90-41c1-9452-43fe5d633154 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:54.282795 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-f0dabaf4-2a90-41c1-9452-43fe5d633154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:54.299406 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 856/1717] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:17:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:17:54.303526 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dabaf4-2a90-41c1-9452-43fe5d633154 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:54.304144 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0373a3-9d24-4420-9eab-13251a7ed11c service neutron] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:54.311174 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a597a1e-e21b-4087-a6f7-0dccdb55f350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:54.312225 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a597a1e-e21b-4087-a6f7-0dccdb55f350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:54.312512 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a597a1e-e21b-4087-a6f7-0dccdb55f350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:54.313048 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a597a1e-e21b-4087-a6f7-0dccdb55f350 admin admin] PATH_INFO: `/v3/users/9a9d5122517b48669144298be241c62a` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:54.314580 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a597a1e-e21b-4087-a6f7-0dccdb55f350 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a9d5122517b48669144298be241c62a)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:54.316642 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a597a1e-e21b-4087-a6f7-0dccdb55f350 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:54.335774 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dabaf4-2a90-41c1-9452-43fe5d633154 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:54.351509 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e8cd51-f826-4ebe-aeed-91386f122508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:54.352259 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8cd51-f826-4ebe-aeed-91386f122508 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:54.352787 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8cd51-f826-4ebe-aeed-91386f122508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:54.353513 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8cd51-f826-4ebe-aeed-91386f122508 admin admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:54.354203 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e8cd51-f826-4ebe-aeed-91386f122508 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:17:54.354627 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e8cd51-f826-4ebe-aeed-91386f122508 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:54.356500 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e8cd51-f826-4ebe-aeed-91386f122508 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:54.416579 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 857/1718] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 17 18:17:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:17:54.417803 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e8cd51-f826-4ebe-aeed-91386f122508 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:54.419032 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-5a597a1e-e21b-4087-a6f7-0dccdb55f350 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a9d5122517b48669144298be241c62a'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:54.443854 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e8cd51-f826-4ebe-aeed-91386f122508 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:54.444520 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-5a597a1e-e21b-4087-a6f7-0dccdb55f350 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a9d5122517b48669144298be241c62a'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:54.449788 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-5a597a1e-e21b-4087-a6f7-0dccdb55f350 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a9d5122517b48669144298be241c62a'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:54.450662 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-5a597a1e-e21b-4087-a6f7-0dccdb55f350 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a9d5122517b48669144298be241c62a'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:54.460238 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c51c1-b706-445b-bf16-13ed1ce27341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:54.462188 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c51c1-b706-445b-bf16-13ed1ce27341 admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:54.462355 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c51c1-b706-445b-bf16-13ed1ce27341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:54.462639 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c51c1-b706-445b-bf16-13ed1ce27341 admin admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:54.463893 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673c51c1-b706-445b-bf16-13ed1ce27341 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:54.472695 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673c51c1-b706-445b-bf16-13ed1ce27341 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:54.476134 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-5a597a1e-e21b-4087-a6f7-0dccdb55f350 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a9d5122517b48669144298be241c62a'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:54.517991 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 862/1719] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:17:54 2022] DELETE /identity/v3/users/9a9d5122517b48669144298be241c62a => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:17:54.522484 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1916d16-dd34-4f09-90d7-b540593b2566 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:54.522764 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1916d16-dd34-4f09-90d7-b540593b2566 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:54.525137 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1916d16-dd34-4f09-90d7-b540593b2566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:54.559326 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 858/1720] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:17:54 2022] POST /identity/v3/projects => generated 363 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:17:54.566616 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c51c1-b706-445b-bf16-13ed1ce27341 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:54.569379 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-673c51c1-b706-445b-bf16-13ed1ce27341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:54.595023 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-c1916d16-dd34-4f09-90d7-b540593b2566 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:54.597396 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-c1916d16-dd34-4f09-90d7-b540593b2566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:54.736404 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c51c1-b706-445b-bf16-13ed1ce27341 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:54.753828 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 863/1721] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:17:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:17:54.761005 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ad872-8dc8-4061-96fe-523301344830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:54.762048 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ad872-8dc8-4061-96fe-523301344830 admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:54.762546 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ad872-8dc8-4061-96fe-523301344830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:54.763013 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ad872-8dc8-4061-96fe-523301344830 admin admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:54.763933 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ad872-8dc8-4061-96fe-523301344830 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:54.766147 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ad872-8dc8-4061-96fe-523301344830 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:54.794941 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 859/1722] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:17:54 2022] POST /identity/v3/users => generated 282 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:17:54.797422 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1916d16-dd34-4f09-90d7-b540593b2566 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:54.809662 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1916d16-dd34-4f09-90d7-b540593b2566 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:54.816710 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5197bf64-c28e-4b95-9ad0-465449d8e310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:54.817623 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197bf64-c28e-4b95-9ad0-465449d8e310 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:54.818269 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197bf64-c28e-4b95-9ad0-465449d8e310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:54.818627 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197bf64-c28e-4b95-9ad0-465449d8e310 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:54.819887 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5197bf64-c28e-4b95-9ad0-465449d8e310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:54.821085 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ad872-8dc8-4061-96fe-523301344830 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:54.821995 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5197bf64-c28e-4b95-9ad0-465449d8e310 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:54.824295 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-af5ad872-8dc8-4061-96fe-523301344830 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:54.850037 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 864/1723] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:17:54.851800 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5197bf64-c28e-4b95-9ad0-465449d8e310 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:54.877152 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5197bf64-c28e-4b95-9ad0-465449d8e310 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:54.910963 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bd4d89-0440-4be9-a725-9bcd0f78d316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:54.915877 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd4d89-0440-4be9-a725-9bcd0f78d316 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:54.917191 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd4d89-0440-4be9-a725-9bcd0f78d316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:54.917722 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd4d89-0440-4be9-a725-9bcd0f78d316 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:54.928122 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bd4d89-0440-4be9-a725-9bcd0f78d316 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:54.930152 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bd4d89-0440-4be9-a725-9bcd0f78d316 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:54.991387 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 865/1724] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:17:54.992565 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bd4d89-0440-4be9-a725-9bcd0f78d316 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:55.007873 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ad872-8dc8-4061-96fe-523301344830 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:55.019581 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5638f8-9ada-4027-be2b-072017ebbf02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:55.020265 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5638f8-9ada-4027-be2b-072017ebbf02 service neutron] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:55.020547 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5638f8-9ada-4027-be2b-072017ebbf02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:55.024416 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5638f8-9ada-4027-be2b-072017ebbf02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:55.038586 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bd4d89-0440-4be9-a725-9bcd0f78d316 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:55.049529 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5638f8-9ada-4027-be2b-072017ebbf02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:55.052519 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bedfe2-1870-4876-954a-e2a6e73b473a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:55.053741 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bedfe2-1870-4876-954a-e2a6e73b473a admin admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:55.054279 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bedfe2-1870-4876-954a-e2a6e73b473a admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:55.054808 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bedfe2-1870-4876-954a-e2a6e73b473a admin admin] PATH_INFO: `/v3/projects/33e8ac774d944b59bac90b4f3bfa9776/users/6d7342781ad546ba920f69914396bf84/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:55.055004 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5638f8-9ada-4027-be2b-072017ebbf02 service neutron] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:55.089761 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bedfe2-1870-4876-954a-e2a6e73b473a admin admin] RBAC: Authorizing `identity:create_grant(project_id=33e8ac774d944b59bac90b4f3bfa9776, user_id=6d7342781ad546ba920f69914396bf84, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:55.090911 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 860/1725] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:17:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:17:55.097871 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bedfe2-1870-4876-954a-e2a6e73b473a admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:55.173790 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 866/1726] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:17:54 2022] PUT /identity/v3/projects/33e8ac774d944b59bac90b4f3bfa9776/users/6d7342781ad546ba920f69914396bf84/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:17:55.184616 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75120555-c7c4-420e-8312-7b7919e7c17c None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:55.184906 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75120555-c7c4-420e-8312-7b7919e7c17c None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:55.185186 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75120555-c7c4-420e-8312-7b7919e7c17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:55.277592 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-75120555-c7c4-420e-8312-7b7919e7c17c None None] MFA Rules not processed for user `6d7342781ad546ba920f69914396bf84`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:55.279946 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-75120555-c7c4-420e-8312-7b7919e7c17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:55.507689 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 861/1727] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:17:55 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:17:55.512722 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bedfe2-1870-4876-954a-e2a6e73b473a admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:55.608148 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75120555-c7c4-420e-8312-7b7919e7c17c None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:55.610170 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-75120555-c7c4-420e-8312-7b7919e7c17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:55.747410 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bedfe2-1870-4876-954a-e2a6e73b473a admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:55.762936 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f0453c-af74-4d1f-850c-a5f410e72ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:55.767624 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f0453c-af74-4d1f-850c-a5f410e72ec1 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:55.768209 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f0453c-af74-4d1f-850c-a5f410e72ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:55.768651 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f0453c-af74-4d1f-850c-a5f410e72ec1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:55.770135 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f0453c-af74-4d1f-850c-a5f410e72ec1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:55.779473 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f0453c-af74-4d1f-850c-a5f410e72ec1 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:55.820048 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75120555-c7c4-420e-8312-7b7919e7c17c None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:55.839172 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59487a79-a107-4123-94ff-6f96248aa15c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b430b739cb54fc7911bc89f8ea2df72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:55.839656 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59487a79-a107-4123-94ff-6f96248aa15c service nova] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:55.839946 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59487a79-a107-4123-94ff-6f96248aa15c service nova] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:55.840221 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59487a79-a107-4123-94ff-6f96248aa15c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:55.848104 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 867/1728] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:17:55 2022] POST /identity/v3/projects => generated 363 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:17:55.852990 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f0453c-af74-4d1f-850c-a5f410e72ec1 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:55.863429 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-59487a79-a107-4123-94ff-6f96248aa15c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:55.896368 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59487a79-a107-4123-94ff-6f96248aa15c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:55.897878 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59487a79-a107-4123-94ff-6f96248aa15c service nova] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:55.923912 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 862/1729] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:17:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:17:56.021746 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f0453c-af74-4d1f-850c-a5f410e72ec1 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:56.030006 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6df131-d36e-41f2-9036-d5dbd47ace4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:56.033933 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6df131-d36e-41f2-9036-d5dbd47ace4e admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:56.035047 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6df131-d36e-41f2-9036-d5dbd47ace4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:56.036044 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6df131-d36e-41f2-9036-d5dbd47ace4e admin admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:56.040513 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6df131-d36e-41f2-9036-d5dbd47ace4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:56.043098 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6df131-d36e-41f2-9036-d5dbd47ace4e admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:56.105853 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 868/1730] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:17:55 2022] POST /identity/v3/users => generated 288 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:17:56.110223 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59487a79-a107-4123-94ff-6f96248aa15c service nova] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:56.122283 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59487a79-a107-4123-94ff-6f96248aa15c service nova] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:56.132243 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e30bc87-70f9-4d10-a824-f67282101509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:56.139613 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e30bc87-70f9-4d10-a824-f67282101509 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:56.140087 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e30bc87-70f9-4d10-a824-f67282101509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:56.140544 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e30bc87-70f9-4d10-a824-f67282101509 admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:56.141679 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e30bc87-70f9-4d10-a824-f67282101509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:56.148858 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e30bc87-70f9-4d10-a824-f67282101509 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:56.172832 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 863/1731] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:17:56 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:17:56.174593 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6df131-d36e-41f2-9036-d5dbd47ace4e admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:56.191324 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6df131-d36e-41f2-9036-d5dbd47ace4e admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:56.201080 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572d4217-54f2-4299-a060-ad9dddadbc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:56.204844 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d4217-54f2-4299-a060-ad9dddadbc77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:56.205588 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d4217-54f2-4299-a060-ad9dddadbc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:56.207629 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572d4217-54f2-4299-a060-ad9dddadbc77 admin admin] PATH_INFO: `/v3/projects/49350e1e1548478a909162eac483aaa8/users/f93e81f0be7c4f5c8c9eac464c746a18/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:56.255598 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572d4217-54f2-4299-a060-ad9dddadbc77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49350e1e1548478a909162eac483aaa8, user_id=f93e81f0be7c4f5c8c9eac464c746a18, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:56.262408 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572d4217-54f2-4299-a060-ad9dddadbc77 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:56.294443 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 869/1732] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:17:56 2022] PUT /identity/v3/projects/49350e1e1548478a909162eac483aaa8/users/f93e81f0be7c4f5c8c9eac464c746a18/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:17:56.298360 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e30bc87-70f9-4d10-a824-f67282101509 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:56.315530 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e30bc87-70f9-4d10-a824-f67282101509 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:56.537982 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9de36c-a971-4ccd-9c07-27668ee3fcf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:56.540698 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9de36c-a971-4ccd-9c07-27668ee3fcf2 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:56.542790 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9de36c-a971-4ccd-9c07-27668ee3fcf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:56.543190 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9de36c-a971-4ccd-9c07-27668ee3fcf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:56.546115 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9de36c-a971-4ccd-9c07-27668ee3fcf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:56.553647 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9de36c-a971-4ccd-9c07-27668ee3fcf2 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:56.587351 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 864/1733] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:17:56 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:17:56.593839 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572d4217-54f2-4299-a060-ad9dddadbc77 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:56.614110 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572d4217-54f2-4299-a060-ad9dddadbc77 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:56.640523 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61560161-b40c-4e22-bb12-c505080916fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:56.643243 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61560161-b40c-4e22-bb12-c505080916fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:56.644390 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61560161-b40c-4e22-bb12-c505080916fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:56.645295 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61560161-b40c-4e22-bb12-c505080916fe admin admin] PATH_INFO: `/v3/projects/49350e1e1548478a909162eac483aaa8/users/f93e81f0be7c4f5c8c9eac464c746a18/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:56.651627 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61560161-b40c-4e22-bb12-c505080916fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=49350e1e1548478a909162eac483aaa8, user_id=f93e81f0be7c4f5c8c9eac464c746a18, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:56.658814 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61560161-b40c-4e22-bb12-c505080916fe admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:56.699589 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 870/1734] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:17:56 2022] PUT /identity/v3/projects/49350e1e1548478a909162eac483aaa8/users/f93e81f0be7c4f5c8c9eac464c746a18/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:17:56.702818 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1eff87-a1a1-4aa2-9d87-56ab5d7e2a62 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:56.703104 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1eff87-a1a1-4aa2-9d87-56ab5d7e2a62 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:56.703379 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1eff87-a1a1-4aa2-9d87-56ab5d7e2a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:56.807007 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-da1eff87-a1a1-4aa2-9d87-56ab5d7e2a62 None None] MFA Rules not processed for user `f93e81f0be7c4f5c8c9eac464c746a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:56.812190 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-da1eff87-a1a1-4aa2-9d87-56ab5d7e2a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:57.058095 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be165d-be73-4de5-bb61-6e2d7e5f34cb None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:57.058659 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be165d-be73-4de5-bb61-6e2d7e5f34cb None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:57.058812 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be165d-be73-4de5-bb61-6e2d7e5f34cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:57.082438 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 865/1735] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:17:56 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:17:57.101305 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1eff87-a1a1-4aa2-9d87-56ab5d7e2a62 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:57.117221 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-da1eff87-a1a1-4aa2-9d87-56ab5d7e2a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:57.151887 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-d2be165d-be73-4de5-bb61-6e2d7e5f34cb None None] MFA Rules not processed for user `5e6f035cadd24a59803eec21c7b9e2c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:57.157483 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-d2be165d-be73-4de5-bb61-6e2d7e5f34cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:57.287695 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1eff87-a1a1-4aa2-9d87-56ab5d7e2a62 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:57.294027 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55783e0-c76c-4bc3-9fd5-1b059a21e45f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:57.294849 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55783e0-c76c-4bc3-9fd5-1b059a21e45f service cinder] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:57.295132 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55783e0-c76c-4bc3-9fd5-1b059a21e45f service cinder] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:57.295407 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55783e0-c76c-4bc3-9fd5-1b059a21e45f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:57.311414 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55783e0-c76c-4bc3-9fd5-1b059a21e45f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:57.313448 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55783e0-c76c-4bc3-9fd5-1b059a21e45f service cinder] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:57.331643 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 871/1736] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:17:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:17:57.331643 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2be165d-be73-4de5-bb61-6e2d7e5f34cb None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:57.333542 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-d2be165d-be73-4de5-bb61-6e2d7e5f34cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:57.399632 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 866/1737] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:17:57 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:17:57.401983 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebeb14d-37e2-4047-8a32-c530fa1f6fc9 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:57.402270 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebeb14d-37e2-4047-8a32-c530fa1f6fc9 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:57.402543 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebeb14d-37e2-4047-8a32-c530fa1f6fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:57.421085 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-aebeb14d-37e2-4047-8a32-c530fa1f6fc9 None None] MFA Rules not processed for user `43620937739e45d3bb7849f98d0e6cce`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:57.422335 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-aebeb14d-37e2-4047-8a32-c530fa1f6fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:57.536728 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 867/1738] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:17:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:17:57.562107 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2be165d-be73-4de5-bb61-6e2d7e5f34cb None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:57.568004 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd744af8-091d-46d8-b4bd-52b9fb006434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:57.569012 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd744af8-091d-46d8-b4bd-52b9fb006434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:57.569592 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd744af8-091d-46d8-b4bd-52b9fb006434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:57.569998 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd744af8-091d-46d8-b4bd-52b9fb006434 admin admin] PATH_INFO: `/v3/projects/8ee052d8909048e99f3fe5da586cc06d` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:57.582434 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd744af8-091d-46d8-b4bd-52b9fb006434 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ee052d8909048e99f3fe5da586cc06d)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:57.583291 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebeb14d-37e2-4047-8a32-c530fa1f6fc9 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:57.584783 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd744af8-091d-46d8-b4bd-52b9fb006434 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:57.596860 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebeb14d-37e2-4047-8a32-c530fa1f6fc9 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:57.606944 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8ae345-dbb4-4354-a2ac-9d9c8c4de98f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:57.608857 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ae345-dbb4-4354-a2ac-9d9c8c4de98f service cinder] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:57.609062 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ae345-dbb4-4354-a2ac-9d9c8c4de98f service cinder] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:57.609350 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ae345-dbb4-4354-a2ac-9d9c8c4de98f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:57.712288 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-cd744af8-091d-46d8-b4bd-52b9fb006434 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ee052d8909048e99f3fe5da586cc06d', 'request_id': 'req-cd744af8-091d-46d8-b4bd-52b9fb006434'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:57.723181 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-cd744af8-091d-46d8-b4bd-52b9fb006434 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ee052d8909048e99f3fe5da586cc06d', 'request_id': 'req-cd744af8-091d-46d8-b4bd-52b9fb006434'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:57.733792 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-cd744af8-091d-46d8-b4bd-52b9fb006434 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ee052d8909048e99f3fe5da586cc06d', 'request_id': 'req-cd744af8-091d-46d8-b4bd-52b9fb006434'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:57.735558 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8ae345-dbb4-4354-a2ac-9d9c8c4de98f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:57.737110 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8ae345-dbb4-4354-a2ac-9d9c8c4de98f service cinder] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:57.749666 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 868/1739] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:17:57 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:17:57.763224 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-cd744af8-091d-46d8-b4bd-52b9fb006434 admin admin] The token cache is being invalidate because project 8ee052d8909048e99f3fe5da586cc06d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:17:57.763523 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-cd744af8-091d-46d8-b4bd-52b9fb006434 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:57.764976 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-cd744af8-091d-46d8-b4bd-52b9fb006434 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:57.768155 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 872/1740] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:17:57 2022] DELETE /identity/v3/projects/8ee052d8909048e99f3fe5da586cc06d => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:17:57.772682 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8ae345-dbb4-4354-a2ac-9d9c8c4de98f service cinder] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:57.789108 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8ae345-dbb4-4354-a2ac-9d9c8c4de98f service cinder] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:57.887241 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0da92d6-27df-44c4-a5da-c171eb9352a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:57.888280 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da92d6-27df-44c4-a5da-c171eb9352a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:57.888717 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da92d6-27df-44c4-a5da-c171eb9352a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:57.889311 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da92d6-27df-44c4-a5da-c171eb9352a3 admin admin] PATH_INFO: `/v3/users/d10b8faea02c408ea6bb6a7acf82429b` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:57.891035 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0da92d6-27df-44c4-a5da-c171eb9352a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d10b8faea02c408ea6bb6a7acf82429b)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:57.893173 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0da92d6-27df-44c4-a5da-c171eb9352a3 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:57.992414 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-a0da92d6-27df-44c4-a5da-c171eb9352a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd10b8faea02c408ea6bb6a7acf82429b'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:58.000096 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-a0da92d6-27df-44c4-a5da-c171eb9352a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd10b8faea02c408ea6bb6a7acf82429b'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:58.000982 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-a0da92d6-27df-44c4-a5da-c171eb9352a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd10b8faea02c408ea6bb6a7acf82429b'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:58.010433 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-a0da92d6-27df-44c4-a5da-c171eb9352a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd10b8faea02c408ea6bb6a7acf82429b'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:58.011216 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-a0da92d6-27df-44c4-a5da-c171eb9352a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd10b8faea02c408ea6bb6a7acf82429b'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:58.032382 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 869/1741] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:17:57 2022] DELETE /identity/v3/users/d10b8faea02c408ea6bb6a7acf82429b => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:17:58.535916 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd744af8-091d-46d8-b4bd-52b9fb006434 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:58.537325 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-cd744af8-091d-46d8-b4bd-52b9fb006434 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:58.567640 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd744af8-091d-46d8-b4bd-52b9fb006434 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:58.695626 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dafb4b-6975-4e55-8a03-233876466886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:58.696758 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dafb4b-6975-4e55-8a03-233876466886 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:58.697875 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dafb4b-6975-4e55-8a03-233876466886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:58.698311 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dafb4b-6975-4e55-8a03-233876466886 admin admin] PATH_INFO: `/v3/projects/04144520c06a44cf8e4890ae29dfc50f` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:58.703058 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dafb4b-6975-4e55-8a03-233876466886 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04144520c06a44cf8e4890ae29dfc50f)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:58.705608 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dafb4b-6975-4e55-8a03-233876466886 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:58.820135 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-a5dafb4b-6975-4e55-8a03-233876466886 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04144520c06a44cf8e4890ae29dfc50f', 'request_id': 'req-a5dafb4b-6975-4e55-8a03-233876466886'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:58.838678 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-a5dafb4b-6975-4e55-8a03-233876466886 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04144520c06a44cf8e4890ae29dfc50f', 'request_id': 'req-a5dafb4b-6975-4e55-8a03-233876466886'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:58.856377 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-a5dafb4b-6975-4e55-8a03-233876466886 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04144520c06a44cf8e4890ae29dfc50f', 'request_id': 'req-a5dafb4b-6975-4e55-8a03-233876466886'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:58.871530 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-a5dafb4b-6975-4e55-8a03-233876466886 admin admin] The token cache is being invalidate because project 04144520c06a44cf8e4890ae29dfc50f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:17:58.871834 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-a5dafb4b-6975-4e55-8a03-233876466886 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:58.872671 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-a5dafb4b-6975-4e55-8a03-233876466886 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:58.874661 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 873/1742] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:17:58 2022] DELETE /identity/v3/projects/04144520c06a44cf8e4890ae29dfc50f => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:17:58.879426 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b392d61-8c0b-48ea-8006-7110c5e0b93d None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:58.880476 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b392d61-8c0b-48ea-8006-7110c5e0b93d None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:58.880947 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b392d61-8c0b-48ea-8006-7110c5e0b93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:58.937054 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-3b392d61-8c0b-48ea-8006-7110c5e0b93d None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:58.939677 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-3b392d61-8c0b-48ea-8006-7110c5e0b93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:59.129498 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 870/1743] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:17:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:17:59.134737 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc5de4-c261-429c-9c66-856709312a9a None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:59.135162 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc5de4-c261-429c-9c66-856709312a9a None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:59.135575 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc5de4-c261-429c-9c66-856709312a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:59.165096 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-0acc5de4-c261-429c-9c66-856709312a9a None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:59.167601 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-0acc5de4-c261-429c-9c66-856709312a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:59.195571 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 874/1744] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:17:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:17:59.201424 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b392d61-8c0b-48ea-8006-7110c5e0b93d None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:59.220044 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b392d61-8c0b-48ea-8006-7110c5e0b93d None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:59.226375 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9aca2f-9021-4065-a490-98d67fc1ce98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:59.227786 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9aca2f-9021-4065-a490-98d67fc1ce98 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:59.228252 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9aca2f-9021-4065-a490-98d67fc1ce98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:59.229307 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9aca2f-9021-4065-a490-98d67fc1ce98 admin admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:59.230224 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9aca2f-9021-4065-a490-98d67fc1ce98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:17:59.230696 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9aca2f-9021-4065-a490-98d67fc1ce98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:59.235100 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9aca2f-9021-4065-a490-98d67fc1ce98 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:59.265825 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 871/1745] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 17 18:17:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:17:59.271153 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc5de4-c261-429c-9c66-856709312a9a None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:59.295939 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc5de4-c261-429c-9c66-856709312a9a None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:59.307581 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be50f28-5661-4adb-8517-a70108fd456d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:59.308915 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be50f28-5661-4adb-8517-a70108fd456d admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:59.309205 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be50f28-5661-4adb-8517-a70108fd456d admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:59.309505 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be50f28-5661-4adb-8517-a70108fd456d admin admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:59.310257 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be50f28-5661-4adb-8517-a70108fd456d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:59.315289 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be50f28-5661-4adb-8517-a70108fd456d admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:59.373592 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 875/1746] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:17:59 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:17:59.375292 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9aca2f-9021-4065-a490-98d67fc1ce98 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:59.393103 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9aca2f-9021-4065-a490-98d67fc1ce98 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:59.488876 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6ab967-13b9-4c57-aa7c-26cf7cef1835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:59.489589 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ab967-13b9-4c57-aa7c-26cf7cef1835 admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:59.489868 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ab967-13b9-4c57-aa7c-26cf7cef1835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:59.490139 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ab967-13b9-4c57-aa7c-26cf7cef1835 admin admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:59.490882 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6ab967-13b9-4c57-aa7c-26cf7cef1835 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:59.492839 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6ab967-13b9-4c57-aa7c-26cf7cef1835 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:59.515399 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 872/1747] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:17:59 2022] POST /identity/v3/users => generated 293 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:17:59.518818 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be50f28-5661-4adb-8517-a70108fd456d admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:59.529546 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be50f28-5661-4adb-8517-a70108fd456d admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:59.534260 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cacd39b-aa5b-49fa-b216-e49bfd476d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:59.534917 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cacd39b-aa5b-49fa-b216-e49bfd476d7b admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:59.535577 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cacd39b-aa5b-49fa-b216-e49bfd476d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:59.535577 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cacd39b-aa5b-49fa-b216-e49bfd476d7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:59.536810 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cacd39b-aa5b-49fa-b216-e49bfd476d7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:59.538457 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cacd39b-aa5b-49fa-b216-e49bfd476d7b admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:59.552358 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 876/1748] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:17:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:17:59.553572 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6ab967-13b9-4c57-aa7c-26cf7cef1835 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:59.564370 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6ab967-13b9-4c57-aa7c-26cf7cef1835 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:59.569758 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4017b3-1c76-4356-8fcd-9b33ef0ac16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:59.569915 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4017b3-1c76-4356-8fcd-9b33ef0ac16f admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:59.570120 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4017b3-1c76-4356-8fcd-9b33ef0ac16f admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:59.570398 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4017b3-1c76-4356-8fcd-9b33ef0ac16f admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:59.571118 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4017b3-1c76-4356-8fcd-9b33ef0ac16f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:59.573540 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4017b3-1c76-4356-8fcd-9b33ef0ac16f admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:59.584820 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 873/1749] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:17:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:17:59.589982 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cacd39b-aa5b-49fa-b216-e49bfd476d7b admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:59.599900 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cacd39b-aa5b-49fa-b216-e49bfd476d7b admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:59.604724 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b42e9-d09e-4584-8fb5-76b07df6df89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:59.605718 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b42e9-d09e-4584-8fb5-76b07df6df89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:59.606056 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b42e9-d09e-4584-8fb5-76b07df6df89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:59.606399 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b42e9-d09e-4584-8fb5-76b07df6df89 admin admin] PATH_INFO: `/v3/projects/8583f62e67e042b2b226e6f94e6c54a3/users/5626766834914cf3b507f014d2223c4e/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:59.624333 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822b42e9-d09e-4584-8fb5-76b07df6df89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8583f62e67e042b2b226e6f94e6c54a3, user_id=5626766834914cf3b507f014d2223c4e, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:59.628289 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822b42e9-d09e-4584-8fb5-76b07df6df89 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:59.645764 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 877/1750] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:17:59 2022] PUT /identity/v3/projects/8583f62e67e042b2b226e6f94e6c54a3/users/5626766834914cf3b507f014d2223c4e/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:17:59.656748 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf415c-12b8-4519-9aca-e40b4f0468fe None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:59.657032 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf415c-12b8-4519-9aca-e40b4f0468fe None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:59.657309 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf415c-12b8-4519-9aca-e40b4f0468fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:59.691542 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-6ecf415c-12b8-4519-9aca-e40b4f0468fe None None] MFA Rules not processed for user `5626766834914cf3b507f014d2223c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:59.692780 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-6ecf415c-12b8-4519-9aca-e40b4f0468fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:59.779774 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 874/1751] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:17:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:17:59.786999 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b42e9-d09e-4584-8fb5-76b07df6df89 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:59.900652 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b42e9-d09e-4584-8fb5-76b07df6df89 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:59.911675 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e82af-c94f-4edd-896a-9cfa616938ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:59.912371 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e82af-c94f-4edd-896a-9cfa616938ed admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:59.912655 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e82af-c94f-4edd-896a-9cfa616938ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:59.912928 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e82af-c94f-4edd-896a-9cfa616938ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:59.913718 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31e82af-c94f-4edd-896a-9cfa616938ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:59.929303 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31e82af-c94f-4edd-896a-9cfa616938ed admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:59.993328 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 878/1752] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:17:59 2022] POST /identity/v3/projects => generated 383 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:18:00.002322 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf415c-12b8-4519-9aca-e40b4f0468fe None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:00.021253 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecf415c-12b8-4519-9aca-e40b4f0468fe None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:00.113954 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1212a1-3c27-435b-801f-dc91c50bcaa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:00.114614 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1212a1-3c27-435b-801f-dc91c50bcaa3 admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:00.114891 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1212a1-3c27-435b-801f-dc91c50bcaa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:00.117323 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1212a1-3c27-435b-801f-dc91c50bcaa3 admin admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:00.118225 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1212a1-3c27-435b-801f-dc91c50bcaa3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:00.122026 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1212a1-3c27-435b-801f-dc91c50bcaa3 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:00.184375 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e82af-c94f-4edd-896a-9cfa616938ed admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:00.185586 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 875/1753] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:17:59 2022] POST /identity/v3/users => generated 298 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:18:00.201503 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e82af-c94f-4edd-896a-9cfa616938ed admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:00.217174 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a214d1f-45c1-43b5-91ce-b97abecd108f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:00.217901 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a214d1f-45c1-43b5-91ce-b97abecd108f admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:00.218188 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a214d1f-45c1-43b5-91ce-b97abecd108f admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:00.222391 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a214d1f-45c1-43b5-91ce-b97abecd108f admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:00.225520 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a214d1f-45c1-43b5-91ce-b97abecd108f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:00.230103 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a214d1f-45c1-43b5-91ce-b97abecd108f admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:00.269586 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 879/1754] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:18:00.273986 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1212a1-3c27-435b-801f-dc91c50bcaa3 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:00.303924 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1212a1-3c27-435b-801f-dc91c50bcaa3 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:00.324747 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aa8917-a1cd-420b-8691-9746ee955f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:00.326461 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa8917-a1cd-420b-8691-9746ee955f8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:00.327030 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa8917-a1cd-420b-8691-9746ee955f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:00.330950 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4aa8917-a1cd-420b-8691-9746ee955f8c admin admin] PATH_INFO: `/v3/projects/6890d77090f14a7b955d2434d93f772b/users/05e9011594a541059b935310f885982d/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:00.399112 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aa8917-a1cd-420b-8691-9746ee955f8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6890d77090f14a7b955d2434d93f772b, user_id=05e9011594a541059b935310f885982d, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:00.409519 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4aa8917-a1cd-420b-8691-9746ee955f8c admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:00.446225 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 876/1755] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:18:00 2022] PUT /identity/v3/projects/6890d77090f14a7b955d2434d93f772b/users/05e9011594a541059b935310f885982d/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:00.450484 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a214d1f-45c1-43b5-91ce-b97abecd108f admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:00.476604 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a214d1f-45c1-43b5-91ce-b97abecd108f admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:00.616170 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbffd830-bf32-41df-8bcd-11ffe0e376ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:00.619893 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbffd830-bf32-41df-8bcd-11ffe0e376ff admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:00.621957 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbffd830-bf32-41df-8bcd-11ffe0e376ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:00.623400 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbffd830-bf32-41df-8bcd-11ffe0e376ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:00.626751 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbffd830-bf32-41df-8bcd-11ffe0e376ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:00.630434 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbffd830-bf32-41df-8bcd-11ffe0e376ff admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:00.675578 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 880/1756] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:18:00.679076 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aa8917-a1cd-420b-8691-9746ee955f8c admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:00.698597 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4aa8917-a1cd-420b-8691-9746ee955f8c admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:00.717509 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a7d06-9cdd-4f29-8c4e-209f67d89823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:00.718413 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a7d06-9cdd-4f29-8c4e-209f67d89823 admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:00.718689 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a7d06-9cdd-4f29-8c4e-209f67d89823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:00.719007 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a7d06-9cdd-4f29-8c4e-209f67d89823 admin admin] PATH_INFO: `/v3/projects/6890d77090f14a7b955d2434d93f772b/users/05e9011594a541059b935310f885982d/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:00.722409 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a7d06-9cdd-4f29-8c4e-209f67d89823 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6890d77090f14a7b955d2434d93f772b, user_id=05e9011594a541059b935310f885982d, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:00.726210 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a7d06-9cdd-4f29-8c4e-209f67d89823 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:00.756939 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 877/1757] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:18:00 2022] PUT /identity/v3/projects/6890d77090f14a7b955d2434d93f772b/users/05e9011594a541059b935310f885982d/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:00.757917 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c4cca-3b64-486a-8b90-b6f6c2328e86 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:00.758417 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c4cca-3b64-486a-8b90-b6f6c2328e86 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:00.758930 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c4cca-3b64-486a-8b90-b6f6c2328e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:00.815798 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-062c4cca-3b64-486a-8b90-b6f6c2328e86 None None] MFA Rules not processed for user `05e9011594a541059b935310f885982d`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:00.817251 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-062c4cca-3b64-486a-8b90-b6f6c2328e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:00.951098 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a7d06-9cdd-4f29-8c4e-209f67d89823 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:00.953513 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-253a7d06-9cdd-4f29-8c4e-209f67d89823 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:01.074981 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 881/1758] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:00 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:18:01.084403 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062c4cca-3b64-486a-8b90-b6f6c2328e86 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:01.088309 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-062c4cca-3b64-486a-8b90-b6f6c2328e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:01.136077 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a7d06-9cdd-4f29-8c4e-209f67d89823 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:01.149057 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df389372-1bb7-4dd6-82cb-c55a1945b45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:01.153361 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df389372-1bb7-4dd6-82cb-c55a1945b45d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:01.169022 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df389372-1bb7-4dd6-82cb-c55a1945b45d admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:01.169501 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df389372-1bb7-4dd6-82cb-c55a1945b45d admin admin] PATH_INFO: `/v3/users/6d7342781ad546ba920f69914396bf84` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:01.173646 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df389372-1bb7-4dd6-82cb-c55a1945b45d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d7342781ad546ba920f69914396bf84)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:01.185578 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df389372-1bb7-4dd6-82cb-c55a1945b45d admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:01.236020 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062c4cca-3b64-486a-8b90-b6f6c2328e86 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:01.261230 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caff944-e795-4880-a102-4cf6f10acb6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:01.263064 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caff944-e795-4880-a102-4cf6f10acb6b service cinder] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:01.264014 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caff944-e795-4880-a102-4cf6f10acb6b service cinder] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:01.264521 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caff944-e795-4880-a102-4cf6f10acb6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:01.323984 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-df389372-1bb7-4dd6-82cb-c55a1945b45d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d7342781ad546ba920f69914396bf84'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:01.339386 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-df389372-1bb7-4dd6-82cb-c55a1945b45d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d7342781ad546ba920f69914396bf84'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:01.341820 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-df389372-1bb7-4dd6-82cb-c55a1945b45d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d7342781ad546ba920f69914396bf84'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:01.363950 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-df389372-1bb7-4dd6-82cb-c55a1945b45d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d7342781ad546ba920f69914396bf84'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:01.364970 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-df389372-1bb7-4dd6-82cb-c55a1945b45d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d7342781ad546ba920f69914396bf84'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:01.436096 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 878/1759] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:18:00 2022] DELETE /identity/v3/users/6d7342781ad546ba920f69914396bf84 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:01.438621 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca89b3-4a7d-4b3d-b991-78ca5c7ccb04 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:01.439568 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca89b3-4a7d-4b3d-b991-78ca5c7ccb04 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:01.444780 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca89b3-4a7d-4b3d-b991-78ca5c7ccb04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:01.451528 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caff944-e795-4880-a102-4cf6f10acb6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:01.457541 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caff944-e795-4880-a102-4cf6f10acb6b service cinder] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:01.511801 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 882/1760] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:18:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:18:01.539445 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-9dca89b3-4a7d-4b3d-b991-78ca5c7ccb04 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:01.550762 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-9dca89b3-4a7d-4b3d-b991-78ca5c7ccb04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:01.732854 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 879/1761] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:01.855561 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caff944-e795-4880-a102-4cf6f10acb6b service cinder] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:01.857008 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-1caff944-e795-4880-a102-4cf6f10acb6b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:02.046093 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caff944-e795-4880-a102-4cf6f10acb6b service cinder] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:02.155452 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af9e90-e131-47e0-9ae0-1da5024a9a39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:02.156606 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af9e90-e131-47e0-9ae0-1da5024a9a39 service neutron] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:02.157728 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af9e90-e131-47e0-9ae0-1da5024a9a39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:02.158169 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af9e90-e131-47e0-9ae0-1da5024a9a39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:02.192687 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76af9e90-e131-47e0-9ae0-1da5024a9a39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:02.196447 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76af9e90-e131-47e0-9ae0-1da5024a9a39 service neutron] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:02.218117 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 883/1762] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:18:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:18:04.019667 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca89b3-4a7d-4b3d-b991-78ca5c7ccb04 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:04.033829 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-9dca89b3-4a7d-4b3d-b991-78ca5c7ccb04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:04.068833 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca89b3-4a7d-4b3d-b991-78ca5c7ccb04 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:04.076153 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d82211a-6604-4a2d-8b4e-5d72e0c86130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:04.079196 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82211a-6604-4a2d-8b4e-5d72e0c86130 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:04.079658 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82211a-6604-4a2d-8b4e-5d72e0c86130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:04.080068 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d82211a-6604-4a2d-8b4e-5d72e0c86130 admin admin] PATH_INFO: `/v3/projects/33e8ac774d944b59bac90b4f3bfa9776` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:04.089282 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d82211a-6604-4a2d-8b4e-5d72e0c86130 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33e8ac774d944b59bac90b4f3bfa9776)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:04.100316 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d82211a-6604-4a2d-8b4e-5d72e0c86130 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:04.233023 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-2d82211a-6604-4a2d-8b4e-5d72e0c86130 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33e8ac774d944b59bac90b4f3bfa9776', 'request_id': 'req-2d82211a-6604-4a2d-8b4e-5d72e0c86130'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:04.257626 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-2d82211a-6604-4a2d-8b4e-5d72e0c86130 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33e8ac774d944b59bac90b4f3bfa9776', 'request_id': 'req-2d82211a-6604-4a2d-8b4e-5d72e0c86130'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:04.299014 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-2d82211a-6604-4a2d-8b4e-5d72e0c86130 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33e8ac774d944b59bac90b4f3bfa9776', 'request_id': 'req-2d82211a-6604-4a2d-8b4e-5d72e0c86130'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:04.316704 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-2d82211a-6604-4a2d-8b4e-5d72e0c86130 admin admin] The token cache is being invalidate because project 33e8ac774d944b59bac90b4f3bfa9776 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:18:04.320924 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-2d82211a-6604-4a2d-8b4e-5d72e0c86130 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:04.322042 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-2d82211a-6604-4a2d-8b4e-5d72e0c86130 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:04.327557 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 880/1763] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:18:04 2022] DELETE /identity/v3/projects/33e8ac774d944b59bac90b4f3bfa9776 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:04.328683 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af9e90-e131-47e0-9ae0-1da5024a9a39 service neutron] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:04.345905 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af9e90-e131-47e0-9ae0-1da5024a9a39 service neutron] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:04.511721 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146a4658-feb1-4b6a-b4b6-2a9ff7a8da1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:04.512837 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a4658-feb1-4b6a-b4b6-2a9ff7a8da1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:04.513269 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a4658-feb1-4b6a-b4b6-2a9ff7a8da1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:04.513753 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a4658-feb1-4b6a-b4b6-2a9ff7a8da1f admin admin] PATH_INFO: `/v3/users/f93e81f0be7c4f5c8c9eac464c746a18` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:04.516161 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146a4658-feb1-4b6a-b4b6-2a9ff7a8da1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f93e81f0be7c4f5c8c9eac464c746a18)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:04.523714 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146a4658-feb1-4b6a-b4b6-2a9ff7a8da1f admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:04.585691 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-146a4658-feb1-4b6a-b4b6-2a9ff7a8da1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f93e81f0be7c4f5c8c9eac464c746a18'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:04.601129 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-146a4658-feb1-4b6a-b4b6-2a9ff7a8da1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f93e81f0be7c4f5c8c9eac464c746a18'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:04.602129 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-146a4658-feb1-4b6a-b4b6-2a9ff7a8da1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f93e81f0be7c4f5c8c9eac464c746a18'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:04.602920 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-146a4658-feb1-4b6a-b4b6-2a9ff7a8da1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f93e81f0be7c4f5c8c9eac464c746a18'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:04.612130 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-146a4658-feb1-4b6a-b4b6-2a9ff7a8da1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f93e81f0be7c4f5c8c9eac464c746a18'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:04.630330 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 884/1764] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:18:04 2022] DELETE /identity/v3/users/f93e81f0be7c4f5c8c9eac464c746a18 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:04.998987 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117547e-caf3-4e2b-8eee-db73d742c81a None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:04.999400 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117547e-caf3-4e2b-8eee-db73d742c81a None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:04.999799 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b117547e-caf3-4e2b-8eee-db73d742c81a None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:05.001897 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 881/1765] 10.222.0.65 () {54 vars in 921 bytes} [Tue May 17 18:18:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:18:05.011650 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a825193-709a-410e-b43d-4e14b356cd89 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:05.011778 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a825193-709a-410e-b43d-4e14b356cd89 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:05.012013 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a825193-709a-410e-b43d-4e14b356cd89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:05.048739 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-7a825193-709a-410e-b43d-4e14b356cd89 None None] MFA Rules not processed for user `5b430b739cb54fc7911bc89f8ea2df72`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:05.050354 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-7a825193-709a-410e-b43d-4e14b356cd89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:05.169308 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 885/1766] 10.222.0.65 () {58 vars in 1018 bytes} [Tue May 17 18:18:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:06.163279 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b117547e-caf3-4e2b-8eee-db73d742c81a None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:06.165752 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-b117547e-caf3-4e2b-8eee-db73d742c81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:06.192310 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b117547e-caf3-4e2b-8eee-db73d742c81a None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:06.200059 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b6728-72b2-4c57-8bb4-14e500b4580a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b430b739cb54fc7911bc89f8ea2df72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:06.201318 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b6728-72b2-4c57-8bb4-14e500b4580a service nova] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:06.202043 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b6728-72b2-4c57-8bb4-14e500b4580a service nova] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:06.202043 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b6728-72b2-4c57-8bb4-14e500b4580a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:06.212393 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171b6728-72b2-4c57-8bb4-14e500b4580a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:06.214477 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171b6728-72b2-4c57-8bb4-14e500b4580a service nova] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:06.227228 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 882/1767] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:18:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:18:06.782754 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a825193-709a-410e-b43d-4e14b356cd89 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:06.784439 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-7a825193-709a-410e-b43d-4e14b356cd89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:06.908954 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a825193-709a-410e-b43d-4e14b356cd89 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:06.916418 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a9a061-e02a-4022-af1a-172d1340024a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:06.918224 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a9a061-e02a-4022-af1a-172d1340024a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:06.918678 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a9a061-e02a-4022-af1a-172d1340024a admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:06.919107 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a9a061-e02a-4022-af1a-172d1340024a admin admin] PATH_INFO: `/v3/projects/49350e1e1548478a909162eac483aaa8` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:06.920855 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a9a061-e02a-4022-af1a-172d1340024a admin admin] RBAC: Authorizing `identity:delete_project(project_id=49350e1e1548478a909162eac483aaa8)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:06.924919 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a9a061-e02a-4022-af1a-172d1340024a admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:07.028999 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-b5a9a061-e02a-4022-af1a-172d1340024a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49350e1e1548478a909162eac483aaa8', 'request_id': 'req-b5a9a061-e02a-4022-af1a-172d1340024a'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:07.038203 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-b5a9a061-e02a-4022-af1a-172d1340024a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49350e1e1548478a909162eac483aaa8', 'request_id': 'req-b5a9a061-e02a-4022-af1a-172d1340024a'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:07.050024 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-b5a9a061-e02a-4022-af1a-172d1340024a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49350e1e1548478a909162eac483aaa8', 'request_id': 'req-b5a9a061-e02a-4022-af1a-172d1340024a'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:07.071074 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-b5a9a061-e02a-4022-af1a-172d1340024a admin admin] The token cache is being invalidate because project 49350e1e1548478a909162eac483aaa8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:18:07.071547 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-b5a9a061-e02a-4022-af1a-172d1340024a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:07.073319 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-b5a9a061-e02a-4022-af1a-172d1340024a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:07.078591 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 886/1768] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:18:06 2022] DELETE /identity/v3/projects/49350e1e1548478a909162eac483aaa8 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:07.080294 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7baed61-4a1e-4765-8bad-bc5b7a994655 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:07.080584 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7baed61-4a1e-4765-8bad-bc5b7a994655 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:07.080861 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7baed61-4a1e-4765-8bad-bc5b7a994655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:07.105825 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-e7baed61-4a1e-4765-8bad-bc5b7a994655 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:07.109191 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-e7baed61-4a1e-4765-8bad-bc5b7a994655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:07.116868 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af79cd-559b-449a-b2bb-46a0cd96080f None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:07.117408 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af79cd-559b-449a-b2bb-46a0cd96080f None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:07.118022 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af79cd-559b-449a-b2bb-46a0cd96080f None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:07.120475 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 887/1769] 10.222.0.65 () {54 vars in 921 bytes} [Tue May 17 18:18:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 18:18:07.146468 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787868f9-c0a8-4999-8364-a44fd5c0d775 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:07.147318 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787868f9-c0a8-4999-8364-a44fd5c0d775 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:07.147318 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787868f9-c0a8-4999-8364-a44fd5c0d775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:07.186582 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-787868f9-c0a8-4999-8364-a44fd5c0d775 None None] MFA Rules not processed for user `5b430b739cb54fc7911bc89f8ea2df72`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:07.189657 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-787868f9-c0a8-4999-8364-a44fd5c0d775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:07.280680 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 883/1770] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:07.281754 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7baed61-4a1e-4765-8bad-bc5b7a994655 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:07.283169 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-e7baed61-4a1e-4765-8bad-bc5b7a994655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:07.345030 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 888/1771] 10.222.0.65 () {58 vars in 1018 bytes} [Tue May 17 18:18:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:07.346997 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c9091-21c1-42df-836c-181cd14b1152 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:07.347482 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c9091-21c1-42df-836c-181cd14b1152 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:07.347913 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c9091-21c1-42df-836c-181cd14b1152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:07.376735 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-655c9091-21c1-42df-836c-181cd14b1152 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:07.378569 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-655c9091-21c1-42df-836c-181cd14b1152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:07.398766 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 889/1772] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:07.403593 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655c9091-21c1-42df-836c-181cd14b1152 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:07.428459 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7baed61-4a1e-4765-8bad-bc5b7a994655 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:07.434243 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbba072-49c9-4d34-9776-24f8c05b4df6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:07.435847 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbba072-49c9-4d34-9776-24f8c05b4df6 service cinder] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:07.436251 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbba072-49c9-4d34-9776-24f8c05b4df6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:07.436591 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbba072-49c9-4d34-9776-24f8c05b4df6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:07.436888 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655c9091-21c1-42df-836c-181cd14b1152 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:07.439069 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-7dbba072-49c9-4d34-9776-24f8c05b4df6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:07.450995 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e61844-4456-4366-bb6b-9dd3eed51248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:07.452041 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e61844-4456-4366-bb6b-9dd3eed51248 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:07.452322 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e61844-4456-4366-bb6b-9dd3eed51248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:07.452598 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e61844-4456-4366-bb6b-9dd3eed51248 admin admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:07.453519 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e61844-4456-4366-bb6b-9dd3eed51248 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:18:07.453828 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e61844-4456-4366-bb6b-9dd3eed51248 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:07.455721 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e61844-4456-4366-bb6b-9dd3eed51248 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:07.477539 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 890/1773] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 17 18:18:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:18:07.478506 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e61844-4456-4366-bb6b-9dd3eed51248 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:07.506859 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e61844-4456-4366-bb6b-9dd3eed51248 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:07.513139 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10836766-eef4-4ccc-9d5b-f9b8c8680fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:07.513825 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10836766-eef4-4ccc-9d5b-f9b8c8680fc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:07.514103 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10836766-eef4-4ccc-9d5b-f9b8c8680fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:07.514517 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10836766-eef4-4ccc-9d5b-f9b8c8680fc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:07.516013 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10836766-eef4-4ccc-9d5b-f9b8c8680fc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:07.518439 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10836766-eef4-4ccc-9d5b-f9b8c8680fc2 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:07.540633 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbba072-49c9-4d34-9776-24f8c05b4df6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:07.541867 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbba072-49c9-4d34-9776-24f8c05b4df6 service cinder] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:07.559979 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 891/1774] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:18:07 2022] POST /identity/v3/projects => generated 401 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:18:07.565290 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10836766-eef4-4ccc-9d5b-f9b8c8680fc2 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:07.575457 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 884/1775] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:18:07 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:18:07.590427 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbba072-49c9-4d34-9776-24f8c05b4df6 service cinder] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:07.591825 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-7dbba072-49c9-4d34-9776-24f8c05b4df6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:07.633719 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbba072-49c9-4d34-9776-24f8c05b4df6 service cinder] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:07.728811 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10836766-eef4-4ccc-9d5b-f9b8c8680fc2 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:07.739494 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3956496-29cf-4922-b2b3-e8f4ea7e80ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:07.740188 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3956496-29cf-4922-b2b3-e8f4ea7e80ba admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:07.740467 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3956496-29cf-4922-b2b3-e8f4ea7e80ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:07.740741 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3956496-29cf-4922-b2b3-e8f4ea7e80ba admin admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:07.741437 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3956496-29cf-4922-b2b3-e8f4ea7e80ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:07.743403 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3956496-29cf-4922-b2b3-e8f4ea7e80ba admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:07.794111 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 892/1776] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:18:07 2022] POST /identity/v3/users => generated 301 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:18:07.806257 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3956496-29cf-4922-b2b3-e8f4ea7e80ba admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:07.834530 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14245f8b-ddf7-41dc-a64d-d1817a114ed0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b430b739cb54fc7911bc89f8ea2df72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:07.835200 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14245f8b-ddf7-41dc-a64d-d1817a114ed0 service nova] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:07.835484 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14245f8b-ddf7-41dc-a64d-d1817a114ed0 service nova] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:07.835754 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14245f8b-ddf7-41dc-a64d-d1817a114ed0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:07.854582 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3956496-29cf-4922-b2b3-e8f4ea7e80ba admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:07.865390 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14245f8b-ddf7-41dc-a64d-d1817a114ed0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:07.867093 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14245f8b-ddf7-41dc-a64d-d1817a114ed0 service nova] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:07.867395 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38afaff-fe4b-47d9-81a7-b4fb0a299205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:07.868628 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38afaff-fe4b-47d9-81a7-b4fb0a299205 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:07.869331 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38afaff-fe4b-47d9-81a7-b4fb0a299205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:07.870682 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38afaff-fe4b-47d9-81a7-b4fb0a299205 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:07.871504 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38afaff-fe4b-47d9-81a7-b4fb0a299205 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:07.875826 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38afaff-fe4b-47d9-81a7-b4fb0a299205 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:07.901968 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 885/1777] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:18:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:18:07.929345 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 893/1778] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:18:07.932956 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14245f8b-ddf7-41dc-a64d-d1817a114ed0 service nova] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:07.955455 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14245f8b-ddf7-41dc-a64d-d1817a114ed0 service nova] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:07.975127 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b5d128-4b37-4acb-85c7-65f33399e810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:07.975886 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5d128-4b37-4acb-85c7-65f33399e810 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:07.976170 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5d128-4b37-4acb-85c7-65f33399e810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:07.976449 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5d128-4b37-4acb-85c7-65f33399e810 admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:07.977192 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b5d128-4b37-4acb-85c7-65f33399e810 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:07.979028 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b5d128-4b37-4acb-85c7-65f33399e810 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:08.026525 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 886/1779] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:18:08.030347 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38afaff-fe4b-47d9-81a7-b4fb0a299205 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:08.053789 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38afaff-fe4b-47d9-81a7-b4fb0a299205 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:08.066222 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e885387f-1b5a-4000-b55d-b6cb748b8ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:08.067126 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e885387f-1b5a-4000-b55d-b6cb748b8ac8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:08.067663 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e885387f-1b5a-4000-b55d-b6cb748b8ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:08.068351 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e885387f-1b5a-4000-b55d-b6cb748b8ac8 admin admin] PATH_INFO: `/v3/projects/2af82ce385f443eaa7fee9907f2117d0/users/5bce019d1142417a9b7ea29ac62421e8/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:08.114054 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e885387f-1b5a-4000-b55d-b6cb748b8ac8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2af82ce385f443eaa7fee9907f2117d0, user_id=5bce019d1142417a9b7ea29ac62421e8, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:08.119287 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e885387f-1b5a-4000-b55d-b6cb748b8ac8 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:08.156366 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 894/1780] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:18:08 2022] PUT /identity/v3/projects/2af82ce385f443eaa7fee9907f2117d0/users/5bce019d1142417a9b7ea29ac62421e8/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:08.158465 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a38c7-3e39-480d-aa98-df657e94a138 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:08.158871 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a38c7-3e39-480d-aa98-df657e94a138 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:08.159218 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a38c7-3e39-480d-aa98-df657e94a138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:08.198429 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-c25a38c7-3e39-480d-aa98-df657e94a138 None None] MFA Rules not processed for user `5bce019d1142417a9b7ea29ac62421e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:08.199764 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-c25a38c7-3e39-480d-aa98-df657e94a138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:08.293625 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 887/1781] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:08 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:08.298284 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e885387f-1b5a-4000-b55d-b6cb748b8ac8 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:08.393283 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e885387f-1b5a-4000-b55d-b6cb748b8ac8 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:08.399731 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca9598-a30f-468a-86d5-9362b778b5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:08.400780 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca9598-a30f-468a-86d5-9362b778b5ea admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:08.401175 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca9598-a30f-468a-86d5-9362b778b5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:08.401558 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca9598-a30f-468a-86d5-9362b778b5ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:08.402425 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ca9598-a30f-468a-86d5-9362b778b5ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:08.405040 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ca9598-a30f-468a-86d5-9362b778b5ea admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:08.443636 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 895/1782] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:18:08 2022] POST /identity/v3/projects => generated 401 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:18:08.447712 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25a38c7-3e39-480d-aa98-df657e94a138 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:08.458761 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25a38c7-3e39-480d-aa98-df657e94a138 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:08.513714 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e151650-cf93-4920-b13f-7cd37505ee39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:08.514413 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e151650-cf93-4920-b13f-7cd37505ee39 admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:08.514694 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e151650-cf93-4920-b13f-7cd37505ee39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:08.514968 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e151650-cf93-4920-b13f-7cd37505ee39 admin admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:08.515651 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e151650-cf93-4920-b13f-7cd37505ee39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:08.517587 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e151650-cf93-4920-b13f-7cd37505ee39 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:08.540165 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 888/1783] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:18:08 2022] POST /identity/v3/users => generated 307 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:18:08.542979 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca9598-a30f-468a-86d5-9362b778b5ea admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:08.553131 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ca9598-a30f-468a-86d5-9362b778b5ea admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:08.558255 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb4f62b-7ded-4a26-b030-770dc4652c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:08.558900 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4f62b-7ded-4a26-b030-770dc4652c7a admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:08.559174 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4f62b-7ded-4a26-b030-770dc4652c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:08.559444 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb4f62b-7ded-4a26-b030-770dc4652c7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:08.560154 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb4f62b-7ded-4a26-b030-770dc4652c7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:08.561807 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb4f62b-7ded-4a26-b030-770dc4652c7a admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:08.572027 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 896/1784] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:18:08.576244 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e151650-cf93-4920-b13f-7cd37505ee39 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:08.585940 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e151650-cf93-4920-b13f-7cd37505ee39 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:08.590449 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e2e00d-b8c7-4605-a0ce-e6a8d60109dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:08.591317 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2e00d-b8c7-4605-a0ce-e6a8d60109dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:08.591595 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2e00d-b8c7-4605-a0ce-e6a8d60109dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:08.591869 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e2e00d-b8c7-4605-a0ce-e6a8d60109dd admin admin] PATH_INFO: `/v3/projects/7d9169c971614314a5ffd5eeed42abbb/users/55138bb5e8fd4bdf84c4c06175f07074/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:08.607477 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e2e00d-b8c7-4605-a0ce-e6a8d60109dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d9169c971614314a5ffd5eeed42abbb, user_id=55138bb5e8fd4bdf84c4c06175f07074, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:08.610168 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e2e00d-b8c7-4605-a0ce-e6a8d60109dd admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:08.623800 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 889/1785] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:18:08 2022] PUT /identity/v3/projects/7d9169c971614314a5ffd5eeed42abbb/users/55138bb5e8fd4bdf84c4c06175f07074/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:18:08.627897 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb4f62b-7ded-4a26-b030-770dc4652c7a admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:08.637600 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb4f62b-7ded-4a26-b030-770dc4652c7a admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:08.693138 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4488e29e-0878-4151-b4a7-c171043be281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:08.693856 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488e29e-0878-4151-b4a7-c171043be281 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:08.694138 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488e29e-0878-4151-b4a7-c171043be281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:08.694412 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488e29e-0878-4151-b4a7-c171043be281 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:08.695140 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4488e29e-0878-4151-b4a7-c171043be281 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:08.697005 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4488e29e-0878-4151-b4a7-c171043be281 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:08.709488 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 897/1786] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:18:08.713727 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e2e00d-b8c7-4605-a0ce-e6a8d60109dd admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:08.724681 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e2e00d-b8c7-4605-a0ce-e6a8d60109dd admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:08.729961 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bba829-3e3a-4bb8-abe6-089d60bc96a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:08.730906 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bba829-3e3a-4bb8-abe6-089d60bc96a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:08.731186 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bba829-3e3a-4bb8-abe6-089d60bc96a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:08.731492 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bba829-3e3a-4bb8-abe6-089d60bc96a1 admin admin] PATH_INFO: `/v3/projects/7d9169c971614314a5ffd5eeed42abbb/users/55138bb5e8fd4bdf84c4c06175f07074/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:08.733429 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bba829-3e3a-4bb8-abe6-089d60bc96a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d9169c971614314a5ffd5eeed42abbb, user_id=55138bb5e8fd4bdf84c4c06175f07074, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:08.736042 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bba829-3e3a-4bb8-abe6-089d60bc96a1 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:08.747130 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 890/1787] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:18:08 2022] PUT /identity/v3/projects/7d9169c971614314a5ffd5eeed42abbb/users/55138bb5e8fd4bdf84c4c06175f07074/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:08.759444 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c3470-1d87-4cab-9471-574b0a7090e1 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:08.759959 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c3470-1d87-4cab-9471-574b0a7090e1 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:08.760633 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c3470-1d87-4cab-9471-574b0a7090e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:08.796822 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-8b0c3470-1d87-4cab-9471-574b0a7090e1 None None] MFA Rules not processed for user `55138bb5e8fd4bdf84c4c06175f07074`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:08.798111 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-8b0c3470-1d87-4cab-9471-574b0a7090e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:08.862749 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 898/1788] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:08 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:08.873442 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bba829-3e3a-4bb8-abe6-089d60bc96a1 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:08.926141 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bba829-3e3a-4bb8-abe6-089d60bc96a1 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:08.929689 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b1b89-58a7-44d1-a2c7-555b79f9cac7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:08.930320 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b1b89-58a7-44d1-a2c7-555b79f9cac7 service cinder] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:08.930594 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b1b89-58a7-44d1-a2c7-555b79f9cac7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:08.930862 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1b1b89-58a7-44d1-a2c7-555b79f9cac7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:08.942834 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b1b89-58a7-44d1-a2c7-555b79f9cac7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:08.944259 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1b1b89-58a7-44d1-a2c7-555b79f9cac7 service cinder] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:08.954507 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 891/1789] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:18:08 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:18:09.030839 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0c3470-1d87-4cab-9471-574b0a7090e1 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:09.042012 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0c3470-1d87-4cab-9471-574b0a7090e1 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:09.045670 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db044e9-2d7a-4e36-97d6-c28d6384d355 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:09.046355 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db044e9-2d7a-4e36-97d6-c28d6384d355 service cinder] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:09.046649 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db044e9-2d7a-4e36-97d6-c28d6384d355 service cinder] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:09.046904 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db044e9-2d7a-4e36-97d6-c28d6384d355 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:09.105493 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db044e9-2d7a-4e36-97d6-c28d6384d355 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:09.106881 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db044e9-2d7a-4e36-97d6-c28d6384d355 service cinder] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:09.115692 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 899/1790] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:18:09 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:18:17.531052 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b1b89-58a7-44d1-a2c7-555b79f9cac7 service cinder] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:17.699080 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1b1b89-58a7-44d1-a2c7-555b79f9cac7 service cinder] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:17.703907 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da937bde-9f56-428e-9df0-b6e941c2eabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:17.704820 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da937bde-9f56-428e-9df0-b6e941c2eabc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:17.705099 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da937bde-9f56-428e-9df0-b6e941c2eabc admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:17.705371 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da937bde-9f56-428e-9df0-b6e941c2eabc admin admin] PATH_INFO: `/v3/users/5bce019d1142417a9b7ea29ac62421e8` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:17.714450 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da937bde-9f56-428e-9df0-b6e941c2eabc admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bce019d1142417a9b7ea29ac62421e8)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:17.716412 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da937bde-9f56-428e-9df0-b6e941c2eabc admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:17.782710 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-da937bde-9f56-428e-9df0-b6e941c2eabc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bce019d1142417a9b7ea29ac62421e8'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:17.792870 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-da937bde-9f56-428e-9df0-b6e941c2eabc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bce019d1142417a9b7ea29ac62421e8'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:17.793945 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-da937bde-9f56-428e-9df0-b6e941c2eabc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bce019d1142417a9b7ea29ac62421e8'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:17.803162 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-da937bde-9f56-428e-9df0-b6e941c2eabc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bce019d1142417a9b7ea29ac62421e8'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:17.803997 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-da937bde-9f56-428e-9df0-b6e941c2eabc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bce019d1142417a9b7ea29ac62421e8'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:17.841872 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 892/1791] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:18:17 2022] DELETE /identity/v3/users/5bce019d1142417a9b7ea29ac62421e8 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:17.843651 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199f745-dd68-4da8-99b6-a141d13a0936 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:17.844079 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199f745-dd68-4da8-99b6-a141d13a0936 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:17.844160 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199f745-dd68-4da8-99b6-a141d13a0936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:17.870034 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-4199f745-dd68-4da8-99b6-a141d13a0936 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:17.874335 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-4199f745-dd68-4da8-99b6-a141d13a0936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:17.984795 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 900/1792] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:18.091315 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da937bde-9f56-428e-9df0-b6e941c2eabc admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:18.095053 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-da937bde-9f56-428e-9df0-b6e941c2eabc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:18.247049 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da937bde-9f56-428e-9df0-b6e941c2eabc admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:18.252273 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a676f-4deb-47bf-8f62-77b8cc149820 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:18.252959 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a676f-4deb-47bf-8f62-77b8cc149820 service neutron] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:18.253242 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a676f-4deb-47bf-8f62-77b8cc149820 service neutron] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:18.253565 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a676f-4deb-47bf-8f62-77b8cc149820 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:18.266968 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a676f-4deb-47bf-8f62-77b8cc149820 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:18.269117 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a676f-4deb-47bf-8f62-77b8cc149820 service neutron] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:18.299669 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 893/1793] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:18:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:18:18.713548 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4199f745-dd68-4da8-99b6-a141d13a0936 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:18.717166 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-4199f745-dd68-4da8-99b6-a141d13a0936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:18.732821 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4199f745-dd68-4da8-99b6-a141d13a0936 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:18.738920 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df51a6ec-b979-41ab-98ae-7109e2dd197b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:18.739980 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51a6ec-b979-41ab-98ae-7109e2dd197b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:18.740273 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51a6ec-b979-41ab-98ae-7109e2dd197b admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:18.740607 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51a6ec-b979-41ab-98ae-7109e2dd197b admin admin] PATH_INFO: `/v3/projects/2af82ce385f443eaa7fee9907f2117d0` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:18.741847 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df51a6ec-b979-41ab-98ae-7109e2dd197b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2af82ce385f443eaa7fee9907f2117d0)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:18.743794 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df51a6ec-b979-41ab-98ae-7109e2dd197b admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:18.835056 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-df51a6ec-b979-41ab-98ae-7109e2dd197b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2af82ce385f443eaa7fee9907f2117d0', 'request_id': 'req-df51a6ec-b979-41ab-98ae-7109e2dd197b'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:18.842559 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-df51a6ec-b979-41ab-98ae-7109e2dd197b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2af82ce385f443eaa7fee9907f2117d0', 'request_id': 'req-df51a6ec-b979-41ab-98ae-7109e2dd197b'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:18.860590 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-df51a6ec-b979-41ab-98ae-7109e2dd197b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2af82ce385f443eaa7fee9907f2117d0', 'request_id': 'req-df51a6ec-b979-41ab-98ae-7109e2dd197b'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:18.874976 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-df51a6ec-b979-41ab-98ae-7109e2dd197b admin admin] The token cache is being invalidate because project 2af82ce385f443eaa7fee9907f2117d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:18:18.875263 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-df51a6ec-b979-41ab-98ae-7109e2dd197b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:18.876047 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-df51a6ec-b979-41ab-98ae-7109e2dd197b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:18.881189 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 901/1794] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:18:18 2022] DELETE /identity/v3/projects/2af82ce385f443eaa7fee9907f2117d0 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:18.885170 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a676f-4deb-47bf-8f62-77b8cc149820 service neutron] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:18.896010 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a676f-4deb-47bf-8f62-77b8cc149820 service neutron] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:19.063945 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae13d94d-a3b9-423c-97ae-6f287f8e1798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:19.064943 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13d94d-a3b9-423c-97ae-6f287f8e1798 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:19.065347 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13d94d-a3b9-423c-97ae-6f287f8e1798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:19.065652 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13d94d-a3b9-423c-97ae-6f287f8e1798 admin admin] PATH_INFO: `/v3/users/55138bb5e8fd4bdf84c4c06175f07074` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:19.066898 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae13d94d-a3b9-423c-97ae-6f287f8e1798 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55138bb5e8fd4bdf84c4c06175f07074)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:19.069553 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae13d94d-a3b9-423c-97ae-6f287f8e1798 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:19.122203 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-ae13d94d-a3b9-423c-97ae-6f287f8e1798 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55138bb5e8fd4bdf84c4c06175f07074'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:19.134693 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-ae13d94d-a3b9-423c-97ae-6f287f8e1798 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55138bb5e8fd4bdf84c4c06175f07074'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:19.135600 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-ae13d94d-a3b9-423c-97ae-6f287f8e1798 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55138bb5e8fd4bdf84c4c06175f07074'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:19.145970 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-ae13d94d-a3b9-423c-97ae-6f287f8e1798 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55138bb5e8fd4bdf84c4c06175f07074'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:19.147033 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-ae13d94d-a3b9-423c-97ae-6f287f8e1798 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55138bb5e8fd4bdf84c4c06175f07074'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:19.173098 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 894/1795] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:18:18 2022] DELETE /identity/v3/users/55138bb5e8fd4bdf84c4c06175f07074 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:19.270743 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df51a6ec-b979-41ab-98ae-7109e2dd197b admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:19.273013 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-df51a6ec-b979-41ab-98ae-7109e2dd197b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:19.288920 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df51a6ec-b979-41ab-98ae-7109e2dd197b admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:19.353538 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfee753-0e44-45a6-aa81-99145a7c8cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:19.354906 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfee753-0e44-45a6-aa81-99145a7c8cac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:19.354906 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfee753-0e44-45a6-aa81-99145a7c8cac admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:19.355101 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfee753-0e44-45a6-aa81-99145a7c8cac admin admin] PATH_INFO: `/v3/users/5626766834914cf3b507f014d2223c4e` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:19.356469 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfee753-0e44-45a6-aa81-99145a7c8cac admin admin] RBAC: Authorizing `identity:delete_user(user_id=5626766834914cf3b507f014d2223c4e)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:19.358470 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfee753-0e44-45a6-aa81-99145a7c8cac admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:19.413187 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-3bfee753-0e44-45a6-aa81-99145a7c8cac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5626766834914cf3b507f014d2223c4e'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:19.455892 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-3bfee753-0e44-45a6-aa81-99145a7c8cac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5626766834914cf3b507f014d2223c4e'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:19.456658 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-3bfee753-0e44-45a6-aa81-99145a7c8cac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5626766834914cf3b507f014d2223c4e'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:19.457316 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-3bfee753-0e44-45a6-aa81-99145a7c8cac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5626766834914cf3b507f014d2223c4e'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:19.477819 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-3bfee753-0e44-45a6-aa81-99145a7c8cac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5626766834914cf3b507f014d2223c4e'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:19.544291 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 902/1796] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:18:19 2022] DELETE /identity/v3/users/5626766834914cf3b507f014d2223c4e => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:19.549250 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8b8c1-fff2-4f3e-ae90-30922209342d None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:19.549626 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8b8c1-fff2-4f3e-ae90-30922209342d None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:19.549895 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8b8c1-fff2-4f3e-ae90-30922209342d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:19.588639 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-d5e8b8c1-fff2-4f3e-ae90-30922209342d None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:19.590618 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-d5e8b8c1-fff2-4f3e-ae90-30922209342d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:19.665942 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 895/1797] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:18:19.703114 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfee753-0e44-45a6-aa81-99145a7c8cac admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:19.704745 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-3bfee753-0e44-45a6-aa81-99145a7c8cac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:19.823673 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfee753-0e44-45a6-aa81-99145a7c8cac admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:19.838919 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a615640e-7ece-4e97-845c-fe71321f9051 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:19.840809 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a615640e-7ece-4e97-845c-fe71321f9051 service neutron] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:19.842418 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a615640e-7ece-4e97-845c-fe71321f9051 service neutron] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:19.848420 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a615640e-7ece-4e97-845c-fe71321f9051 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:19.865724 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a615640e-7ece-4e97-845c-fe71321f9051 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:19.868394 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a615640e-7ece-4e97-845c-fe71321f9051 service neutron] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:19.882367 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 903/1798] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:18:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:18:20.067418 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e8b8c1-fff2-4f3e-ae90-30922209342d None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:20.068877 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-d5e8b8c1-fff2-4f3e-ae90-30922209342d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:20.087777 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e8b8c1-fff2-4f3e-ae90-30922209342d None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:20.094606 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72558d97-fe9d-43ae-944d-aa86ea472ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:20.095642 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72558d97-fe9d-43ae-944d-aa86ea472ac3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:20.096160 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72558d97-fe9d-43ae-944d-aa86ea472ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:20.096564 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72558d97-fe9d-43ae-944d-aa86ea472ac3 admin admin] PATH_INFO: `/v3/projects/7d9169c971614314a5ffd5eeed42abbb` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:20.097908 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72558d97-fe9d-43ae-944d-aa86ea472ac3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d9169c971614314a5ffd5eeed42abbb)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:20.100221 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72558d97-fe9d-43ae-944d-aa86ea472ac3 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:20.179124 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-72558d97-fe9d-43ae-944d-aa86ea472ac3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d9169c971614314a5ffd5eeed42abbb', 'request_id': 'req-72558d97-fe9d-43ae-944d-aa86ea472ac3'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:20.185696 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-72558d97-fe9d-43ae-944d-aa86ea472ac3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d9169c971614314a5ffd5eeed42abbb', 'request_id': 'req-72558d97-fe9d-43ae-944d-aa86ea472ac3'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:20.193733 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-72558d97-fe9d-43ae-944d-aa86ea472ac3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d9169c971614314a5ffd5eeed42abbb', 'request_id': 'req-72558d97-fe9d-43ae-944d-aa86ea472ac3'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:20.206922 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-72558d97-fe9d-43ae-944d-aa86ea472ac3 admin admin] The token cache is being invalidate because project 7d9169c971614314a5ffd5eeed42abbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:18:20.207235 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-72558d97-fe9d-43ae-944d-aa86ea472ac3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:20.207921 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-72558d97-fe9d-43ae-944d-aa86ea472ac3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:20.209507 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 896/1799] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:18:20 2022] DELETE /identity/v3/projects/7d9169c971614314a5ffd5eeed42abbb => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:20.214499 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0348dea-013d-4e3d-821b-93946d147754 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:20.214779 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0348dea-013d-4e3d-821b-93946d147754 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:20.215074 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0348dea-013d-4e3d-821b-93946d147754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:20.232934 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-f0348dea-013d-4e3d-821b-93946d147754 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:20.234367 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-f0348dea-013d-4e3d-821b-93946d147754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:20.311818 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 904/1800] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:20.319759 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d281ce-da39-4523-ac6c-5e5ae9688e8f None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:20.320037 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d281ce-da39-4523-ac6c-5e5ae9688e8f None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:20.320307 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d281ce-da39-4523-ac6c-5e5ae9688e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:20.339751 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-a3d281ce-da39-4523-ac6c-5e5ae9688e8f None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:20.341137 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-a3d281ce-da39-4523-ac6c-5e5ae9688e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:20.352339 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 897/1801] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:20.356425 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0348dea-013d-4e3d-821b-93946d147754 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:20.366235 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0348dea-013d-4e3d-821b-93946d147754 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:20.371642 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e6f314-874f-4c3d-a151-ae6110d11fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:20.372564 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6f314-874f-4c3d-a151-ae6110d11fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:20.372564 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6f314-874f-4c3d-a151-ae6110d11fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:20.372849 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6f314-874f-4c3d-a151-ae6110d11fe7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:20.373600 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e6f314-874f-4c3d-a151-ae6110d11fe7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:18:20.374059 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e6f314-874f-4c3d-a151-ae6110d11fe7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:20.375670 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e6f314-874f-4c3d-a151-ae6110d11fe7 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:20.390138 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 905/1802] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 17 18:18:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:18:20.395129 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d281ce-da39-4523-ac6c-5e5ae9688e8f None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:20.404958 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d281ce-da39-4523-ac6c-5e5ae9688e8f None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:20.410637 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417fa9df-93b8-421e-8c76-b553298ee4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:20.411307 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417fa9df-93b8-421e-8c76-b553298ee4dd admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:20.411664 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417fa9df-93b8-421e-8c76-b553298ee4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:20.411907 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417fa9df-93b8-421e-8c76-b553298ee4dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:20.412891 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417fa9df-93b8-421e-8c76-b553298ee4dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:20.415026 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417fa9df-93b8-421e-8c76-b553298ee4dd admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:20.442987 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e6f314-874f-4c3d-a151-ae6110d11fe7 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:20.444948 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-b2e6f314-874f-4c3d-a151-ae6110d11fe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:20.453494 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 898/1803] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:18:20 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:18:20.457571 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417fa9df-93b8-421e-8c76-b553298ee4dd admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:20.482005 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e6f314-874f-4c3d-a151-ae6110d11fe7 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:20.550533 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417fa9df-93b8-421e-8c76-b553298ee4dd admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:20.557982 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705f83cb-d8bb-4931-b997-8b0391643ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:20.558825 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705f83cb-d8bb-4931-b997-8b0391643ecd admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:20.559478 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705f83cb-d8bb-4931-b997-8b0391643ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:20.559909 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705f83cb-d8bb-4931-b997-8b0391643ecd admin admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:20.560795 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705f83cb-d8bb-4931-b997-8b0391643ecd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:20.562881 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705f83cb-d8bb-4931-b997-8b0391643ecd admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:20.576308 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6601e37-5dc7-4bc2-b39b-e07721d2f384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:20.577428 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6601e37-5dc7-4bc2-b39b-e07721d2f384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:20.577852 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6601e37-5dc7-4bc2-b39b-e07721d2f384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:20.578157 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6601e37-5dc7-4bc2-b39b-e07721d2f384 admin admin] PATH_INFO: `/v3/projects/8583f62e67e042b2b226e6f94e6c54a3` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:20.579582 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6601e37-5dc7-4bc2-b39b-e07721d2f384 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8583f62e67e042b2b226e6f94e6c54a3)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:20.581649 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6601e37-5dc7-4bc2-b39b-e07721d2f384 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:20.596375 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 899/1804] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:18:20 2022] POST /identity/v3/users => generated 292 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:18:20.600253 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705f83cb-d8bb-4931-b997-8b0391643ecd admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:20.612540 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705f83cb-d8bb-4931-b997-8b0391643ecd admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:20.618949 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89faf31e-b465-44ad-8c81-4d766e7984d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:20.620116 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89faf31e-b465-44ad-8c81-4d766e7984d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:20.620407 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89faf31e-b465-44ad-8c81-4d766e7984d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:20.620727 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89faf31e-b465-44ad-8c81-4d766e7984d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:20.621745 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89faf31e-b465-44ad-8c81-4d766e7984d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:20.623062 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89faf31e-b465-44ad-8c81-4d766e7984d5 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:20.639454 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 900/1805] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:18:20 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:18:20.642116 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-f6601e37-5dc7-4bc2-b39b-e07721d2f384 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8583f62e67e042b2b226e6f94e6c54a3', 'request_id': 'req-f6601e37-5dc7-4bc2-b39b-e07721d2f384'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:20.647143 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89faf31e-b465-44ad-8c81-4d766e7984d5 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:20.650544 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-f6601e37-5dc7-4bc2-b39b-e07721d2f384 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8583f62e67e042b2b226e6f94e6c54a3', 'request_id': 'req-f6601e37-5dc7-4bc2-b39b-e07721d2f384'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:20.659829 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89faf31e-b465-44ad-8c81-4d766e7984d5 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:20.661516 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-f6601e37-5dc7-4bc2-b39b-e07721d2f384 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8583f62e67e042b2b226e6f94e6c54a3', 'request_id': 'req-f6601e37-5dc7-4bc2-b39b-e07721d2f384'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:20.674633 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-f6601e37-5dc7-4bc2-b39b-e07721d2f384 admin admin] The token cache is being invalidate because project 8583f62e67e042b2b226e6f94e6c54a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:18:20.674942 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-f6601e37-5dc7-4bc2-b39b-e07721d2f384 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:20.675670 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-f6601e37-5dc7-4bc2-b39b-e07721d2f384 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:20.680684 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 906/1806] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:18:20 2022] DELETE /identity/v3/projects/8583f62e67e042b2b226e6f94e6c54a3 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:18:20.682700 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6601e37-5dc7-4bc2-b39b-e07721d2f384 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:20.684231 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-f6601e37-5dc7-4bc2-b39b-e07721d2f384 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:20.728362 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859776b3-5be7-4e3d-bf2f-869e4a8b6c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:20.729047 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859776b3-5be7-4e3d-bf2f-869e4a8b6c69 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:20.729332 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859776b3-5be7-4e3d-bf2f-869e4a8b6c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:20.729762 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859776b3-5be7-4e3d-bf2f-869e4a8b6c69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:20.730519 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859776b3-5be7-4e3d-bf2f-869e4a8b6c69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:20.732166 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859776b3-5be7-4e3d-bf2f-869e4a8b6c69 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:20.750010 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 901/1807] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:18:20 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:18:20.753924 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859776b3-5be7-4e3d-bf2f-869e4a8b6c69 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:20.755855 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-859776b3-5be7-4e3d-bf2f-869e4a8b6c69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:20.767419 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6601e37-5dc7-4bc2-b39b-e07721d2f384 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:20.770994 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859776b3-5be7-4e3d-bf2f-869e4a8b6c69 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:20.772341 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33963099-b2b5-4fd5-9084-0c3f2af23200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:20.773525 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33963099-b2b5-4fd5-9084-0c3f2af23200 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:20.773766 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33963099-b2b5-4fd5-9084-0c3f2af23200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:20.774045 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33963099-b2b5-4fd5-9084-0c3f2af23200 admin admin] PATH_INFO: `/v3/users/05e9011594a541059b935310f885982d` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:20.776231 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33963099-b2b5-4fd5-9084-0c3f2af23200 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05e9011594a541059b935310f885982d)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:20.777747 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33963099-b2b5-4fd5-9084-0c3f2af23200 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:20.779003 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b03e134-1b2c-49f4-9d9a-87752c3f12ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:20.781220 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03e134-1b2c-49f4-9d9a-87752c3f12ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:20.781771 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03e134-1b2c-49f4-9d9a-87752c3f12ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:20.782031 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03e134-1b2c-49f4-9d9a-87752c3f12ee admin admin] PATH_INFO: `/v3/projects/8396ba094cdb4dfc9c4c8dae5cafa76c/users/0a8aad2460b64dada2e93e5cdc997767/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:20.807692 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b03e134-1b2c-49f4-9d9a-87752c3f12ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=8396ba094cdb4dfc9c4c8dae5cafa76c, user_id=0a8aad2460b64dada2e93e5cdc997767, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:20.811848 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b03e134-1b2c-49f4-9d9a-87752c3f12ee admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:20.832945 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 902/1808] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:18:20 2022] PUT /identity/v3/projects/8396ba094cdb4dfc9c4c8dae5cafa76c/users/0a8aad2460b64dada2e93e5cdc997767/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:18:20.842349 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-33963099-b2b5-4fd5-9084-0c3f2af23200 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05e9011594a541059b935310f885982d'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:20.842605 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8bf62-7406-4df9-9d0c-7775675bff04 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:20.843011 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8bf62-7406-4df9-9d0c-7775675bff04 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:20.843291 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec8bf62-7406-4df9-9d0c-7775675bff04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:20.855945 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-33963099-b2b5-4fd5-9084-0c3f2af23200 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05e9011594a541059b935310f885982d'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:20.856748 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-33963099-b2b5-4fd5-9084-0c3f2af23200 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05e9011594a541059b935310f885982d'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:20.857440 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-33963099-b2b5-4fd5-9084-0c3f2af23200 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05e9011594a541059b935310f885982d'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:20.866182 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-33963099-b2b5-4fd5-9084-0c3f2af23200 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05e9011594a541059b935310f885982d'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:20.871083 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-fec8bf62-7406-4df9-9d0c-7775675bff04 None None] MFA Rules not processed for user `0a8aad2460b64dada2e93e5cdc997767`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:20.872434 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-fec8bf62-7406-4df9-9d0c-7775675bff04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:20.881421 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 907/1809] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:18:20 2022] DELETE /identity/v3/users/05e9011594a541059b935310f885982d => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:18:20.949640 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 903/1810] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:18:20.961112 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33963099-b2b5-4fd5-9084-0c3f2af23200 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:20.963115 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-33963099-b2b5-4fd5-9084-0c3f2af23200 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:21.028674 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33963099-b2b5-4fd5-9084-0c3f2af23200 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:21.042117 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b973cd4-c3af-4653-be91-a373ce6bf58a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:21.043106 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b973cd4-c3af-4653-be91-a373ce6bf58a service cinder] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:21.043304 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b973cd4-c3af-4653-be91-a373ce6bf58a service cinder] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:21.043586 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b973cd4-c3af-4653-be91-a373ce6bf58a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:21.113488 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b973cd4-c3af-4653-be91-a373ce6bf58a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:21.115300 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b973cd4-c3af-4653-be91-a373ce6bf58a service cinder] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:21.125294 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 908/1811] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:18:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:18:21.165246 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec8bf62-7406-4df9-9d0c-7775675bff04 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:21.168005 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-fec8bf62-7406-4df9-9d0c-7775675bff04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:21.190500 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b973cd4-c3af-4653-be91-a373ce6bf58a service cinder] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:21.192199 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-7b973cd4-c3af-4653-be91-a373ce6bf58a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:21.308565 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec8bf62-7406-4df9-9d0c-7775675bff04 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:21.346252 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b973cd4-c3af-4653-be91-a373ce6bf58a service cinder] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:21.351695 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c123fac-3f9d-4876-aad9-bf6b283c6f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:21.352561 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c123fac-3f9d-4876-aad9-bf6b283c6f62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:21.352865 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c123fac-3f9d-4876-aad9-bf6b283c6f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:21.353189 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c123fac-3f9d-4876-aad9-bf6b283c6f62 admin admin] PATH_INFO: `/v3/projects/6890d77090f14a7b955d2434d93f772b` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:21.354651 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c123fac-3f9d-4876-aad9-bf6b283c6f62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6890d77090f14a7b955d2434d93f772b)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:21.356616 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c123fac-3f9d-4876-aad9-bf6b283c6f62 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:21.375767 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24267369-2a24-4151-8b3e-d32eca1e87b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:21.376676 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24267369-2a24-4151-8b3e-d32eca1e87b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:21.377011 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24267369-2a24-4151-8b3e-d32eca1e87b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:21.377314 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24267369-2a24-4151-8b3e-d32eca1e87b5 admin admin] PATH_INFO: `/v3/users/0a8aad2460b64dada2e93e5cdc997767` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:21.378806 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24267369-2a24-4151-8b3e-d32eca1e87b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a8aad2460b64dada2e93e5cdc997767)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:21.381016 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24267369-2a24-4151-8b3e-d32eca1e87b5 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:21.418006 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-1c123fac-3f9d-4876-aad9-bf6b283c6f62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6890d77090f14a7b955d2434d93f772b', 'request_id': 'req-1c123fac-3f9d-4876-aad9-bf6b283c6f62'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:21.424872 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-1c123fac-3f9d-4876-aad9-bf6b283c6f62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6890d77090f14a7b955d2434d93f772b', 'request_id': 'req-1c123fac-3f9d-4876-aad9-bf6b283c6f62'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:21.435949 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-1c123fac-3f9d-4876-aad9-bf6b283c6f62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6890d77090f14a7b955d2434d93f772b', 'request_id': 'req-1c123fac-3f9d-4876-aad9-bf6b283c6f62'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:21.444722 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-24267369-2a24-4151-8b3e-d32eca1e87b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a8aad2460b64dada2e93e5cdc997767'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:21.451818 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-24267369-2a24-4151-8b3e-d32eca1e87b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a8aad2460b64dada2e93e5cdc997767'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:21.452487 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-24267369-2a24-4151-8b3e-d32eca1e87b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a8aad2460b64dada2e93e5cdc997767'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:21.453409 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-1c123fac-3f9d-4876-aad9-bf6b283c6f62 admin admin] The token cache is being invalidate because project 6890d77090f14a7b955d2434d93f772b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:18:21.453911 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-1c123fac-3f9d-4876-aad9-bf6b283c6f62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:21.454795 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-1c123fac-3f9d-4876-aad9-bf6b283c6f62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:21.456725 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 909/1812] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:18:21 2022] DELETE /identity/v3/projects/6890d77090f14a7b955d2434d93f772b => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:21.461838 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-24267369-2a24-4151-8b3e-d32eca1e87b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a8aad2460b64dada2e93e5cdc997767'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:21.462695 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-24267369-2a24-4151-8b3e-d32eca1e87b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a8aad2460b64dada2e93e5cdc997767'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:21.462966 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77078cc-9cd9-49dd-bf64-178123fa227b None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:21.463249 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77078cc-9cd9-49dd-bf64-178123fa227b None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:21.463521 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77078cc-9cd9-49dd-bf64-178123fa227b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:21.480872 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 904/1813] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:18:21 2022] DELETE /identity/v3/users/0a8aad2460b64dada2e93e5cdc997767 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:21.483176 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-f77078cc-9cd9-49dd-bf64-178123fa227b None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:21.484355 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-f77078cc-9cd9-49dd-bf64-178123fa227b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:21.485229 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a0c09-48f8-4e5f-89fa-0cd624467f8a None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:21.485552 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a0c09-48f8-4e5f-89fa-0cd624467f8a None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:21.485832 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a0c09-48f8-4e5f-89fa-0cd624467f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:21.504317 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-277a0c09-48f8-4e5f-89fa-0cd624467f8a None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:21.505533 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-277a0c09-48f8-4e5f-89fa-0cd624467f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:21.543420 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 910/1814] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:21.551708 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f84c45-7905-4c32-b2e6-95fb43582bff None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:21.552074 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f84c45-7905-4c32-b2e6-95fb43582bff None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:21.552357 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f84c45-7905-4c32-b2e6-95fb43582bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:21.564428 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 905/1815] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:18:21.570088 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-89f84c45-7905-4c32-b2e6-95fb43582bff None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:21.571281 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-89f84c45-7905-4c32-b2e6-95fb43582bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:21.576113 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a0c09-48f8-4e5f-89fa-0cd624467f8a None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:21.576432 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-277a0c09-48f8-4e5f-89fa-0cd624467f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:21.581036 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 911/1816] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:18:21.585245 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f84c45-7905-4c32-b2e6-95fb43582bff None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:21.594675 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f84c45-7905-4c32-b2e6-95fb43582bff None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:21.600584 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44569b16-db1a-4c4b-93e1-1522a0dd022d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:21.601241 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44569b16-db1a-4c4b-93e1-1522a0dd022d admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:21.601559 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44569b16-db1a-4c4b-93e1-1522a0dd022d admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:21.601837 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44569b16-db1a-4c4b-93e1-1522a0dd022d admin admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:21.602562 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44569b16-db1a-4c4b-93e1-1522a0dd022d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:18:21.602562 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44569b16-db1a-4c4b-93e1-1522a0dd022d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:21.605943 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44569b16-db1a-4c4b-93e1-1522a0dd022d admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:21.622389 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 912/1817] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 17 18:18:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:18:21.623264 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44569b16-db1a-4c4b-93e1-1522a0dd022d admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:21.633540 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44569b16-db1a-4c4b-93e1-1522a0dd022d admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:21.634023 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a0c09-48f8-4e5f-89fa-0cd624467f8a None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:21.637810 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf02cc7-c1e3-4108-abbf-19d97b05aeb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:21.638280 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcdff65-640c-4447-8c0c-1c35d0e83632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:21.638510 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf02cc7-c1e3-4108-abbf-19d97b05aeb9 service neutron] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:21.638796 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf02cc7-c1e3-4108-abbf-19d97b05aeb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:21.638968 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcdff65-640c-4447-8c0c-1c35d0e83632 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:21.639063 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf02cc7-c1e3-4108-abbf-19d97b05aeb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:21.639215 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcdff65-640c-4447-8c0c-1c35d0e83632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:21.639462 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcdff65-640c-4447-8c0c-1c35d0e83632 admin admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:21.640147 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcdff65-640c-4447-8c0c-1c35d0e83632 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:21.642053 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcdff65-640c-4447-8c0c-1c35d0e83632 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:21.648466 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf02cc7-c1e3-4108-abbf-19d97b05aeb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:21.650571 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf02cc7-c1e3-4108-abbf-19d97b05aeb9 service neutron] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:21.660418 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 906/1818] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:18:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:18:21.673554 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 913/1819] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:18:21 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:18:21.675145 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf02cc7-c1e3-4108-abbf-19d97b05aeb9 service neutron] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:21.684848 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf02cc7-c1e3-4108-abbf-19d97b05aeb9 service neutron] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:21.743885 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b35709-bc2a-4116-b619-d6c46d802e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:21.744553 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b35709-bc2a-4116-b619-d6c46d802e26 admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:21.744831 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b35709-bc2a-4116-b619-d6c46d802e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:21.745114 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b35709-bc2a-4116-b619-d6c46d802e26 admin admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:21.745879 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b35709-bc2a-4116-b619-d6c46d802e26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:21.748044 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b35709-bc2a-4116-b619-d6c46d802e26 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:21.771423 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 907/1820] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:18:21 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:18:21.778572 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcdff65-640c-4447-8c0c-1c35d0e83632 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:21.793592 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcdff65-640c-4447-8c0c-1c35d0e83632 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:21.800407 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b5203-1b9c-4da0-87c8-4bbf8b10d2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:21.801045 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b5203-1b9c-4da0-87c8-4bbf8b10d2fd admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:21.801332 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b5203-1b9c-4da0-87c8-4bbf8b10d2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:21.801644 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00b5203-1b9c-4da0-87c8-4bbf8b10d2fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:21.802961 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b5203-1b9c-4da0-87c8-4bbf8b10d2fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:21.804558 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00b5203-1b9c-4da0-87c8-4bbf8b10d2fd admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:21.818739 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 914/1821] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:18:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:18:21.820444 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b35709-bc2a-4116-b619-d6c46d802e26 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:21.832618 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b35709-bc2a-4116-b619-d6c46d802e26 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:21.839622 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9dc0a4-2ad5-4bc1-b2aa-9a324cc02350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:21.840392 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9dc0a4-2ad5-4bc1-b2aa-9a324cc02350 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:21.841324 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9dc0a4-2ad5-4bc1-b2aa-9a324cc02350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:21.841687 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9dc0a4-2ad5-4bc1-b2aa-9a324cc02350 admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:21.842430 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9dc0a4-2ad5-4bc1-b2aa-9a324cc02350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:21.844321 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9dc0a4-2ad5-4bc1-b2aa-9a324cc02350 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:21.859778 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 908/1822] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:18:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:18:21.862000 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b5203-1b9c-4da0-87c8-4bbf8b10d2fd admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:21.880831 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00b5203-1b9c-4da0-87c8-4bbf8b10d2fd admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:21.897989 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19a517a-28ab-4f34-a889-15b10ff5db83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:21.899324 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a517a-28ab-4f34-a889-15b10ff5db83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:21.900341 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a517a-28ab-4f34-a889-15b10ff5db83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:21.900621 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a517a-28ab-4f34-a889-15b10ff5db83 admin admin] PATH_INFO: `/v3/projects/7e72a2bea51745fdbc740cda45805563/users/d09af0915f0044d0b5bb60a3f5673056/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:21.919370 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19a517a-28ab-4f34-a889-15b10ff5db83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e72a2bea51745fdbc740cda45805563, user_id=d09af0915f0044d0b5bb60a3f5673056, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:21.922125 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19a517a-28ab-4f34-a889-15b10ff5db83 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:21.937783 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 915/1823] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:18:21 2022] PUT /identity/v3/projects/7e72a2bea51745fdbc740cda45805563/users/d09af0915f0044d0b5bb60a3f5673056/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:18:21.956462 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb54fd3-216c-4bd7-8608-eb77affd76a0 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:21.956766 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb54fd3-216c-4bd7-8608-eb77affd76a0 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:21.957485 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb54fd3-216c-4bd7-8608-eb77affd76a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:21.985379 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-efb54fd3-216c-4bd7-8608-eb77affd76a0 None None] MFA Rules not processed for user `d09af0915f0044d0b5bb60a3f5673056`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:21.986624 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-efb54fd3-216c-4bd7-8608-eb77affd76a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:22.050557 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 909/1824] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:22.062673 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19a517a-28ab-4f34-a889-15b10ff5db83 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:22.064553 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-b19a517a-28ab-4f34-a889-15b10ff5db83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:22.096952 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb54fd3-216c-4bd7-8608-eb77affd76a0 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:22.098535 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-efb54fd3-216c-4bd7-8608-eb77affd76a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:22.132657 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19a517a-28ab-4f34-a889-15b10ff5db83 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:22.136815 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f873d4-9d5a-41c8-ac6a-a471dca9f293 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:22.137482 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f873d4-9d5a-41c8-ac6a-a471dca9f293 service cinder] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:22.137759 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f873d4-9d5a-41c8-ac6a-a471dca9f293 service cinder] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:22.138033 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f873d4-9d5a-41c8-ac6a-a471dca9f293 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:22.146124 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f873d4-9d5a-41c8-ac6a-a471dca9f293 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:22.147546 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f873d4-9d5a-41c8-ac6a-a471dca9f293 service cinder] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:22.156834 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 916/1825] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:18:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:18:22.166067 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb54fd3-216c-4bd7-8608-eb77affd76a0 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:22.170843 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a89ad2-94ee-4987-bbc6-6d7c4a08add0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:22.171621 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a89ad2-94ee-4987-bbc6-6d7c4a08add0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:22.171893 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a89ad2-94ee-4987-bbc6-6d7c4a08add0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:22.172158 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a89ad2-94ee-4987-bbc6-6d7c4a08add0 admin admin] PATH_INFO: `/v3/projects/8396ba094cdb4dfc9c4c8dae5cafa76c` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:22.173328 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a89ad2-94ee-4987-bbc6-6d7c4a08add0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8396ba094cdb4dfc9c4c8dae5cafa76c)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:22.175238 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a89ad2-94ee-4987-bbc6-6d7c4a08add0 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:22.223915 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-46a89ad2-94ee-4987-bbc6-6d7c4a08add0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8396ba094cdb4dfc9c4c8dae5cafa76c', 'request_id': 'req-46a89ad2-94ee-4987-bbc6-6d7c4a08add0'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:22.230204 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-46a89ad2-94ee-4987-bbc6-6d7c4a08add0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8396ba094cdb4dfc9c4c8dae5cafa76c', 'request_id': 'req-46a89ad2-94ee-4987-bbc6-6d7c4a08add0'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:22.237481 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-46a89ad2-94ee-4987-bbc6-6d7c4a08add0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8396ba094cdb4dfc9c4c8dae5cafa76c', 'request_id': 'req-46a89ad2-94ee-4987-bbc6-6d7c4a08add0'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:22.248250 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-46a89ad2-94ee-4987-bbc6-6d7c4a08add0 admin admin] The token cache is being invalidate because project 8396ba094cdb4dfc9c4c8dae5cafa76c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:18:22.248614 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-46a89ad2-94ee-4987-bbc6-6d7c4a08add0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:22.249275 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-46a89ad2-94ee-4987-bbc6-6d7c4a08add0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:22.250889 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 910/1826] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:18:22 2022] DELETE /identity/v3/projects/8396ba094cdb4dfc9c4c8dae5cafa76c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:18:22.255788 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb20504-a516-4800-aee9-3cf206de5bc3 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:22.256074 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb20504-a516-4800-aee9-3cf206de5bc3 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:22.256350 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb20504-a516-4800-aee9-3cf206de5bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:22.274225 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-ddb20504-a516-4800-aee9-3cf206de5bc3 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:22.275906 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-ddb20504-a516-4800-aee9-3cf206de5bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:22.340018 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 917/1827] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:22.349021 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19726921-4cc5-4d24-91d2-fbe4a6ef06f0 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:22.349308 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19726921-4cc5-4d24-91d2-fbe4a6ef06f0 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:22.349620 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19726921-4cc5-4d24-91d2-fbe4a6ef06f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:22.369361 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-19726921-4cc5-4d24-91d2-fbe4a6ef06f0 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:22.370693 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-19726921-4cc5-4d24-91d2-fbe4a6ef06f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:22.382576 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 911/1828] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:22.388478 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb20504-a516-4800-aee9-3cf206de5bc3 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:22.400616 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb20504-a516-4800-aee9-3cf206de5bc3 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:22.409889 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab836b6f-aefc-42a4-b539-761375342844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:22.410674 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab836b6f-aefc-42a4-b539-761375342844 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:22.410961 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab836b6f-aefc-42a4-b539-761375342844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:22.411237 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab836b6f-aefc-42a4-b539-761375342844 admin admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:22.412399 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab836b6f-aefc-42a4-b539-761375342844 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:18:22.412399 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab836b6f-aefc-42a4-b539-761375342844 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:22.414116 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab836b6f-aefc-42a4-b539-761375342844 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:22.430592 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 918/1829] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 17 18:18:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:18:22.437491 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19726921-4cc5-4d24-91d2-fbe4a6ef06f0 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:22.450274 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19726921-4cc5-4d24-91d2-fbe4a6ef06f0 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:22.461855 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b256b-254e-4cf4-8c73-38bc1721a3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:22.463071 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b256b-254e-4cf4-8c73-38bc1721a3c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:22.463350 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b256b-254e-4cf4-8c73-38bc1721a3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:22.463623 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b256b-254e-4cf4-8c73-38bc1721a3c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:22.464320 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b256b-254e-4cf4-8c73-38bc1721a3c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:22.466287 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b256b-254e-4cf4-8c73-38bc1721a3c7 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:22.543321 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 912/1830] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:18:22 2022] POST /identity/v3/projects => generated 371 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:18:22.548487 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab836b6f-aefc-42a4-b539-761375342844 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:22.561314 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab836b6f-aefc-42a4-b539-761375342844 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:22.630922 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a83e925-7b94-4461-8774-b63f60fb9524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:22.631589 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83e925-7b94-4461-8774-b63f60fb9524 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:22.631867 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83e925-7b94-4461-8774-b63f60fb9524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:22.632160 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83e925-7b94-4461-8774-b63f60fb9524 admin admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:22.632843 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a83e925-7b94-4461-8774-b63f60fb9524 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:22.635477 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a83e925-7b94-4461-8774-b63f60fb9524 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:22.655837 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 919/1831] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:18:22 2022] POST /identity/v3/users => generated 286 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:18:22.659909 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b256b-254e-4cf4-8c73-38bc1721a3c7 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:22.670669 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b256b-254e-4cf4-8c73-38bc1721a3c7 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:22.675552 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee5d30-a3d5-4e92-8b0e-61029580cb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:22.676300 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee5d30-a3d5-4e92-8b0e-61029580cb40 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:22.676646 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee5d30-a3d5-4e92-8b0e-61029580cb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:22.677012 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee5d30-a3d5-4e92-8b0e-61029580cb40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:22.677934 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eee5d30-a3d5-4e92-8b0e-61029580cb40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:22.679614 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eee5d30-a3d5-4e92-8b0e-61029580cb40 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:22.690925 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 913/1832] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:18:22.694736 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a83e925-7b94-4461-8774-b63f60fb9524 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:22.705291 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a83e925-7b94-4461-8774-b63f60fb9524 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:22.710407 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7758cb7f-fa6f-428d-88d9-709cff441486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:22.711065 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758cb7f-fa6f-428d-88d9-709cff441486 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:22.711344 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758cb7f-fa6f-428d-88d9-709cff441486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:22.711618 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7758cb7f-fa6f-428d-88d9-709cff441486 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:22.712412 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7758cb7f-fa6f-428d-88d9-709cff441486 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:22.714055 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7758cb7f-fa6f-428d-88d9-709cff441486 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:22.724384 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 920/1833] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:18:22.729298 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee5d30-a3d5-4e92-8b0e-61029580cb40 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:22.746391 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee5d30-a3d5-4e92-8b0e-61029580cb40 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:22.751291 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f9ac5-22c7-4787-8342-e2690709ffa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:22.752169 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f9ac5-22c7-4787-8342-e2690709ffa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:22.752451 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f9ac5-22c7-4787-8342-e2690709ffa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:22.752732 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f9ac5-22c7-4787-8342-e2690709ffa0 admin admin] PATH_INFO: `/v3/projects/ce842c58cc3d4c699713368379bd7d46/users/f548cb1ac7bd4feabc51aff38c7f7cb2/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:22.767666 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f9ac5-22c7-4787-8342-e2690709ffa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce842c58cc3d4c699713368379bd7d46, user_id=f548cb1ac7bd4feabc51aff38c7f7cb2, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:22.770333 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f9ac5-22c7-4787-8342-e2690709ffa0 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:22.783525 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 914/1834] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:18:22 2022] PUT /identity/v3/projects/ce842c58cc3d4c699713368379bd7d46/users/f548cb1ac7bd4feabc51aff38c7f7cb2/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:22.793836 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676bf8b7-de39-4e92-b022-a1649266ad43 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:22.794127 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676bf8b7-de39-4e92-b022-a1649266ad43 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:22.794499 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676bf8b7-de39-4e92-b022-a1649266ad43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:22.820399 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-676bf8b7-de39-4e92-b022-a1649266ad43 None None] MFA Rules not processed for user `f548cb1ac7bd4feabc51aff38c7f7cb2`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:22.822198 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-676bf8b7-de39-4e92-b022-a1649266ad43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:22.887237 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 921/1835] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:22.902943 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f9ac5-22c7-4787-8342-e2690709ffa0 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:22.904619 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-975f9ac5-22c7-4787-8342-e2690709ffa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:22.960829 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f9ac5-22c7-4787-8342-e2690709ffa0 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:22.964909 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9be87b-79f8-4a8e-813d-cae4ab262bcf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:22.965576 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9be87b-79f8-4a8e-813d-cae4ab262bcf service cinder] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:22.965854 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9be87b-79f8-4a8e-813d-cae4ab262bcf service cinder] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:22.966184 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9be87b-79f8-4a8e-813d-cae4ab262bcf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:22.974373 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9be87b-79f8-4a8e-813d-cae4ab262bcf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:22.975818 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9be87b-79f8-4a8e-813d-cae4ab262bcf service cinder] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:22.984522 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 915/1836] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:18:22 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:18:23.004482 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676bf8b7-de39-4e92-b022-a1649266ad43 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:23.063941 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676bf8b7-de39-4e92-b022-a1649266ad43 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:23.068443 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c577fc-4b9f-4614-a1cf-7642ca64b651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:23.069299 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c577fc-4b9f-4614-a1cf-7642ca64b651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:23.069608 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c577fc-4b9f-4614-a1cf-7642ca64b651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:23.069880 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c577fc-4b9f-4614-a1cf-7642ca64b651 admin admin] PATH_INFO: `/v3/users/f548cb1ac7bd4feabc51aff38c7f7cb2` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:23.071193 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c577fc-4b9f-4614-a1cf-7642ca64b651 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f548cb1ac7bd4feabc51aff38c7f7cb2)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:23.073425 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c577fc-4b9f-4614-a1cf-7642ca64b651 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:23.123175 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-e4c577fc-4b9f-4614-a1cf-7642ca64b651 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f548cb1ac7bd4feabc51aff38c7f7cb2'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:23.135360 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-e4c577fc-4b9f-4614-a1cf-7642ca64b651 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f548cb1ac7bd4feabc51aff38c7f7cb2'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:23.136209 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-e4c577fc-4b9f-4614-a1cf-7642ca64b651 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f548cb1ac7bd4feabc51aff38c7f7cb2'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:23.136967 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-e4c577fc-4b9f-4614-a1cf-7642ca64b651 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f548cb1ac7bd4feabc51aff38c7f7cb2'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:23.144311 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-e4c577fc-4b9f-4614-a1cf-7642ca64b651 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f548cb1ac7bd4feabc51aff38c7f7cb2'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:23.161199 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 922/1837] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:18:23 2022] DELETE /identity/v3/users/f548cb1ac7bd4feabc51aff38c7f7cb2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:23.165941 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458372f5-4c40-43f7-ba74-0f9ee9a07f68 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:23.166227 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458372f5-4c40-43f7-ba74-0f9ee9a07f68 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:23.166758 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458372f5-4c40-43f7-ba74-0f9ee9a07f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:23.184066 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-458372f5-4c40-43f7-ba74-0f9ee9a07f68 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:23.185274 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-458372f5-4c40-43f7-ba74-0f9ee9a07f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:23.250744 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 916/1838] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:23.260177 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c577fc-4b9f-4614-a1cf-7642ca64b651 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:23.261595 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-e4c577fc-4b9f-4614-a1cf-7642ca64b651 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:23.316888 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c577fc-4b9f-4614-a1cf-7642ca64b651 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:23.320473 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f343409-845e-44ea-9c45-1b1aea5f5d4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:23.321107 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f343409-845e-44ea-9c45-1b1aea5f5d4e service neutron] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:23.321384 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f343409-845e-44ea-9c45-1b1aea5f5d4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:23.321696 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f343409-845e-44ea-9c45-1b1aea5f5d4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:23.330631 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f343409-845e-44ea-9c45-1b1aea5f5d4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:23.332053 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f343409-845e-44ea-9c45-1b1aea5f5d4e service neutron] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:23.341564 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 923/1839] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:18:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:18:23.596778 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458372f5-4c40-43f7-ba74-0f9ee9a07f68 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:23.598212 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-458372f5-4c40-43f7-ba74-0f9ee9a07f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:23.612416 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458372f5-4c40-43f7-ba74-0f9ee9a07f68 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:23.619731 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b71612-a597-4595-9585-7e5a3cec8579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:23.620597 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b71612-a597-4595-9585-7e5a3cec8579 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:23.620872 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b71612-a597-4595-9585-7e5a3cec8579 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:23.621278 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b71612-a597-4595-9585-7e5a3cec8579 admin admin] PATH_INFO: `/v3/projects/ce842c58cc3d4c699713368379bd7d46` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:23.622366 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b71612-a597-4595-9585-7e5a3cec8579 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce842c58cc3d4c699713368379bd7d46)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:23.624269 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b71612-a597-4595-9585-7e5a3cec8579 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:23.676282 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-80b71612-a597-4595-9585-7e5a3cec8579 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce842c58cc3d4c699713368379bd7d46', 'request_id': 'req-80b71612-a597-4595-9585-7e5a3cec8579'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:23.683124 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-80b71612-a597-4595-9585-7e5a3cec8579 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce842c58cc3d4c699713368379bd7d46', 'request_id': 'req-80b71612-a597-4595-9585-7e5a3cec8579'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:23.689841 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-80b71612-a597-4595-9585-7e5a3cec8579 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce842c58cc3d4c699713368379bd7d46', 'request_id': 'req-80b71612-a597-4595-9585-7e5a3cec8579'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:23.700988 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-80b71612-a597-4595-9585-7e5a3cec8579 admin admin] The token cache is being invalidate because project ce842c58cc3d4c699713368379bd7d46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:18:23.701271 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-80b71612-a597-4595-9585-7e5a3cec8579 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:23.701937 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-80b71612-a597-4595-9585-7e5a3cec8579 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:23.703490 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 917/1840] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:18:23 2022] DELETE /identity/v3/projects/ce842c58cc3d4c699713368379bd7d46 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:23.710124 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed03756-e6f3-4932-ba96-0293bdb7238c None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:23.710468 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed03756-e6f3-4932-ba96-0293bdb7238c None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:23.710699 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed03756-e6f3-4932-ba96-0293bdb7238c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:23.733523 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-9ed03756-e6f3-4932-ba96-0293bdb7238c None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:23.734912 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-9ed03756-e6f3-4932-ba96-0293bdb7238c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:23.804758 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 924/1841] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:23.813067 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db797323-8c9a-4643-a661-f6ed59364ea2 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:23.813358 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db797323-8c9a-4643-a661-f6ed59364ea2 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:23.813683 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db797323-8c9a-4643-a661-f6ed59364ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:23.832769 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-db797323-8c9a-4643-a661-f6ed59364ea2 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:23.834545 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-db797323-8c9a-4643-a661-f6ed59364ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:23.842324 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 918/1842] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:23.846794 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed03756-e6f3-4932-ba96-0293bdb7238c None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:23.856712 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed03756-e6f3-4932-ba96-0293bdb7238c None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:23.861415 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b96d7-8f91-4404-9d30-8aab62ec420e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:23.862098 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b96d7-8f91-4404-9d30-8aab62ec420e admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:23.862379 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b96d7-8f91-4404-9d30-8aab62ec420e admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:23.862655 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b96d7-8f91-4404-9d30-8aab62ec420e admin admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:23.863407 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6b96d7-8f91-4404-9d30-8aab62ec420e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:18:23.863714 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6b96d7-8f91-4404-9d30-8aab62ec420e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:23.865309 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6b96d7-8f91-4404-9d30-8aab62ec420e admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:23.877620 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 925/1843] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 17 18:18:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:18:23.881829 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db797323-8c9a-4643-a661-f6ed59364ea2 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:23.891193 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db797323-8c9a-4643-a661-f6ed59364ea2 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:23.898216 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29b181-7134-4574-88a2-0edbffc27612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:23.898890 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29b181-7134-4574-88a2-0edbffc27612 admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:23.899170 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29b181-7134-4574-88a2-0edbffc27612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:23.899966 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29b181-7134-4574-88a2-0edbffc27612 admin admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:23.900699 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf29b181-7134-4574-88a2-0edbffc27612 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:23.902702 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf29b181-7134-4574-88a2-0edbffc27612 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:23.932141 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 919/1844] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:18:23 2022] POST /identity/v3/projects => generated 359 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:18:23.933611 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b96d7-8f91-4404-9d30-8aab62ec420e admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:23.943387 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b96d7-8f91-4404-9d30-8aab62ec420e admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:24.000098 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a6215-6fa0-4509-a78c-9db4abc67121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:24.000766 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a6215-6fa0-4509-a78c-9db4abc67121 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:24.001040 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a6215-6fa0-4509-a78c-9db4abc67121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:24.001308 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a6215-6fa0-4509-a78c-9db4abc67121 admin admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:24.002033 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a6215-6fa0-4509-a78c-9db4abc67121 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:24.003914 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a6215-6fa0-4509-a78c-9db4abc67121 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:24.023363 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 926/1845] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:18:23 2022] POST /identity/v3/users => generated 280 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:18:24.027774 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29b181-7134-4574-88a2-0edbffc27612 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:24.043655 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29b181-7134-4574-88a2-0edbffc27612 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:24.048431 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a6b18-80ad-4991-bc4c-f39c76ddff3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:24.048955 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a6b18-80ad-4991-bc4c-f39c76ddff3c admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:24.049232 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a6b18-80ad-4991-bc4c-f39c76ddff3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:24.049916 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036a6b18-80ad-4991-bc4c-f39c76ddff3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:24.050252 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036a6b18-80ad-4991-bc4c-f39c76ddff3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:24.051830 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036a6b18-80ad-4991-bc4c-f39c76ddff3c admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:24.062895 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 920/1846] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:18:24.066541 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a6215-6fa0-4509-a78c-9db4abc67121 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:24.077131 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a6215-6fa0-4509-a78c-9db4abc67121 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:24.081725 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d48dd7-f75a-4aec-a1dd-72ec182e8d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:24.082456 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d48dd7-f75a-4aec-a1dd-72ec182e8d22 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:24.082834 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d48dd7-f75a-4aec-a1dd-72ec182e8d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:24.083116 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d48dd7-f75a-4aec-a1dd-72ec182e8d22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:24.083882 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d48dd7-f75a-4aec-a1dd-72ec182e8d22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:24.085523 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d48dd7-f75a-4aec-a1dd-72ec182e8d22 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:24.095767 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 927/1847] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:18:24.099889 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a6b18-80ad-4991-bc4c-f39c76ddff3c admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:24.110557 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036a6b18-80ad-4991-bc4c-f39c76ddff3c admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:24.115280 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e642d-e9df-46ca-9bdb-500866c72027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:24.116169 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e642d-e9df-46ca-9bdb-500866c72027 admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:24.116446 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e642d-e9df-46ca-9bdb-500866c72027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:24.116719 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e642d-e9df-46ca-9bdb-500866c72027 admin admin] PATH_INFO: `/v3/projects/844b92b949b54200978e2edc0c78c109/users/9ceb5c5311954e558b798043e2a26ddb/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:24.131835 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1e642d-e9df-46ca-9bdb-500866c72027 admin admin] RBAC: Authorizing `identity:create_grant(project_id=844b92b949b54200978e2edc0c78c109, user_id=9ceb5c5311954e558b798043e2a26ddb, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:24.135094 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1e642d-e9df-46ca-9bdb-500866c72027 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:24.150939 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 921/1848] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:18:24 2022] PUT /identity/v3/projects/844b92b949b54200978e2edc0c78c109/users/9ceb5c5311954e558b798043e2a26ddb/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:24.162475 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497cf19-425d-4d66-a4fb-a4b3524c95a6 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:24.162858 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497cf19-425d-4d66-a4fb-a4b3524c95a6 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:24.163201 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9497cf19-425d-4d66-a4fb-a4b3524c95a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:24.192146 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-9497cf19-425d-4d66-a4fb-a4b3524c95a6 None None] MFA Rules not processed for user `9ceb5c5311954e558b798043e2a26ddb`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:24.193380 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-9497cf19-425d-4d66-a4fb-a4b3524c95a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:24.261878 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 928/1849] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:24 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:24.296070 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e642d-e9df-46ca-9bdb-500866c72027 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:24.297894 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-2f1e642d-e9df-46ca-9bdb-500866c72027 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:24.354975 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e642d-e9df-46ca-9bdb-500866c72027 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:24.358550 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8863a2-ecb6-452e-bf3a-882a3607b312 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:24.359186 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8863a2-ecb6-452e-bf3a-882a3607b312 service cinder] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:24.359462 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8863a2-ecb6-452e-bf3a-882a3607b312 service cinder] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:24.359733 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8863a2-ecb6-452e-bf3a-882a3607b312 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:24.367794 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8863a2-ecb6-452e-bf3a-882a3607b312 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:24.369240 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8863a2-ecb6-452e-bf3a-882a3607b312 service cinder] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:24.378376 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 922/1850] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:18:24 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:18:24.392112 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9497cf19-425d-4d66-a4fb-a4b3524c95a6 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:24.452091 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9497cf19-425d-4d66-a4fb-a4b3524c95a6 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:24.456685 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4273870-a525-4dd9-ba50-6fc7158f087d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:24.457580 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4273870-a525-4dd9-ba50-6fc7158f087d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:24.457860 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4273870-a525-4dd9-ba50-6fc7158f087d admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:24.458134 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4273870-a525-4dd9-ba50-6fc7158f087d admin admin] PATH_INFO: `/v3/users/9ceb5c5311954e558b798043e2a26ddb` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:24.459364 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4273870-a525-4dd9-ba50-6fc7158f087d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ceb5c5311954e558b798043e2a26ddb)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:24.461285 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4273870-a525-4dd9-ba50-6fc7158f087d admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:24.507403 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-c4273870-a525-4dd9-ba50-6fc7158f087d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ceb5c5311954e558b798043e2a26ddb'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:24.519379 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-c4273870-a525-4dd9-ba50-6fc7158f087d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ceb5c5311954e558b798043e2a26ddb'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:24.520040 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-c4273870-a525-4dd9-ba50-6fc7158f087d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ceb5c5311954e558b798043e2a26ddb'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:24.520665 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-c4273870-a525-4dd9-ba50-6fc7158f087d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ceb5c5311954e558b798043e2a26ddb'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:24.527617 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-c4273870-a525-4dd9-ba50-6fc7158f087d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ceb5c5311954e558b798043e2a26ddb'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:24.539791 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 929/1851] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:18:24 2022] DELETE /identity/v3/users/9ceb5c5311954e558b798043e2a26ddb => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:24.544407 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fe9cd-c41c-466b-b49c-403549c42833 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:24.544696 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fe9cd-c41c-466b-b49c-403549c42833 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:24.544972 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14fe9cd-c41c-466b-b49c-403549c42833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:24.562077 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-f14fe9cd-c41c-466b-b49c-403549c42833 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:24.563323 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-f14fe9cd-c41c-466b-b49c-403549c42833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:24.620008 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 923/1852] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:18:24.629259 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4273870-a525-4dd9-ba50-6fc7158f087d admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:24.630666 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-c4273870-a525-4dd9-ba50-6fc7158f087d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:24.688185 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4273870-a525-4dd9-ba50-6fc7158f087d admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:24.691767 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484db3f4-8e5b-47e6-be3c-d1f01cf68a83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:24.692398 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484db3f4-8e5b-47e6-be3c-d1f01cf68a83 service neutron] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:24.692671 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484db3f4-8e5b-47e6-be3c-d1f01cf68a83 service neutron] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:24.692938 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484db3f4-8e5b-47e6-be3c-d1f01cf68a83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:24.702491 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484db3f4-8e5b-47e6-be3c-d1f01cf68a83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:24.703905 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484db3f4-8e5b-47e6-be3c-d1f01cf68a83 service neutron] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:24.713583 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 930/1853] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:18:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:18:25.168023 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14fe9cd-c41c-466b-b49c-403549c42833 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:25.169593 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-f14fe9cd-c41c-466b-b49c-403549c42833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:25.187097 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14fe9cd-c41c-466b-b49c-403549c42833 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:25.191852 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee625893-4ef2-4b62-bc31-08fc601077b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:25.192722 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee625893-4ef2-4b62-bc31-08fc601077b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:25.192995 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee625893-4ef2-4b62-bc31-08fc601077b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:25.193270 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee625893-4ef2-4b62-bc31-08fc601077b7 admin admin] PATH_INFO: `/v3/projects/844b92b949b54200978e2edc0c78c109` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:25.194517 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee625893-4ef2-4b62-bc31-08fc601077b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=844b92b949b54200978e2edc0c78c109)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:25.196458 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee625893-4ef2-4b62-bc31-08fc601077b7 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:25.247831 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-ee625893-4ef2-4b62-bc31-08fc601077b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '844b92b949b54200978e2edc0c78c109', 'request_id': 'req-ee625893-4ef2-4b62-bc31-08fc601077b7'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:25.254545 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-ee625893-4ef2-4b62-bc31-08fc601077b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '844b92b949b54200978e2edc0c78c109', 'request_id': 'req-ee625893-4ef2-4b62-bc31-08fc601077b7'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:25.262496 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-ee625893-4ef2-4b62-bc31-08fc601077b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '844b92b949b54200978e2edc0c78c109', 'request_id': 'req-ee625893-4ef2-4b62-bc31-08fc601077b7'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:25.273296 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-ee625893-4ef2-4b62-bc31-08fc601077b7 admin admin] The token cache is being invalidate because project 844b92b949b54200978e2edc0c78c109 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:18:25.273623 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-ee625893-4ef2-4b62-bc31-08fc601077b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:25.274274 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-ee625893-4ef2-4b62-bc31-08fc601077b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:25.276414 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 924/1854] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:18:25 2022] DELETE /identity/v3/projects/844b92b949b54200978e2edc0c78c109 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:25.281333 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8bdd1-f793-482a-ab70-ef5c0259450b None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:25.281827 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8bdd1-f793-482a-ab70-ef5c0259450b None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:25.281913 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8bdd1-f793-482a-ab70-ef5c0259450b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:25.300082 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-05d8bdd1-f793-482a-ab70-ef5c0259450b None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:25.301261 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-05d8bdd1-f793-482a-ab70-ef5c0259450b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:25.359390 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 931/1855] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:25.366945 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f11a2-ae5c-4d5f-b628-6ead65964d92 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:25.367422 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f11a2-ae5c-4d5f-b628-6ead65964d92 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:25.367509 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f11a2-ae5c-4d5f-b628-6ead65964d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:25.385739 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-a18f11a2-ae5c-4d5f-b628-6ead65964d92 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:25.386931 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-a18f11a2-ae5c-4d5f-b628-6ead65964d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:25.394717 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 925/1856] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:25.398768 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8bdd1-f793-482a-ab70-ef5c0259450b None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:25.408624 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8bdd1-f793-482a-ab70-ef5c0259450b None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:25.413142 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c784a6-0423-40d8-860e-cc9d7dac3936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:25.413823 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c784a6-0423-40d8-860e-cc9d7dac3936 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:25.414101 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c784a6-0423-40d8-860e-cc9d7dac3936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:25.414491 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c784a6-0423-40d8-860e-cc9d7dac3936 admin admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:25.415841 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c784a6-0423-40d8-860e-cc9d7dac3936 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:18:25.416146 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c784a6-0423-40d8-860e-cc9d7dac3936 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:25.417792 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c784a6-0423-40d8-860e-cc9d7dac3936 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:25.428967 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 932/1857] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 17 18:18:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:18:25.433281 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f11a2-ae5c-4d5f-b628-6ead65964d92 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:25.442209 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f11a2-ae5c-4d5f-b628-6ead65964d92 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:25.446786 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70d3030-fef9-4da0-aba4-b19386eb766b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:25.447435 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d3030-fef9-4da0-aba4-b19386eb766b admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:25.447711 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d3030-fef9-4da0-aba4-b19386eb766b admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:25.447986 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70d3030-fef9-4da0-aba4-b19386eb766b admin admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:25.448921 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70d3030-fef9-4da0-aba4-b19386eb766b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:25.450837 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70d3030-fef9-4da0-aba4-b19386eb766b admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:25.476176 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 926/1858] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:18:25 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:18:25.481073 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c784a6-0423-40d8-860e-cc9d7dac3936 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:25.490849 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c784a6-0423-40d8-860e-cc9d7dac3936 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:25.545586 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f306b0-3f55-4d51-8f12-4d2bbca21fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:25.546344 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f306b0-3f55-4d51-8f12-4d2bbca21fee admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:25.546638 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f306b0-3f55-4d51-8f12-4d2bbca21fee admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:25.546911 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f306b0-3f55-4d51-8f12-4d2bbca21fee admin admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:25.547852 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f306b0-3f55-4d51-8f12-4d2bbca21fee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:25.550574 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f306b0-3f55-4d51-8f12-4d2bbca21fee admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:25.583898 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 933/1859] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:18:25 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:18:25.588003 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70d3030-fef9-4da0-aba4-b19386eb766b admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:25.599366 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70d3030-fef9-4da0-aba4-b19386eb766b admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:25.604316 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2695acd0-6e23-4bc2-87d6-ed7478130af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:25.604977 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695acd0-6e23-4bc2-87d6-ed7478130af2 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:25.605276 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695acd0-6e23-4bc2-87d6-ed7478130af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:25.605571 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695acd0-6e23-4bc2-87d6-ed7478130af2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:25.606288 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2695acd0-6e23-4bc2-87d6-ed7478130af2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:25.607892 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2695acd0-6e23-4bc2-87d6-ed7478130af2 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:25.619037 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 927/1860] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:18:25.623028 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f306b0-3f55-4d51-8f12-4d2bbca21fee admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:25.632699 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f306b0-3f55-4d51-8f12-4d2bbca21fee admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:25.637920 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc225ae-d0fe-425c-a51f-fe8202e0d7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:25.638568 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc225ae-d0fe-425c-a51f-fe8202e0d7ea admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:25.638847 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc225ae-d0fe-425c-a51f-fe8202e0d7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:25.639117 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc225ae-d0fe-425c-a51f-fe8202e0d7ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:25.639826 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc225ae-d0fe-425c-a51f-fe8202e0d7ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:25.641403 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc225ae-d0fe-425c-a51f-fe8202e0d7ea admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:25.651903 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 934/1861] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:18:25.656118 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2695acd0-6e23-4bc2-87d6-ed7478130af2 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:25.669062 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2695acd0-6e23-4bc2-87d6-ed7478130af2 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:25.673803 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b01003-a8e9-4269-8fc1-34f0a94f62ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:25.674665 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b01003-a8e9-4269-8fc1-34f0a94f62ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:25.674942 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b01003-a8e9-4269-8fc1-34f0a94f62ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:25.675211 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b01003-a8e9-4269-8fc1-34f0a94f62ed admin admin] PATH_INFO: `/v3/projects/1ad57e24427042fb893ab609dd5ce9c1/users/d807c2875e8742bb856e96715433b3f9/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:25.693588 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b01003-a8e9-4269-8fc1-34f0a94f62ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ad57e24427042fb893ab609dd5ce9c1, user_id=d807c2875e8742bb856e96715433b3f9, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:25.697890 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b01003-a8e9-4269-8fc1-34f0a94f62ed admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:25.713872 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 928/1862] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:18:25 2022] PUT /identity/v3/projects/1ad57e24427042fb893ab609dd5ce9c1/users/d807c2875e8742bb856e96715433b3f9/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:25.724062 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9bcd2e-4e16-49e6-889d-0fd93a395f60 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:25.724352 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9bcd2e-4e16-49e6-889d-0fd93a395f60 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:25.724631 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9bcd2e-4e16-49e6-889d-0fd93a395f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:25.750602 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-ce9bcd2e-4e16-49e6-889d-0fd93a395f60 None None] MFA Rules not processed for user `d807c2875e8742bb856e96715433b3f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:25.751784 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-ce9bcd2e-4e16-49e6-889d-0fd93a395f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:25.815316 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 935/1863] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:25.819601 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b01003-a8e9-4269-8fc1-34f0a94f62ed admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:25.883528 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b01003-a8e9-4269-8fc1-34f0a94f62ed admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:25.888179 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d8444-f709-4cbe-af8f-df1c86006c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:25.888824 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d8444-f709-4cbe-af8f-df1c86006c30 admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:25.889103 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d8444-f709-4cbe-af8f-df1c86006c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:25.889377 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41d8444-f709-4cbe-af8f-df1c86006c30 admin admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:25.890088 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41d8444-f709-4cbe-af8f-df1c86006c30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:25.891969 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41d8444-f709-4cbe-af8f-df1c86006c30 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:25.916168 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 929/1864] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:18:25 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:18:25.920187 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9bcd2e-4e16-49e6-889d-0fd93a395f60 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:25.931375 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9bcd2e-4e16-49e6-889d-0fd93a395f60 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:26.113291 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e1322-31e9-4005-9611-fb4a20d18d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:26.114047 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e1322-31e9-4005-9611-fb4a20d18d19 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:26.114348 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e1322-31e9-4005-9611-fb4a20d18d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:26.114614 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e1322-31e9-4005-9611-fb4a20d18d19 admin admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:26.115309 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2e1322-31e9-4005-9611-fb4a20d18d19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:26.117197 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2e1322-31e9-4005-9611-fb4a20d18d19 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:26.137269 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 936/1865] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:18:25 2022] POST /identity/v3/users => generated 293 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:18:26.141263 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d8444-f709-4cbe-af8f-df1c86006c30 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:26.152108 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41d8444-f709-4cbe-af8f-df1c86006c30 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:26.157024 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6459ad-7889-4a79-9338-2e0c4969a550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:26.157777 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6459ad-7889-4a79-9338-2e0c4969a550 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:26.158120 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6459ad-7889-4a79-9338-2e0c4969a550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:26.158487 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6459ad-7889-4a79-9338-2e0c4969a550 admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:26.159268 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6459ad-7889-4a79-9338-2e0c4969a550 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:26.160920 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6459ad-7889-4a79-9338-2e0c4969a550 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:26.173348 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 930/1866] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:18:26.177283 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e1322-31e9-4005-9611-fb4a20d18d19 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:26.187358 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e1322-31e9-4005-9611-fb4a20d18d19 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:26.191919 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443724b6-2753-4be2-8c0e-0061176a21f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:26.192573 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443724b6-2753-4be2-8c0e-0061176a21f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:26.192849 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443724b6-2753-4be2-8c0e-0061176a21f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:26.193119 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443724b6-2753-4be2-8c0e-0061176a21f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:26.193870 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443724b6-2753-4be2-8c0e-0061176a21f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:26.195449 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443724b6-2753-4be2-8c0e-0061176a21f6 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:26.206830 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 937/1867] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:18:26.211279 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6459ad-7889-4a79-9338-2e0c4969a550 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:26.221912 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6459ad-7889-4a79-9338-2e0c4969a550 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:26.226483 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89239ff6-0db2-4e42-818b-0b82f6ee2c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:26.227359 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89239ff6-0db2-4e42-818b-0b82f6ee2c59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:26.228227 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89239ff6-0db2-4e42-818b-0b82f6ee2c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:26.228495 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89239ff6-0db2-4e42-818b-0b82f6ee2c59 admin admin] PATH_INFO: `/v3/projects/c5747f8e1d7844e3826c338f4ae953f1/users/110d4604834d4a958335f0bc344997a6/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:26.246577 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89239ff6-0db2-4e42-818b-0b82f6ee2c59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5747f8e1d7844e3826c338f4ae953f1, user_id=110d4604834d4a958335f0bc344997a6, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:26.250985 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89239ff6-0db2-4e42-818b-0b82f6ee2c59 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:26.266544 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 931/1868] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:18:26 2022] PUT /identity/v3/projects/c5747f8e1d7844e3826c338f4ae953f1/users/110d4604834d4a958335f0bc344997a6/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:26.278342 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797e39e-7eed-4ddb-b817-16811e3fc646 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:26.278629 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797e39e-7eed-4ddb-b817-16811e3fc646 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:26.278902 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797e39e-7eed-4ddb-b817-16811e3fc646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:26.305706 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-0797e39e-7eed-4ddb-b817-16811e3fc646 None None] MFA Rules not processed for user `110d4604834d4a958335f0bc344997a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:26.307165 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-0797e39e-7eed-4ddb-b817-16811e3fc646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:26.370396 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 938/1869] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:26.375136 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89239ff6-0db2-4e42-818b-0b82f6ee2c59 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:26.435727 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89239ff6-0db2-4e42-818b-0b82f6ee2c59 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:26.440355 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a248279a-bfe1-40bb-903a-d38fcd2eaaa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:26.441003 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a248279a-bfe1-40bb-903a-d38fcd2eaaa9 admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:26.441283 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a248279a-bfe1-40bb-903a-d38fcd2eaaa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:26.441598 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a248279a-bfe1-40bb-903a-d38fcd2eaaa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:26.442288 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a248279a-bfe1-40bb-903a-d38fcd2eaaa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:26.444160 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a248279a-bfe1-40bb-903a-d38fcd2eaaa9 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:26.469664 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 932/1870] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:18:26 2022] POST /identity/v3/projects => generated 385 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:18:26.473674 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0797e39e-7eed-4ddb-b817-16811e3fc646 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:26.484701 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0797e39e-7eed-4ddb-b817-16811e3fc646 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:26.537407 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f56728-db0f-4822-b697-0802c45e5bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:26.538092 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f56728-db0f-4822-b697-0802c45e5bf3 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:26.538368 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f56728-db0f-4822-b697-0802c45e5bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:26.538635 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f56728-db0f-4822-b697-0802c45e5bf3 admin admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:26.539302 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f56728-db0f-4822-b697-0802c45e5bf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:26.547926 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f56728-db0f-4822-b697-0802c45e5bf3 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:26.566070 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 939/1871] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:18:26 2022] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:18:26.570543 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a248279a-bfe1-40bb-903a-d38fcd2eaaa9 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:26.582572 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a248279a-bfe1-40bb-903a-d38fcd2eaaa9 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:26.587831 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90293326-d345-46c4-a9f5-95e52cf9def2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:26.588512 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90293326-d345-46c4-a9f5-95e52cf9def2 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:26.588788 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90293326-d345-46c4-a9f5-95e52cf9def2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:26.589055 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90293326-d345-46c4-a9f5-95e52cf9def2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:26.589857 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90293326-d345-46c4-a9f5-95e52cf9def2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:26.591444 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90293326-d345-46c4-a9f5-95e52cf9def2 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:26.602024 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 933/1872] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:18:26.606166 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f56728-db0f-4822-b697-0802c45e5bf3 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:26.615981 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f56728-db0f-4822-b697-0802c45e5bf3 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:26.620741 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeef162-4a9e-4be4-bb2b-ad0d91dbbcc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:26.621639 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeef162-4a9e-4be4-bb2b-ad0d91dbbcc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:26.621932 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeef162-4a9e-4be4-bb2b-ad0d91dbbcc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:26.622184 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeef162-4a9e-4be4-bb2b-ad0d91dbbcc1 admin admin] PATH_INFO: `/v3/projects/4a5b31c8bace411d96e81280ed5aab3a/users/1512edc4446749e5a10e9bb7bc7ac59c/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:26.637238 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeef162-4a9e-4be4-bb2b-ad0d91dbbcc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a5b31c8bace411d96e81280ed5aab3a, user_id=1512edc4446749e5a10e9bb7bc7ac59c, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:26.639932 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeef162-4a9e-4be4-bb2b-ad0d91dbbcc1 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:26.653742 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 940/1873] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:18:26 2022] PUT /identity/v3/projects/4a5b31c8bace411d96e81280ed5aab3a/users/1512edc4446749e5a10e9bb7bc7ac59c/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:18:26.657736 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90293326-d345-46c4-a9f5-95e52cf9def2 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:26.668082 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90293326-d345-46c4-a9f5-95e52cf9def2 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:26.731076 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84c84d6-5205-4dd0-a5aa-71d6a8ede105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:26.740786 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c84d6-5205-4dd0-a5aa-71d6a8ede105 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:26.740786 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c84d6-5205-4dd0-a5aa-71d6a8ede105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:26.740786 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c84d6-5205-4dd0-a5aa-71d6a8ede105 admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:26.740786 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84c84d6-5205-4dd0-a5aa-71d6a8ede105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:26.740786 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84c84d6-5205-4dd0-a5aa-71d6a8ede105 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:26.748680 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 934/1874] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:18:26.749973 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeef162-4a9e-4be4-bb2b-ad0d91dbbcc1 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:26.760009 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeef162-4a9e-4be4-bb2b-ad0d91dbbcc1 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:26.764693 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ebc206-3f68-44cf-bff7-fa1a255f37a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:26.765602 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ebc206-3f68-44cf-bff7-fa1a255f37a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:26.765873 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ebc206-3f68-44cf-bff7-fa1a255f37a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:26.766137 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ebc206-3f68-44cf-bff7-fa1a255f37a8 admin admin] PATH_INFO: `/v3/projects/4a5b31c8bace411d96e81280ed5aab3a/users/1512edc4446749e5a10e9bb7bc7ac59c/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:26.768065 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ebc206-3f68-44cf-bff7-fa1a255f37a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a5b31c8bace411d96e81280ed5aab3a, user_id=1512edc4446749e5a10e9bb7bc7ac59c, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:26.770696 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ebc206-3f68-44cf-bff7-fa1a255f37a8 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:26.781617 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 941/1875] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:18:26 2022] PUT /identity/v3/projects/4a5b31c8bace411d96e81280ed5aab3a/users/1512edc4446749e5a10e9bb7bc7ac59c/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:26.791666 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fead1c-4a6a-416c-a5f9-2b0241ad94bb None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:26.791949 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fead1c-4a6a-416c-a5f9-2b0241ad94bb None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:26.792372 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fead1c-4a6a-416c-a5f9-2b0241ad94bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:26.818619 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-34fead1c-4a6a-416c-a5f9-2b0241ad94bb None None] MFA Rules not processed for user `1512edc4446749e5a10e9bb7bc7ac59c`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:26.819811 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-34fead1c-4a6a-416c-a5f9-2b0241ad94bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:26.898180 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 935/1876] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:26 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:26.909290 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ebc206-3f68-44cf-bff7-fa1a255f37a8 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:26.910967 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-e3ebc206-3f68-44cf-bff7-fa1a255f37a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:26.966022 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ebc206-3f68-44cf-bff7-fa1a255f37a8 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:26.969628 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25371aa6-63ba-4459-8731-24495098a49f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:26.970251 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25371aa6-63ba-4459-8731-24495098a49f service cinder] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:26.970524 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25371aa6-63ba-4459-8731-24495098a49f service cinder] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:26.970793 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25371aa6-63ba-4459-8731-24495098a49f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:27.023640 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25371aa6-63ba-4459-8731-24495098a49f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:27.025062 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25371aa6-63ba-4459-8731-24495098a49f service cinder] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:27.033781 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 942/1877] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:18:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:18:33.870211 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fead1c-4a6a-416c-a5f9-2b0241ad94bb None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:33.871854 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-34fead1c-4a6a-416c-a5f9-2b0241ad94bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:33.888879 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fead1c-4a6a-416c-a5f9-2b0241ad94bb None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:33.901364 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913a61b-2e12-4143-b79c-fd700e3fcc87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:33.902091 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913a61b-2e12-4143-b79c-fd700e3fcc87 service cinder] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:33.902365 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913a61b-2e12-4143-b79c-fd700e3fcc87 service cinder] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:33.902633 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913a61b-2e12-4143-b79c-fd700e3fcc87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:33.963886 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a913a61b-2e12-4143-b79c-fd700e3fcc87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:33.965300 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a913a61b-2e12-4143-b79c-fd700e3fcc87 service cinder] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:33.974481 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 936/1878] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:18:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:18:34.511869 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25371aa6-63ba-4459-8731-24495098a49f service cinder] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:34.520286 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25371aa6-63ba-4459-8731-24495098a49f service cinder] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:34.523934 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718a0251-26ed-4510-aafb-4bc98ecf7f4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:34.525073 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a0251-26ed-4510-aafb-4bc98ecf7f4c service cinder] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:34.525351 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a0251-26ed-4510-aafb-4bc98ecf7f4c service cinder] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:34.525653 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718a0251-26ed-4510-aafb-4bc98ecf7f4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:34.534712 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718a0251-26ed-4510-aafb-4bc98ecf7f4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:34.536130 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718a0251-26ed-4510-aafb-4bc98ecf7f4c service cinder] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:34.546036 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 943/1879] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:18:34 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:18:34.975202 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913a61b-2e12-4143-b79c-fd700e3fcc87 service cinder] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:34.976663 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-a913a61b-2e12-4143-b79c-fd700e3fcc87 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:35.043983 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913a61b-2e12-4143-b79c-fd700e3fcc87 service cinder] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:35.049336 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f752492-9792-4381-a93f-6d6b9ec99bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:35.049809 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f752492-9792-4381-a93f-6d6b9ec99bce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:35.050153 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f752492-9792-4381-a93f-6d6b9ec99bce admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:35.050490 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f752492-9792-4381-a93f-6d6b9ec99bce admin admin] PATH_INFO: `/v3/users/a524e077a0c84850b2af69c76e2b5017` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:35.052157 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f752492-9792-4381-a93f-6d6b9ec99bce admin admin] RBAC: Authorizing `identity:delete_user(user_id=a524e077a0c84850b2af69c76e2b5017)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:35.053742 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f752492-9792-4381-a93f-6d6b9ec99bce admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:35.101253 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-9f752492-9792-4381-a93f-6d6b9ec99bce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a524e077a0c84850b2af69c76e2b5017'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:35.108894 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-9f752492-9792-4381-a93f-6d6b9ec99bce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a524e077a0c84850b2af69c76e2b5017'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:35.109670 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-9f752492-9792-4381-a93f-6d6b9ec99bce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a524e077a0c84850b2af69c76e2b5017'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:35.117221 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-9f752492-9792-4381-a93f-6d6b9ec99bce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a524e077a0c84850b2af69c76e2b5017'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:35.117983 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-9f752492-9792-4381-a93f-6d6b9ec99bce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a524e077a0c84850b2af69c76e2b5017'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:35.137145 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 937/1880] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:18:34 2022] DELETE /identity/v3/users/a524e077a0c84850b2af69c76e2b5017 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:35.141934 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fae6d1-5480-4e24-978d-0f3ba343ef2e None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:35.142236 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fae6d1-5480-4e24-978d-0f3ba343ef2e None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:35.142514 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fae6d1-5480-4e24-978d-0f3ba343ef2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:35.160243 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-34fae6d1-5480-4e24-978d-0f3ba343ef2e None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:35.161423 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-34fae6d1-5480-4e24-978d-0f3ba343ef2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:35.222182 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 944/1881] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:35.232168 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f752492-9792-4381-a93f-6d6b9ec99bce admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:35.233623 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-9f752492-9792-4381-a93f-6d6b9ec99bce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:35.290783 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f752492-9792-4381-a93f-6d6b9ec99bce admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:35.294808 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ef411-1a84-4cf2-b355-8db26d60db0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:35.295521 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ef411-1a84-4cf2-b355-8db26d60db0f service neutron] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:35.295834 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ef411-1a84-4cf2-b355-8db26d60db0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:35.296141 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869ef411-1a84-4cf2-b355-8db26d60db0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:35.305530 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869ef411-1a84-4cf2-b355-8db26d60db0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:35.306958 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869ef411-1a84-4cf2-b355-8db26d60db0f service neutron] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:35.316472 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 938/1882] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:18:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:18:35.653047 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fae6d1-5480-4e24-978d-0f3ba343ef2e None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:35.658135 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-34fae6d1-5480-4e24-978d-0f3ba343ef2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:35.674157 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fae6d1-5480-4e24-978d-0f3ba343ef2e None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:35.679475 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc0055-afe9-4e6d-9be6-a4a3551e88cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:35.680340 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc0055-afe9-4e6d-9be6-a4a3551e88cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:35.685854 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc0055-afe9-4e6d-9be6-a4a3551e88cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:35.685854 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc0055-afe9-4e6d-9be6-a4a3551e88cb admin admin] PATH_INFO: `/v3/projects/0446fa575c604072bfc1809616c042f8` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:35.686746 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fc0055-afe9-4e6d-9be6-a4a3551e88cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0446fa575c604072bfc1809616c042f8)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:35.688850 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fc0055-afe9-4e6d-9be6-a4a3551e88cb admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:35.746182 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-85fc0055-afe9-4e6d-9be6-a4a3551e88cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0446fa575c604072bfc1809616c042f8', 'request_id': 'req-85fc0055-afe9-4e6d-9be6-a4a3551e88cb'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:35.753741 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-85fc0055-afe9-4e6d-9be6-a4a3551e88cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0446fa575c604072bfc1809616c042f8', 'request_id': 'req-85fc0055-afe9-4e6d-9be6-a4a3551e88cb'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:35.762981 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-85fc0055-afe9-4e6d-9be6-a4a3551e88cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0446fa575c604072bfc1809616c042f8', 'request_id': 'req-85fc0055-afe9-4e6d-9be6-a4a3551e88cb'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:35.774651 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-85fc0055-afe9-4e6d-9be6-a4a3551e88cb admin admin] The token cache is being invalidate because project 0446fa575c604072bfc1809616c042f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:18:35.774936 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-85fc0055-afe9-4e6d-9be6-a4a3551e88cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:35.775774 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-85fc0055-afe9-4e6d-9be6-a4a3551e88cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:35.777343 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 945/1883] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:18:35 2022] DELETE /identity/v3/projects/0446fa575c604072bfc1809616c042f8 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:35.781633 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ef411-1a84-4cf2-b355-8db26d60db0f service neutron] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:35.792678 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869ef411-1a84-4cf2-b355-8db26d60db0f service neutron] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:35.866819 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c0553c-6377-4196-b839-2a60af44bbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:35.867708 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0553c-6377-4196-b839-2a60af44bbaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:35.868016 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0553c-6377-4196-b839-2a60af44bbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:35.868290 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0553c-6377-4196-b839-2a60af44bbaa admin admin] PATH_INFO: `/v3/users/56a7e0697eeb433eb0124d16491b0533` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:35.869631 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c0553c-6377-4196-b839-2a60af44bbaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=56a7e0697eeb433eb0124d16491b0533)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:35.871588 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c0553c-6377-4196-b839-2a60af44bbaa admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:35.923540 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-83c0553c-6377-4196-b839-2a60af44bbaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56a7e0697eeb433eb0124d16491b0533'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:35.930669 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-83c0553c-6377-4196-b839-2a60af44bbaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56a7e0697eeb433eb0124d16491b0533'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:35.931425 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-83c0553c-6377-4196-b839-2a60af44bbaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56a7e0697eeb433eb0124d16491b0533'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:35.938899 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-83c0553c-6377-4196-b839-2a60af44bbaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56a7e0697eeb433eb0124d16491b0533'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:35.939519 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-83c0553c-6377-4196-b839-2a60af44bbaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56a7e0697eeb433eb0124d16491b0533'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:35.962827 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 939/1884] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:18:35 2022] DELETE /identity/v3/users/56a7e0697eeb433eb0124d16491b0533 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:36.026116 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc0055-afe9-4e6d-9be6-a4a3551e88cb admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:36.028131 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-85fc0055-afe9-4e6d-9be6-a4a3551e88cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:36.052016 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc0055-afe9-4e6d-9be6-a4a3551e88cb admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:36.117878 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffcf320-f3e8-4cab-a2cb-f5b47c510ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:36.118748 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffcf320-f3e8-4cab-a2cb-f5b47c510ebf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:36.119025 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffcf320-f3e8-4cab-a2cb-f5b47c510ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:36.119295 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffcf320-f3e8-4cab-a2cb-f5b47c510ebf admin admin] PATH_INFO: `/v3/users/d09af0915f0044d0b5bb60a3f5673056` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:36.120492 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffcf320-f3e8-4cab-a2cb-f5b47c510ebf admin admin] RBAC: Authorizing `identity:delete_user(user_id=d09af0915f0044d0b5bb60a3f5673056)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:36.122480 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffcf320-f3e8-4cab-a2cb-f5b47c510ebf admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:36.168151 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-0ffcf320-f3e8-4cab-a2cb-f5b47c510ebf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd09af0915f0044d0b5bb60a3f5673056'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:36.180618 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-0ffcf320-f3e8-4cab-a2cb-f5b47c510ebf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd09af0915f0044d0b5bb60a3f5673056'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:36.181343 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-0ffcf320-f3e8-4cab-a2cb-f5b47c510ebf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd09af0915f0044d0b5bb60a3f5673056'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:36.182023 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-0ffcf320-f3e8-4cab-a2cb-f5b47c510ebf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd09af0915f0044d0b5bb60a3f5673056'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:36.188899 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-0ffcf320-f3e8-4cab-a2cb-f5b47c510ebf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd09af0915f0044d0b5bb60a3f5673056'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:36.203381 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 946/1885] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:18:36 2022] DELETE /identity/v3/users/d09af0915f0044d0b5bb60a3f5673056 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:36.207853 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b3fd0-d27f-407c-8a51-3d7312d44d47 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:36.208728 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b3fd0-d27f-407c-8a51-3d7312d44d47 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:36.209013 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b3fd0-d27f-407c-8a51-3d7312d44d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:36.226515 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-ca3b3fd0-d27f-407c-8a51-3d7312d44d47 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:36.228018 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-ca3b3fd0-d27f-407c-8a51-3d7312d44d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:36.290619 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 940/1886] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:18:36.300675 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffcf320-f3e8-4cab-a2cb-f5b47c510ebf admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:36.302092 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-0ffcf320-f3e8-4cab-a2cb-f5b47c510ebf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:36.362629 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffcf320-f3e8-4cab-a2cb-f5b47c510ebf admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:36.366332 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e963349f-177e-4f9f-934c-bada73492fbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:36.366923 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e963349f-177e-4f9f-934c-bada73492fbd service neutron] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:36.367201 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e963349f-177e-4f9f-934c-bada73492fbd service neutron] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:36.367470 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e963349f-177e-4f9f-934c-bada73492fbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:36.377426 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b3fd0-d27f-407c-8a51-3d7312d44d47 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:36.377680 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e963349f-177e-4f9f-934c-bada73492fbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:36.378944 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-ca3b3fd0-d27f-407c-8a51-3d7312d44d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:36.379300 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e963349f-177e-4f9f-934c-bada73492fbd service neutron] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:36.389658 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 947/1887] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:18:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:18:36.396071 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b3fd0-d27f-407c-8a51-3d7312d44d47 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:36.408112 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1320a67-e047-4075-8de2-308b9e5723f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:36.409035 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1320a67-e047-4075-8de2-308b9e5723f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:36.416448 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1320a67-e047-4075-8de2-308b9e5723f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:36.416776 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1320a67-e047-4075-8de2-308b9e5723f1 admin admin] PATH_INFO: `/v3/projects/d011ffd5f11c4580ad499e44230281fa` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:36.419329 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1320a67-e047-4075-8de2-308b9e5723f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d011ffd5f11c4580ad499e44230281fa)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:36.421195 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1320a67-e047-4075-8de2-308b9e5723f1 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:36.472098 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-f1320a67-e047-4075-8de2-308b9e5723f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd011ffd5f11c4580ad499e44230281fa', 'request_id': 'req-f1320a67-e047-4075-8de2-308b9e5723f1'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:36.478463 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-f1320a67-e047-4075-8de2-308b9e5723f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd011ffd5f11c4580ad499e44230281fa', 'request_id': 'req-f1320a67-e047-4075-8de2-308b9e5723f1'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:36.485809 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-f1320a67-e047-4075-8de2-308b9e5723f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd011ffd5f11c4580ad499e44230281fa', 'request_id': 'req-f1320a67-e047-4075-8de2-308b9e5723f1'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:36.497607 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-f1320a67-e047-4075-8de2-308b9e5723f1 admin admin] The token cache is being invalidate because project d011ffd5f11c4580ad499e44230281fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:18:36.497793 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-f1320a67-e047-4075-8de2-308b9e5723f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:36.498454 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-f1320a67-e047-4075-8de2-308b9e5723f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:36.500072 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 941/1888] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:18:36 2022] DELETE /identity/v3/projects/d011ffd5f11c4580ad499e44230281fa => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:18:36.505306 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed53bc-3fe1-45f6-a191-9474975ff612 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:36.505871 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed53bc-3fe1-45f6-a191-9474975ff612 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:36.506322 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed53bc-3fe1-45f6-a191-9474975ff612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:36.525032 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-09ed53bc-3fe1-45f6-a191-9474975ff612 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:36.526319 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-09ed53bc-3fe1-45f6-a191-9474975ff612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:36.585331 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 948/1889] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:36.593750 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4e220-7b3a-4828-bb8a-bd9b1d43d8ce None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:36.594042 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4e220-7b3a-4828-bb8a-bd9b1d43d8ce None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:36.594319 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4e220-7b3a-4828-bb8a-bd9b1d43d8ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:36.613243 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-ead4e220-7b3a-4828-bb8a-bd9b1d43d8ce None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:36.614490 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-ead4e220-7b3a-4828-bb8a-bd9b1d43d8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:36.623035 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 942/1890] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:36.627213 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed53bc-3fe1-45f6-a191-9474975ff612 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:36.637249 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed53bc-3fe1-45f6-a191-9474975ff612 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:36.642187 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca05fbac-ac47-4d9b-92be-46335e9ecdcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:36.642839 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca05fbac-ac47-4d9b-92be-46335e9ecdcb admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:36.643115 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca05fbac-ac47-4d9b-92be-46335e9ecdcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:36.643383 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca05fbac-ac47-4d9b-92be-46335e9ecdcb admin admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:36.644098 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca05fbac-ac47-4d9b-92be-46335e9ecdcb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:18:36.644395 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca05fbac-ac47-4d9b-92be-46335e9ecdcb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:36.646003 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca05fbac-ac47-4d9b-92be-46335e9ecdcb admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:36.658937 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 949/1891] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 17 18:18:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:18:36.662714 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead4e220-7b3a-4828-bb8a-bd9b1d43d8ce None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:36.671894 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca05fbac-ac47-4d9b-92be-46335e9ecdcb admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:36.672788 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead4e220-7b3a-4828-bb8a-bd9b1d43d8ce None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:36.674001 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-ca05fbac-ac47-4d9b-92be-46335e9ecdcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:36.678267 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daba1a4-cdbc-4938-9a3a-a1e8e0795e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:36.679113 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daba1a4-cdbc-4938-9a3a-a1e8e0795e47 admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:36.679486 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daba1a4-cdbc-4938-9a3a-a1e8e0795e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:36.679856 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daba1a4-cdbc-4938-9a3a-a1e8e0795e47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:36.681155 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daba1a4-cdbc-4938-9a3a-a1e8e0795e47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:36.683149 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daba1a4-cdbc-4938-9a3a-a1e8e0795e47 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:36.695233 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca05fbac-ac47-4d9b-92be-46335e9ecdcb admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:36.702313 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa06786-b016-46ec-bb33-0678ac4c8b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:36.703404 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa06786-b016-46ec-bb33-0678ac4c8b7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:36.703836 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa06786-b016-46ec-bb33-0678ac4c8b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:36.704435 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa06786-b016-46ec-bb33-0678ac4c8b7b admin admin] PATH_INFO: `/v3/projects/7e72a2bea51745fdbc740cda45805563` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:36.705946 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa06786-b016-46ec-bb33-0678ac4c8b7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e72a2bea51745fdbc740cda45805563)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:36.708997 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa06786-b016-46ec-bb33-0678ac4c8b7b admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:36.718296 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 943/1892] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:18:36 2022] POST /identity/v3/projects => generated 365 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:18:36.719324 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daba1a4-cdbc-4938-9a3a-a1e8e0795e47 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:36.760476 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-9aa06786-b016-46ec-bb33-0678ac4c8b7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e72a2bea51745fdbc740cda45805563', 'request_id': 'req-9aa06786-b016-46ec-bb33-0678ac4c8b7b'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:36.768687 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-9aa06786-b016-46ec-bb33-0678ac4c8b7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e72a2bea51745fdbc740cda45805563', 'request_id': 'req-9aa06786-b016-46ec-bb33-0678ac4c8b7b'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:36.777753 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-9aa06786-b016-46ec-bb33-0678ac4c8b7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e72a2bea51745fdbc740cda45805563', 'request_id': 'req-9aa06786-b016-46ec-bb33-0678ac4c8b7b'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:36.790128 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-9aa06786-b016-46ec-bb33-0678ac4c8b7b admin admin] The token cache is being invalidate because project 7e72a2bea51745fdbc740cda45805563 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:18:36.790630 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-9aa06786-b016-46ec-bb33-0678ac4c8b7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:36.790826 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daba1a4-cdbc-4938-9a3a-a1e8e0795e47 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:36.791738 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-9aa06786-b016-46ec-bb33-0678ac4c8b7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:36.794034 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 950/1893] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:18:36 2022] DELETE /identity/v3/projects/7e72a2bea51745fdbc740cda45805563 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:18:36.799539 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653049c2-a749-4590-9ac3-71d0d9dec343 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:36.800010 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653049c2-a749-4590-9ac3-71d0d9dec343 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:36.800282 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653049c2-a749-4590-9ac3-71d0d9dec343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:36.820349 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-653049c2-a749-4590-9ac3-71d0d9dec343 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:36.822525 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-653049c2-a749-4590-9ac3-71d0d9dec343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:36.857360 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39278916-0bf3-4ec7-93db-0285eda7a42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:36.858068 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39278916-0bf3-4ec7-93db-0285eda7a42b admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:36.858352 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39278916-0bf3-4ec7-93db-0285eda7a42b admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:36.858686 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39278916-0bf3-4ec7-93db-0285eda7a42b admin admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:36.859382 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39278916-0bf3-4ec7-93db-0285eda7a42b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:36.861330 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39278916-0bf3-4ec7-93db-0285eda7a42b admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:36.884793 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 944/1894] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:18:36 2022] POST /identity/v3/users => generated 283 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:18:36.886031 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39278916-0bf3-4ec7-93db-0285eda7a42b admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:36.887817 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-39278916-0bf3-4ec7-93db-0285eda7a42b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:36.895339 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 951/1895] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:36.900108 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39278916-0bf3-4ec7-93db-0285eda7a42b admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:36.903209 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bda0b1-dd5c-4991-974e-ad321711e7cc None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:36.903497 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bda0b1-dd5c-4991-974e-ad321711e7cc None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:36.903773 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bda0b1-dd5c-4991-974e-ad321711e7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:36.905781 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65329eaf-109e-42d4-8cef-99ddabfd5b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:36.906518 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65329eaf-109e-42d4-8cef-99ddabfd5b49 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:36.906868 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65329eaf-109e-42d4-8cef-99ddabfd5b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:36.907218 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65329eaf-109e-42d4-8cef-99ddabfd5b49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:36.908030 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65329eaf-109e-42d4-8cef-99ddabfd5b49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:36.909709 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65329eaf-109e-42d4-8cef-99ddabfd5b49 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:36.923441 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 945/1896] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:18:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:18:36.923621 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-f2bda0b1-dd5c-4991-974e-ad321711e7cc None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:36.924006 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-f2bda0b1-dd5c-4991-974e-ad321711e7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:36.924639 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65329eaf-109e-42d4-8cef-99ddabfd5b49 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:36.934099 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 952/1897] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:36.936816 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65329eaf-109e-42d4-8cef-99ddabfd5b49 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:36.938205 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bda0b1-dd5c-4991-974e-ad321711e7cc None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:36.941906 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6971f30f-29fc-4f90-8b97-363aabfda1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:36.942615 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971f30f-29fc-4f90-8b97-363aabfda1d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:36.942892 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971f30f-29fc-4f90-8b97-363aabfda1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:36.943160 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971f30f-29fc-4f90-8b97-363aabfda1d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:36.943918 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6971f30f-29fc-4f90-8b97-363aabfda1d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:36.945469 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6971f30f-29fc-4f90-8b97-363aabfda1d1 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:36.947205 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bda0b1-dd5c-4991-974e-ad321711e7cc None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:36.952112 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0a6b82-0a12-4654-ade2-eb53bcf948ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:36.952772 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a6b82-0a12-4654-ade2-eb53bcf948ad admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:36.953050 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a6b82-0a12-4654-ade2-eb53bcf948ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:36.953324 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0a6b82-0a12-4654-ade2-eb53bcf948ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:36.954077 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0a6b82-0a12-4654-ade2-eb53bcf948ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:18:36.954383 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0a6b82-0a12-4654-ade2-eb53bcf948ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:36.955972 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0a6b82-0a12-4654-ade2-eb53bcf948ad admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:36.961600 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 946/1898] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:18:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:18:36.962718 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6971f30f-29fc-4f90-8b97-363aabfda1d1 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:36.971206 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 953/1899] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 17 18:18:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:18:36.975943 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6971f30f-29fc-4f90-8b97-363aabfda1d1 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:36.976109 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0a6b82-0a12-4654-ade2-eb53bcf948ad admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:36.982626 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f905221-fae6-4825-9819-fc3c1063618e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:36.983692 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f905221-fae6-4825-9819-fc3c1063618e admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:36.983970 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f905221-fae6-4825-9819-fc3c1063618e admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:36.984235 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f905221-fae6-4825-9819-fc3c1063618e admin admin] PATH_INFO: `/v3/projects/d5305be0c4f24726aeb71376dc09926e/users/6d48e2381bbc4fa492f477af01e9d90c/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:36.986930 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0a6b82-0a12-4654-ade2-eb53bcf948ad admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:36.991894 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3f0dcb-6deb-4ae2-a3c9-c0a95654c8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:36.992618 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f0dcb-6deb-4ae2-a3c9-c0a95654c8d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:36.993637 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f0dcb-6deb-4ae2-a3c9-c0a95654c8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:36.993983 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3f0dcb-6deb-4ae2-a3c9-c0a95654c8d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:36.994757 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3f0dcb-6deb-4ae2-a3c9-c0a95654c8d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:36.996861 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3f0dcb-6deb-4ae2-a3c9-c0a95654c8d3 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:37.000090 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f905221-fae6-4825-9819-fc3c1063618e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5305be0c4f24726aeb71376dc09926e, user_id=6d48e2381bbc4fa492f477af01e9d90c, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:37.002837 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f905221-fae6-4825-9819-fc3c1063618e admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:37.019611 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 947/1900] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:18:36 2022] PUT /identity/v3/projects/d5305be0c4f24726aeb71376dc09926e/users/6d48e2381bbc4fa492f477af01e9d90c/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:18:37.027490 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 954/1901] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:18:36 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:18:37.028757 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f905221-fae6-4825-9819-fc3c1063618e admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:37.029217 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc6ceb-e7d7-4d38-93a0-5fe5de17e0fd None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:37.029566 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc6ceb-e7d7-4d38-93a0-5fe5de17e0fd None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:37.029846 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fc6ceb-e7d7-4d38-93a0-5fe5de17e0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:37.064992 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-d4fc6ceb-e7d7-4d38-93a0-5fe5de17e0fd None None] MFA Rules not processed for user `6d48e2381bbc4fa492f477af01e9d90c`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:37.066222 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-d4fc6ceb-e7d7-4d38-93a0-5fe5de17e0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:37.103937 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f905221-fae6-4825-9819-fc3c1063618e admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:37.133122 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 955/1902] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:37 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:18:37.137684 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fc6ceb-e7d7-4d38-93a0-5fe5de17e0fd None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:37.165248 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0043ef6-96eb-4444-99dc-44e6806a0b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:37.165952 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0043ef6-96eb-4444-99dc-44e6806a0b83 admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:37.166236 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0043ef6-96eb-4444-99dc-44e6806a0b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:37.166543 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0043ef6-96eb-4444-99dc-44e6806a0b83 admin admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:37.167229 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0043ef6-96eb-4444-99dc-44e6806a0b83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:37.169128 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0043ef6-96eb-4444-99dc-44e6806a0b83 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:37.191095 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 948/1903] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:18:37 2022] POST /identity/v3/users => generated 288 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:18:37.195041 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0043ef6-96eb-4444-99dc-44e6806a0b83 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:37.207137 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fc6ceb-e7d7-4d38-93a0-5fe5de17e0fd None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:37.211888 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0043ef6-96eb-4444-99dc-44e6806a0b83 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:37.213088 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a56b99a-a3a0-4aa3-a9b0-fe0e6d6ea896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:37.213972 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56b99a-a3a0-4aa3-a9b0-fe0e6d6ea896 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:37.214324 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56b99a-a3a0-4aa3-a9b0-fe0e6d6ea896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:37.214726 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a56b99a-a3a0-4aa3-a9b0-fe0e6d6ea896 admin admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:37.215569 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a56b99a-a3a0-4aa3-a9b0-fe0e6d6ea896 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:37.217433 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d582dc7-3983-4fe8-85d3-c705dc9a9c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:37.218121 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d582dc7-3983-4fe8-85d3-c705dc9a9c6f admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:37.218502 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d582dc7-3983-4fe8-85d3-c705dc9a9c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:37.218664 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d582dc7-3983-4fe8-85d3-c705dc9a9c6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:37.219057 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a56b99a-a3a0-4aa3-a9b0-fe0e6d6ea896 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:37.219373 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d582dc7-3983-4fe8-85d3-c705dc9a9c6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:37.220993 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d582dc7-3983-4fe8-85d3-c705dc9a9c6f admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:37.234939 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 949/1904] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:18:37.238567 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d582dc7-3983-4fe8-85d3-c705dc9a9c6f admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:37.250318 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d582dc7-3983-4fe8-85d3-c705dc9a9c6f admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:37.257022 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee6a00f-0f48-41c0-a70d-14c09aff1177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:37.257899 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6a00f-0f48-41c0-a70d-14c09aff1177 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:37.258253 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6a00f-0f48-41c0-a70d-14c09aff1177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:37.258642 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6a00f-0f48-41c0-a70d-14c09aff1177 admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:37.259642 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee6a00f-0f48-41c0-a70d-14c09aff1177 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:37.265643 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 956/1905] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:18:37 2022] POST /identity/v3/projects => generated 365 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:18:37.268717 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a56b99a-a3a0-4aa3-a9b0-fe0e6d6ea896 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:37.282240 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee6a00f-0f48-41c0-a70d-14c09aff1177 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:37.308480 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 950/1906] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:18:37.316386 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee6a00f-0f48-41c0-a70d-14c09aff1177 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:37.337545 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee6a00f-0f48-41c0-a70d-14c09aff1177 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:37.367067 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a56b99a-a3a0-4aa3-a9b0-fe0e6d6ea896 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:37.373048 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703fe7ca-f3a5-40ae-8180-e92f085f2d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:37.374099 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703fe7ca-f3a5-40ae-8180-e92f085f2d7a admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:37.374385 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703fe7ca-f3a5-40ae-8180-e92f085f2d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:37.374656 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703fe7ca-f3a5-40ae-8180-e92f085f2d7a admin admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:37.375350 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703fe7ca-f3a5-40ae-8180-e92f085f2d7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:37.379431 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703fe7ca-f3a5-40ae-8180-e92f085f2d7a admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:37.420370 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 957/1907] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:18:37 2022] POST /identity/v3/users => generated 289 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:18:37.424203 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703fe7ca-f3a5-40ae-8180-e92f085f2d7a admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:37.438030 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ceff5f-e93f-4650-bdcb-629f32526219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:37.439210 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ceff5f-e93f-4650-bdcb-629f32526219 admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:37.440017 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ceff5f-e93f-4650-bdcb-629f32526219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:37.444037 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ceff5f-e93f-4650-bdcb-629f32526219 admin admin] PATH_INFO: `/v3/projects/bd358a8987db47aa8e2800b80c17fe49/users/211c52261d684423926d921296417218/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:37.447235 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703fe7ca-f3a5-40ae-8180-e92f085f2d7a admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:37.463409 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ceff5f-e93f-4650-bdcb-629f32526219 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd358a8987db47aa8e2800b80c17fe49, user_id=211c52261d684423926d921296417218, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:37.463897 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e1648-b02d-45cc-afd4-6540622c4df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:37.464725 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e1648-b02d-45cc-afd4-6540622c4df1 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:37.465062 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e1648-b02d-45cc-afd4-6540622c4df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:37.465305 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e1648-b02d-45cc-afd4-6540622c4df1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:37.466070 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032e1648-b02d-45cc-afd4-6540622c4df1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:37.466516 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ceff5f-e93f-4650-bdcb-629f32526219 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:37.471771 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032e1648-b02d-45cc-afd4-6540622c4df1 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:37.494188 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 951/1908] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:18:37 2022] PUT /identity/v3/projects/bd358a8987db47aa8e2800b80c17fe49/users/211c52261d684423926d921296417218/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:37.495825 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ceff5f-e93f-4650-bdcb-629f32526219 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:37.503487 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 958/1909] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:18:37.505183 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f794ffc-98c9-425c-b772-aaf0663af019 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:37.505482 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f794ffc-98c9-425c-b772-aaf0663af019 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:37.505753 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f794ffc-98c9-425c-b772-aaf0663af019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:37.545330 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-6f794ffc-98c9-425c-b772-aaf0663af019 None None] MFA Rules not processed for user `211c52261d684423926d921296417218`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:37.546664 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-6f794ffc-98c9-425c-b772-aaf0663af019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:37.614800 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ceff5f-e93f-4650-bdcb-629f32526219 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:37.620405 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e142ae9-5432-454d-ac86-a38a1f6e0035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:37.621314 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e142ae9-5432-454d-ac86-a38a1f6e0035 admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:37.621925 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e142ae9-5432-454d-ac86-a38a1f6e0035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:37.621925 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e142ae9-5432-454d-ac86-a38a1f6e0035 admin admin] PATH_INFO: `/v3/projects/d1829c0880ee40b69f86e5e2695c8697/users/28e16daf912f456ab7307248cc0d047b/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:37.639896 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e142ae9-5432-454d-ac86-a38a1f6e0035 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1829c0880ee40b69f86e5e2695c8697, user_id=28e16daf912f456ab7307248cc0d047b, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:37.642947 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e142ae9-5432-454d-ac86-a38a1f6e0035 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:37.643929 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 959/1910] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:37.657166 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f794ffc-98c9-425c-b772-aaf0663af019 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:37.659178 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-6f794ffc-98c9-425c-b772-aaf0663af019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:37.663784 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 952/1911] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:18:37 2022] PUT /identity/v3/projects/d1829c0880ee40b69f86e5e2695c8697/users/28e16daf912f456ab7307248cc0d047b/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:37.668420 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e142ae9-5432-454d-ac86-a38a1f6e0035 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:37.718094 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f794ffc-98c9-425c-b772-aaf0663af019 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:37.738084 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e142ae9-5432-454d-ac86-a38a1f6e0035 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:37.742701 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df99218f-c1cf-4441-8afb-433b7b02b741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:37.743990 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99218f-c1cf-4441-8afb-433b7b02b741 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:37.744268 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99218f-c1cf-4441-8afb-433b7b02b741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:37.744542 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99218f-c1cf-4441-8afb-433b7b02b741 admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:37.745255 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df99218f-c1cf-4441-8afb-433b7b02b741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:37.746875 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df99218f-c1cf-4441-8afb-433b7b02b741 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:37.757613 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 953/1912] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:18:37.761579 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df99218f-c1cf-4441-8afb-433b7b02b741 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:37.769572 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9de38f-f98f-4cb0-80fa-79b6e7dabce0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:37.770226 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9de38f-f98f-4cb0-80fa-79b6e7dabce0 service cinder] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:37.770507 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9de38f-f98f-4cb0-80fa-79b6e7dabce0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:37.770658 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df99218f-c1cf-4441-8afb-433b7b02b741 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:37.770783 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9de38f-f98f-4cb0-80fa-79b6e7dabce0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:37.775193 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c577aa4-7e5f-43c1-ace7-5c5ade9d3c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:37.776076 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c577aa4-7e5f-43c1-ace7-5c5ade9d3c07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:37.776353 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c577aa4-7e5f-43c1-ace7-5c5ade9d3c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:37.776619 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c577aa4-7e5f-43c1-ace7-5c5ade9d3c07 admin admin] PATH_INFO: `/v3/projects/d1829c0880ee40b69f86e5e2695c8697/users/28e16daf912f456ab7307248cc0d047b/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:37.778590 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c577aa4-7e5f-43c1-ace7-5c5ade9d3c07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1829c0880ee40b69f86e5e2695c8697, user_id=28e16daf912f456ab7307248cc0d047b, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:37.781167 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c577aa4-7e5f-43c1-ace7-5c5ade9d3c07 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:37.791679 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 954/1913] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:18:37 2022] PUT /identity/v3/projects/d1829c0880ee40b69f86e5e2695c8697/users/28e16daf912f456ab7307248cc0d047b/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:18:37.802451 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25302261-76e5-468d-a9c7-b3f934fa2a17 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:37.802897 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25302261-76e5-468d-a9c7-b3f934fa2a17 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:37.803180 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25302261-76e5-468d-a9c7-b3f934fa2a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:37.829249 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-25302261-76e5-468d-a9c7-b3f934fa2a17 None None] MFA Rules not processed for user `28e16daf912f456ab7307248cc0d047b`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:37.829563 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9de38f-f98f-4cb0-80fa-79b6e7dabce0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:37.830482 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-25302261-76e5-468d-a9c7-b3f934fa2a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:37.831180 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9de38f-f98f-4cb0-80fa-79b6e7dabce0 service cinder] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:37.841784 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 960/1914] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:18:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:18:37.911931 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 955/1915] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:37 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:18:37.925904 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9de38f-f98f-4cb0-80fa-79b6e7dabce0 service cinder] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:37.935177 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9de38f-f98f-4cb0-80fa-79b6e7dabce0 service cinder] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:38.010727 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229cf0c7-40df-449a-9c3b-d245a645c6d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:38.012384 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229cf0c7-40df-449a-9c3b-d245a645c6d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:38.013641 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229cf0c7-40df-449a-9c3b-d245a645c6d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:38.014902 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229cf0c7-40df-449a-9c3b-d245a645c6d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:38.029939 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229cf0c7-40df-449a-9c3b-d245a645c6d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:38.032130 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229cf0c7-40df-449a-9c3b-d245a645c6d6 service cinder] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:38.042652 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 961/1916] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:18:37 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:18:38.519244 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25302261-76e5-468d-a9c7-b3f934fa2a17 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:38.588124 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229cf0c7-40df-449a-9c3b-d245a645c6d6 service cinder] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:38.589690 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-229cf0c7-40df-449a-9c3b-d245a645c6d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:38.602267 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25302261-76e5-468d-a9c7-b3f934fa2a17 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:38.606974 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ceee8a-91ce-4ca6-8e78-d832244b3810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:38.607868 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ceee8a-91ce-4ca6-8e78-d832244b3810 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:38.608114 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ceee8a-91ce-4ca6-8e78-d832244b3810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:38.608398 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ceee8a-91ce-4ca6-8e78-d832244b3810 admin admin] PATH_INFO: `/v3/users/6d48e2381bbc4fa492f477af01e9d90c` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:38.609640 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ceee8a-91ce-4ca6-8e78-d832244b3810 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d48e2381bbc4fa492f477af01e9d90c)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:38.611555 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ceee8a-91ce-4ca6-8e78-d832244b3810 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:38.656445 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229cf0c7-40df-449a-9c3b-d245a645c6d6 service cinder] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:38.661187 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af2c70-a4d5-44f4-b723-177d70d90a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:38.662240 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af2c70-a4d5-44f4-b723-177d70d90a8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:38.662723 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af2c70-a4d5-44f4-b723-177d70d90a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:38.663201 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af2c70-a4d5-44f4-b723-177d70d90a8a admin admin] PATH_INFO: `/v3/users/d807c2875e8742bb856e96715433b3f9` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:38.664491 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af2c70-a4d5-44f4-b723-177d70d90a8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d807c2875e8742bb856e96715433b3f9)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:38.666143 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-a3ceee8a-91ce-4ca6-8e78-d832244b3810 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d48e2381bbc4fa492f477af01e9d90c'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:38.666519 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af2c70-a4d5-44f4-b723-177d70d90a8a admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:38.672602 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-a3ceee8a-91ce-4ca6-8e78-d832244b3810 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d48e2381bbc4fa492f477af01e9d90c'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:38.673279 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-a3ceee8a-91ce-4ca6-8e78-d832244b3810 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d48e2381bbc4fa492f477af01e9d90c'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:38.682598 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-a3ceee8a-91ce-4ca6-8e78-d832244b3810 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d48e2381bbc4fa492f477af01e9d90c'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:38.683220 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-a3ceee8a-91ce-4ca6-8e78-d832244b3810 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d48e2381bbc4fa492f477af01e9d90c'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:38.707091 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 956/1917] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:18:38 2022] DELETE /identity/v3/users/6d48e2381bbc4fa492f477af01e9d90c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:38.711501 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bdad8b-3151-412a-905e-23b951f77289 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:38.712276 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bdad8b-3151-412a-905e-23b951f77289 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:38.712698 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bdad8b-3151-412a-905e-23b951f77289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:38.722197 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-37af2c70-a4d5-44f4-b723-177d70d90a8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd807c2875e8742bb856e96715433b3f9'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:38.740570 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-37af2c70-a4d5-44f4-b723-177d70d90a8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd807c2875e8742bb856e96715433b3f9'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:38.741357 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-37af2c70-a4d5-44f4-b723-177d70d90a8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd807c2875e8742bb856e96715433b3f9'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:38.742178 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-37af2c70-a4d5-44f4-b723-177d70d90a8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd807c2875e8742bb856e96715433b3f9'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:38.748771 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-86bdad8b-3151-412a-905e-23b951f77289 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:38.750551 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-86bdad8b-3151-412a-905e-23b951f77289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:38.751245 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-37af2c70-a4d5-44f4-b723-177d70d90a8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd807c2875e8742bb856e96715433b3f9'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:38.770103 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 962/1918] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:18:38 2022] DELETE /identity/v3/users/d807c2875e8742bb856e96715433b3f9 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:18:38.774880 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6fb3d-00e7-4e8a-b61c-17a59d5f3208 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:38.775506 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6fb3d-00e7-4e8a-b61c-17a59d5f3208 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:38.776217 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6fb3d-00e7-4e8a-b61c-17a59d5f3208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:38.801624 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-60e6fb3d-00e7-4e8a-b61c-17a59d5f3208 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:38.803594 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-60e6fb3d-00e7-4e8a-b61c-17a59d5f3208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:38.821666 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 957/1919] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:38.833497 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bdad8b-3151-412a-905e-23b951f77289 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:38.838903 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-86bdad8b-3151-412a-905e-23b951f77289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:38.917721 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 963/1920] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:18:38.925547 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6fb3d-00e7-4e8a-b61c-17a59d5f3208 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:38.926762 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-60e6fb3d-00e7-4e8a-b61c-17a59d5f3208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:38.955409 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bdad8b-3151-412a-905e-23b951f77289 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:39.032568 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6fb3d-00e7-4e8a-b61c-17a59d5f3208 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:39.043909 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d841fa48-1e4e-4709-81c7-e646612fc4a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:39.044580 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d841fa48-1e4e-4709-81c7-e646612fc4a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:39.045004 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d841fa48-1e4e-4709-81c7-e646612fc4a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:39.045284 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d841fa48-1e4e-4709-81c7-e646612fc4a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:39.050230 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa6db7-6a6e-4025-bf26-077fef0f09d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:39.051048 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa6db7-6a6e-4025-bf26-077fef0f09d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:39.051449 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa6db7-6a6e-4025-bf26-077fef0f09d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:39.051860 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa6db7-6a6e-4025-bf26-077fef0f09d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:39.060984 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d841fa48-1e4e-4709-81c7-e646612fc4a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:39.062532 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d841fa48-1e4e-4709-81c7-e646612fc4a2 service neutron] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:39.063063 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aa6db7-6a6e-4025-bf26-077fef0f09d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:39.064657 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aa6db7-6a6e-4025-bf26-077fef0f09d4 service neutron] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:39.072522 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 964/1921] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:18:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:18:39.078250 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 958/1922] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:18:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:18:39.616609 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d841fa48-1e4e-4709-81c7-e646612fc4a2 service neutron] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:39.619220 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-d841fa48-1e4e-4709-81c7-e646612fc4a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:39.643375 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d841fa48-1e4e-4709-81c7-e646612fc4a2 service neutron] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:39.659972 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c337155-c483-4ba5-bf56-47a5cbacb34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:39.666202 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c337155-c483-4ba5-bf56-47a5cbacb34a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:39.668243 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c337155-c483-4ba5-bf56-47a5cbacb34a admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:39.671680 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c337155-c483-4ba5-bf56-47a5cbacb34a admin admin] PATH_INFO: `/v3/projects/d5305be0c4f24726aeb71376dc09926e` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:39.674712 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c337155-c483-4ba5-bf56-47a5cbacb34a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5305be0c4f24726aeb71376dc09926e)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:39.680474 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa6db7-6a6e-4025-bf26-077fef0f09d4 service neutron] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:39.680990 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c337155-c483-4ba5-bf56-47a5cbacb34a admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:39.683664 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-24aa6db7-6a6e-4025-bf26-077fef0f09d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:39.710744 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa6db7-6a6e-4025-bf26-077fef0f09d4 service neutron] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:39.723226 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b28a7a-d7d6-4b00-883a-5024c4888787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:39.725497 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b28a7a-d7d6-4b00-883a-5024c4888787 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:39.725842 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b28a7a-d7d6-4b00-883a-5024c4888787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:39.726830 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b28a7a-d7d6-4b00-883a-5024c4888787 admin admin] PATH_INFO: `/v3/projects/1ad57e24427042fb893ab609dd5ce9c1` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:39.730435 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b28a7a-d7d6-4b00-883a-5024c4888787 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ad57e24427042fb893ab609dd5ce9c1)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:39.733218 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b28a7a-d7d6-4b00-883a-5024c4888787 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:39.760215 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-9c337155-c483-4ba5-bf56-47a5cbacb34a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5305be0c4f24726aeb71376dc09926e', 'request_id': 'req-9c337155-c483-4ba5-bf56-47a5cbacb34a'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:39.767714 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-9c337155-c483-4ba5-bf56-47a5cbacb34a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5305be0c4f24726aeb71376dc09926e', 'request_id': 'req-9c337155-c483-4ba5-bf56-47a5cbacb34a'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:39.782806 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-9c337155-c483-4ba5-bf56-47a5cbacb34a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5305be0c4f24726aeb71376dc09926e', 'request_id': 'req-9c337155-c483-4ba5-bf56-47a5cbacb34a'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:39.821193 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-9c337155-c483-4ba5-bf56-47a5cbacb34a admin admin] The token cache is being invalidate because project d5305be0c4f24726aeb71376dc09926e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:18:39.821682 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-9c337155-c483-4ba5-bf56-47a5cbacb34a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:39.822983 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-9c337155-c483-4ba5-bf56-47a5cbacb34a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:39.830844 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 965/1923] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:18:39 2022] DELETE /identity/v3/projects/d5305be0c4f24726aeb71376dc09926e => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:39.836067 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c337155-c483-4ba5-bf56-47a5cbacb34a admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:39.847217 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-9c337155-c483-4ba5-bf56-47a5cbacb34a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:39.862953 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-93b28a7a-d7d6-4b00-883a-5024c4888787 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ad57e24427042fb893ab609dd5ce9c1', 'request_id': 'req-93b28a7a-d7d6-4b00-883a-5024c4888787'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:39.872864 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-93b28a7a-d7d6-4b00-883a-5024c4888787 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ad57e24427042fb893ab609dd5ce9c1', 'request_id': 'req-93b28a7a-d7d6-4b00-883a-5024c4888787'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:39.901451 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-93b28a7a-d7d6-4b00-883a-5024c4888787 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ad57e24427042fb893ab609dd5ce9c1', 'request_id': 'req-93b28a7a-d7d6-4b00-883a-5024c4888787'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:39.918779 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-93b28a7a-d7d6-4b00-883a-5024c4888787 admin admin] The token cache is being invalidate because project 1ad57e24427042fb893ab609dd5ce9c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:18:39.919071 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-93b28a7a-d7d6-4b00-883a-5024c4888787 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:39.920054 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-93b28a7a-d7d6-4b00-883a-5024c4888787 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:39.923957 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 959/1924] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:18:39 2022] DELETE /identity/v3/projects/1ad57e24427042fb893ab609dd5ce9c1 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:39.928716 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b28a7a-d7d6-4b00-883a-5024c4888787 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:39.931046 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-93b28a7a-d7d6-4b00-883a-5024c4888787 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:39.986643 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c337155-c483-4ba5-bf56-47a5cbacb34a admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:40.017199 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b28a7a-d7d6-4b00-883a-5024c4888787 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:40.024771 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc75c7df-a1af-4c70-9a78-ba68b67f9fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:40.026154 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75c7df-a1af-4c70-9a78-ba68b67f9fe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:40.026154 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75c7df-a1af-4c70-9a78-ba68b67f9fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:40.026515 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75c7df-a1af-4c70-9a78-ba68b67f9fe5 admin admin] PATH_INFO: `/v3/users/110d4604834d4a958335f0bc344997a6` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:40.027625 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc75c7df-a1af-4c70-9a78-ba68b67f9fe5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=110d4604834d4a958335f0bc344997a6)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:40.031352 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc75c7df-a1af-4c70-9a78-ba68b67f9fe5 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:40.062301 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc97098-f201-4397-8821-d3bbeedaf59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:40.064687 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc97098-f201-4397-8821-d3bbeedaf59d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:40.065095 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc97098-f201-4397-8821-d3bbeedaf59d admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:40.065499 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc97098-f201-4397-8821-d3bbeedaf59d admin admin] PATH_INFO: `/v3/users/28e16daf912f456ab7307248cc0d047b` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:40.067038 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc97098-f201-4397-8821-d3bbeedaf59d admin admin] RBAC: Authorizing `identity:delete_user(user_id=28e16daf912f456ab7307248cc0d047b)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:40.068856 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc97098-f201-4397-8821-d3bbeedaf59d admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:40.081229 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-fc75c7df-a1af-4c70-9a78-ba68b67f9fe5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '110d4604834d4a958335f0bc344997a6'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:40.089196 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-fc75c7df-a1af-4c70-9a78-ba68b67f9fe5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '110d4604834d4a958335f0bc344997a6'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:40.089927 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-fc75c7df-a1af-4c70-9a78-ba68b67f9fe5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '110d4604834d4a958335f0bc344997a6'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:40.099762 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-fc75c7df-a1af-4c70-9a78-ba68b67f9fe5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '110d4604834d4a958335f0bc344997a6'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:40.100446 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-fc75c7df-a1af-4c70-9a78-ba68b67f9fe5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '110d4604834d4a958335f0bc344997a6'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:40.118409 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-9dc97098-f201-4397-8821-d3bbeedaf59d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28e16daf912f456ab7307248cc0d047b'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:40.120518 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 960/1925] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:18:39 2022] DELETE /identity/v3/users/110d4604834d4a958335f0bc344997a6 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:18:40.130253 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-9dc97098-f201-4397-8821-d3bbeedaf59d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28e16daf912f456ab7307248cc0d047b'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:40.130964 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-9dc97098-f201-4397-8821-d3bbeedaf59d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28e16daf912f456ab7307248cc0d047b'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:40.131601 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-9dc97098-f201-4397-8821-d3bbeedaf59d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28e16daf912f456ab7307248cc0d047b'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:40.138830 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-9dc97098-f201-4397-8821-d3bbeedaf59d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28e16daf912f456ab7307248cc0d047b'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:40.153500 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 966/1926] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:18:39 2022] DELETE /identity/v3/users/28e16daf912f456ab7307248cc0d047b => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:40.562207 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc75c7df-a1af-4c70-9a78-ba68b67f9fe5 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:40.563921 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-fc75c7df-a1af-4c70-9a78-ba68b67f9fe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:40.567110 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc97098-f201-4397-8821-d3bbeedaf59d admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:40.569204 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-9dc97098-f201-4397-8821-d3bbeedaf59d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:40.659936 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc97098-f201-4397-8821-d3bbeedaf59d admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:40.662364 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc75c7df-a1af-4c70-9a78-ba68b67f9fe5 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:40.664383 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ef9611-0c0d-467f-9498-d0eec43ef76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:40.665258 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef9611-0c0d-467f-9498-d0eec43ef76d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:40.665569 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef9611-0c0d-467f-9498-d0eec43ef76d admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:40.665842 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef9611-0c0d-467f-9498-d0eec43ef76d admin admin] PATH_INFO: `/v3/projects/c5747f8e1d7844e3826c338f4ae953f1` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:40.667001 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ef9611-0c0d-467f-9498-d0eec43ef76d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5747f8e1d7844e3826c338f4ae953f1)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:40.667554 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f8f3e-bcf3-422f-9bb7-76d3365166b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:40.668080 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f8f3e-bcf3-422f-9bb7-76d3365166b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:40.668363 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f8f3e-bcf3-422f-9bb7-76d3365166b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:40.668642 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f8f3e-bcf3-422f-9bb7-76d3365166b6 admin admin] PATH_INFO: `/v3/projects/d1829c0880ee40b69f86e5e2695c8697` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:40.668886 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ef9611-0c0d-467f-9498-d0eec43ef76d admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:40.669896 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72f8f3e-bcf3-422f-9bb7-76d3365166b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1829c0880ee40b69f86e5e2695c8697)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:40.671805 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72f8f3e-bcf3-422f-9bb7-76d3365166b6 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:40.719133 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-86ef9611-0c0d-467f-9498-d0eec43ef76d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5747f8e1d7844e3826c338f4ae953f1', 'request_id': 'req-86ef9611-0c0d-467f-9498-d0eec43ef76d'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:40.723527 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-c72f8f3e-bcf3-422f-9bb7-76d3365166b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1829c0880ee40b69f86e5e2695c8697', 'request_id': 'req-c72f8f3e-bcf3-422f-9bb7-76d3365166b6'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:40.725367 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-86ef9611-0c0d-467f-9498-d0eec43ef76d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5747f8e1d7844e3826c338f4ae953f1', 'request_id': 'req-86ef9611-0c0d-467f-9498-d0eec43ef76d'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:40.729960 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-c72f8f3e-bcf3-422f-9bb7-76d3365166b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1829c0880ee40b69f86e5e2695c8697', 'request_id': 'req-c72f8f3e-bcf3-422f-9bb7-76d3365166b6'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:40.733299 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-86ef9611-0c0d-467f-9498-d0eec43ef76d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5747f8e1d7844e3826c338f4ae953f1', 'request_id': 'req-86ef9611-0c0d-467f-9498-d0eec43ef76d'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:40.737713 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-c72f8f3e-bcf3-422f-9bb7-76d3365166b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1829c0880ee40b69f86e5e2695c8697', 'request_id': 'req-c72f8f3e-bcf3-422f-9bb7-76d3365166b6'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:40.744177 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-86ef9611-0c0d-467f-9498-d0eec43ef76d admin admin] The token cache is being invalidate because project c5747f8e1d7844e3826c338f4ae953f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:18:40.744462 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-86ef9611-0c0d-467f-9498-d0eec43ef76d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:40.745105 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-86ef9611-0c0d-467f-9498-d0eec43ef76d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:40.746698 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 967/1927] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:18:40 2022] DELETE /identity/v3/projects/c5747f8e1d7844e3826c338f4ae953f1 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:18:40.750663 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ef9611-0c0d-467f-9498-d0eec43ef76d admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:40.750812 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-c72f8f3e-bcf3-422f-9bb7-76d3365166b6 admin admin] The token cache is being invalidate because project d1829c0880ee40b69f86e5e2695c8697 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:18:40.750981 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-c72f8f3e-bcf3-422f-9bb7-76d3365166b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:40.751648 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-c72f8f3e-bcf3-422f-9bb7-76d3365166b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:40.751982 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-86ef9611-0c0d-467f-9498-d0eec43ef76d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:40.753347 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 961/1928] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:18:40 2022] DELETE /identity/v3/projects/d1829c0880ee40b69f86e5e2695c8697 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:40.759052 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1190e820-23dd-41ce-be18-ff8932618411 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:40.759338 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1190e820-23dd-41ce-be18-ff8932618411 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:40.759617 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1190e820-23dd-41ce-be18-ff8932618411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:40.778111 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-1190e820-23dd-41ce-be18-ff8932618411 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:40.779410 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-1190e820-23dd-41ce-be18-ff8932618411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:40.814715 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ef9611-0c0d-467f-9498-d0eec43ef76d admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:40.843508 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 962/1929] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:18:40.844530 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4158f61-026b-4065-ae95-63217a1e1896 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:40.845286 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4158f61-026b-4065-ae95-63217a1e1896 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:40.845606 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4158f61-026b-4065-ae95-63217a1e1896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:40.863687 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-d4158f61-026b-4065-ae95-63217a1e1896 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:40.864914 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-d4158f61-026b-4065-ae95-63217a1e1896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:40.870243 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07641e18-d427-4877-b696-68b77aaa60f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:40.871112 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07641e18-d427-4877-b696-68b77aaa60f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:40.871387 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07641e18-d427-4877-b696-68b77aaa60f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:40.871654 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07641e18-d427-4877-b696-68b77aaa60f5 admin admin] PATH_INFO: `/v3/users/1512edc4446749e5a10e9bb7bc7ac59c` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:40.872773 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 963/1930] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:18:40.876242 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07641e18-d427-4877-b696-68b77aaa60f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1512edc4446749e5a10e9bb7bc7ac59c)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:40.876242 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07641e18-d427-4877-b696-68b77aaa60f5 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:40.877025 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4158f61-026b-4065-ae95-63217a1e1896 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:40.886300 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4158f61-026b-4065-ae95-63217a1e1896 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:40.890914 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5187e-4abd-452f-bddf-1d68566e4c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:40.891548 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5187e-4abd-452f-bddf-1d68566e4c4e admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:40.891828 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5187e-4abd-452f-bddf-1d68566e4c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:40.892101 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb5187e-4abd-452f-bddf-1d68566e4c4e admin admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:40.892837 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb5187e-4abd-452f-bddf-1d68566e4c4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:18:40.893141 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb5187e-4abd-452f-bddf-1d68566e4c4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:40.894785 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb5187e-4abd-452f-bddf-1d68566e4c4e admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:40.907934 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 964/1931] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 17 18:18:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:18:40.912636 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5187e-4abd-452f-bddf-1d68566e4c4e admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:40.924540 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb5187e-4abd-452f-bddf-1d68566e4c4e admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:40.929236 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2909752b-bea3-4816-9c95-d043e8bdfb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:40.929912 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909752b-bea3-4816-9c95-d043e8bdfb19 admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:40.930314 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909752b-bea3-4816-9c95-d043e8bdfb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:40.930492 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909752b-bea3-4816-9c95-d043e8bdfb19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:40.931342 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2909752b-bea3-4816-9c95-d043e8bdfb19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:40.931460 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-07641e18-d427-4877-b696-68b77aaa60f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1512edc4446749e5a10e9bb7bc7ac59c'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:40.933242 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2909752b-bea3-4816-9c95-d043e8bdfb19 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:40.946320 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-07641e18-d427-4877-b696-68b77aaa60f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1512edc4446749e5a10e9bb7bc7ac59c'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:40.947809 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-07641e18-d427-4877-b696-68b77aaa60f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1512edc4446749e5a10e9bb7bc7ac59c'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:40.949938 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-07641e18-d427-4877-b696-68b77aaa60f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1512edc4446749e5a10e9bb7bc7ac59c'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:40.958819 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-07641e18-d427-4877-b696-68b77aaa60f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1512edc4446749e5a10e9bb7bc7ac59c'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:40.960745 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 965/1932] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:18:40 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:18:40.966080 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2909752b-bea3-4816-9c95-d043e8bdfb19 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:40.967838 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-2909752b-bea3-4816-9c95-d043e8bdfb19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:40.980214 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 968/1933] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:18:40 2022] DELETE /identity/v3/users/1512edc4446749e5a10e9bb7bc7ac59c => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:18:41.046136 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2909752b-bea3-4816-9c95-d043e8bdfb19 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:41.133865 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b5289d-2a81-4b03-a282-115d9740d89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:41.134723 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5289d-2a81-4b03-a282-115d9740d89d admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:41.135072 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5289d-2a81-4b03-a282-115d9740d89d admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:41.135546 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5289d-2a81-4b03-a282-115d9740d89d admin admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:41.138167 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b5289d-2a81-4b03-a282-115d9740d89d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:41.140312 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b5289d-2a81-4b03-a282-115d9740d89d admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:41.186179 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 966/1934] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:18:40 2022] POST /identity/v3/users => generated 293 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:18:41.190332 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07641e18-d427-4877-b696-68b77aaa60f5 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:41.207227 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07641e18-d427-4877-b696-68b77aaa60f5 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:41.227272 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ffe71-b99a-4032-81da-fd0560320c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:41.227968 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ffe71-b99a-4032-81da-fd0560320c13 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:41.228253 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ffe71-b99a-4032-81da-fd0560320c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:41.228535 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ffe71-b99a-4032-81da-fd0560320c13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:41.229858 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ffe71-b99a-4032-81da-fd0560320c13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:41.230931 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ffe71-b99a-4032-81da-fd0560320c13 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:41.254808 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 969/1935] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:18:41 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:18:41.259958 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b5289d-2a81-4b03-a282-115d9740d89d admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:41.273299 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b5289d-2a81-4b03-a282-115d9740d89d admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:41.280491 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2352727a-d561-4678-8b8c-dd1b97a403f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:41.309391 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352727a-d561-4678-8b8c-dd1b97a403f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:41.311962 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352727a-d561-4678-8b8c-dd1b97a403f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:41.312468 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352727a-d561-4678-8b8c-dd1b97a403f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:41.314630 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2352727a-d561-4678-8b8c-dd1b97a403f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:41.318281 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2352727a-d561-4678-8b8c-dd1b97a403f9 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:41.348389 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 967/1936] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:18:41 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:18:41.352912 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ffe71-b99a-4032-81da-fd0560320c13 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:41.374332 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ffe71-b99a-4032-81da-fd0560320c13 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:41.390525 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41767b1-aab6-49db-99a2-c79970f61f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:41.393013 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41767b1-aab6-49db-99a2-c79970f61f64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:41.393308 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41767b1-aab6-49db-99a2-c79970f61f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:41.396481 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41767b1-aab6-49db-99a2-c79970f61f64 admin admin] PATH_INFO: `/v3/projects/7ab166dd1a1d4902b2e3eb74997ecbfd/users/9a8de63aa3c84047bce4df34ae1a5e8e/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:41.425806 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41767b1-aab6-49db-99a2-c79970f61f64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ab166dd1a1d4902b2e3eb74997ecbfd, user_id=9a8de63aa3c84047bce4df34ae1a5e8e, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:41.433678 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41767b1-aab6-49db-99a2-c79970f61f64 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:41.449561 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 970/1937] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:18:41 2022] PUT /identity/v3/projects/7ab166dd1a1d4902b2e3eb74997ecbfd/users/9a8de63aa3c84047bce4df34ae1a5e8e/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:18:41.460899 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e6386-2920-47cc-9cfd-413fceefddf0 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:41.461262 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e6386-2920-47cc-9cfd-413fceefddf0 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:41.461574 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e6386-2920-47cc-9cfd-413fceefddf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:41.510904 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-d50e6386-2920-47cc-9cfd-413fceefddf0 None None] MFA Rules not processed for user `9a8de63aa3c84047bce4df34ae1a5e8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:41.512310 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-d50e6386-2920-47cc-9cfd-413fceefddf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:41.648192 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 968/1938] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:41.653892 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41767b1-aab6-49db-99a2-c79970f61f64 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:41.716093 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e6386-2920-47cc-9cfd-413fceefddf0 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:41.719123 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-d50e6386-2920-47cc-9cfd-413fceefddf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:41.779696 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41767b1-aab6-49db-99a2-c79970f61f64 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:41.800515 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d60751-e75c-4a70-bbb1-bb20ed2bd018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:41.801200 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d60751-e75c-4a70-bbb1-bb20ed2bd018 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:41.801499 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d60751-e75c-4a70-bbb1-bb20ed2bd018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:41.801778 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d60751-e75c-4a70-bbb1-bb20ed2bd018 admin admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:41.802486 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d60751-e75c-4a70-bbb1-bb20ed2bd018 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:41.804432 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d60751-e75c-4a70-bbb1-bb20ed2bd018 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:41.824250 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e6386-2920-47cc-9cfd-413fceefddf0 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:41.835383 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67fef6a-b5dc-4f56-a363-c12bc498f3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:41.836899 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67fef6a-b5dc-4f56-a363-c12bc498f3e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:41.837217 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67fef6a-b5dc-4f56-a363-c12bc498f3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:41.837616 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67fef6a-b5dc-4f56-a363-c12bc498f3e3 admin admin] PATH_INFO: `/v3/projects/4a5b31c8bace411d96e81280ed5aab3a` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:41.838901 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67fef6a-b5dc-4f56-a363-c12bc498f3e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a5b31c8bace411d96e81280ed5aab3a)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:41.839895 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 971/1939] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:18:41 2022] POST /identity/v3/projects => generated 387 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:18:41.840973 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67fef6a-b5dc-4f56-a363-c12bc498f3e3 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:41.844340 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d60751-e75c-4a70-bbb1-bb20ed2bd018 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:41.898024 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-f67fef6a-b5dc-4f56-a363-c12bc498f3e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a5b31c8bace411d96e81280ed5aab3a', 'request_id': 'req-f67fef6a-b5dc-4f56-a363-c12bc498f3e3'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:41.906328 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-f67fef6a-b5dc-4f56-a363-c12bc498f3e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a5b31c8bace411d96e81280ed5aab3a', 'request_id': 'req-f67fef6a-b5dc-4f56-a363-c12bc498f3e3'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:41.916991 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d60751-e75c-4a70-bbb1-bb20ed2bd018 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:41.917576 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-f67fef6a-b5dc-4f56-a363-c12bc498f3e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a5b31c8bace411d96e81280ed5aab3a', 'request_id': 'req-f67fef6a-b5dc-4f56-a363-c12bc498f3e3'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:41.929824 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-f67fef6a-b5dc-4f56-a363-c12bc498f3e3 admin admin] The token cache is being invalidate because project 4a5b31c8bace411d96e81280ed5aab3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:18:41.930163 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-f67fef6a-b5dc-4f56-a363-c12bc498f3e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:41.930974 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-f67fef6a-b5dc-4f56-a363-c12bc498f3e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:41.935886 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 969/1940] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:18:41 2022] DELETE /identity/v3/projects/4a5b31c8bace411d96e81280ed5aab3a => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:18:41.937779 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339026bf-5251-4c25-b104-f564e58483ab None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:41.938134 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339026bf-5251-4c25-b104-f564e58483ab None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:41.938494 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339026bf-5251-4c25-b104-f564e58483ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:41.974038 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-339026bf-5251-4c25-b104-f564e58483ab None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:41.975285 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-339026bf-5251-4c25-b104-f564e58483ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:41.989500 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87ea0f2-9928-46c7-a0f1-4cfa6e0fb1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:41.990374 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ea0f2-9928-46c7-a0f1-4cfa6e0fb1dd admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:41.990676 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ea0f2-9928-46c7-a0f1-4cfa6e0fb1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:41.991014 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87ea0f2-9928-46c7-a0f1-4cfa6e0fb1dd admin admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:41.991785 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87ea0f2-9928-46c7-a0f1-4cfa6e0fb1dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:41.994053 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87ea0f2-9928-46c7-a0f1-4cfa6e0fb1dd admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:41.996695 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 970/1941] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:18:42.008998 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be9713-31d1-4539-8f45-02e261b688d7 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:42.009382 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be9713-31d1-4539-8f45-02e261b688d7 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:42.010124 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be9713-31d1-4539-8f45-02e261b688d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:42.017558 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 972/1942] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:18:41 2022] POST /identity/v3/users => generated 300 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:18:42.021027 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87ea0f2-9928-46c7-a0f1-4cfa6e0fb1dd admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:42.022838 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-c87ea0f2-9928-46c7-a0f1-4cfa6e0fb1dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:42.033599 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-a8be9713-31d1-4539-8f45-02e261b688d7 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:42.034939 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-a8be9713-31d1-4539-8f45-02e261b688d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:42.035584 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87ea0f2-9928-46c7-a0f1-4cfa6e0fb1dd admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:42.042117 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be27b009-7941-4017-a4e4-c98623559f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:42.042788 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27b009-7941-4017-a4e4-c98623559f50 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:42.043065 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27b009-7941-4017-a4e4-c98623559f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:42.043336 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be27b009-7941-4017-a4e4-c98623559f50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:42.044335 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be27b009-7941-4017-a4e4-c98623559f50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:42.045141 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 971/1943] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:42.046361 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be27b009-7941-4017-a4e4-c98623559f50 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:42.049385 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be9713-31d1-4539-8f45-02e261b688d7 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:42.059668 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 973/1944] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:18:42.059810 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be9713-31d1-4539-8f45-02e261b688d7 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:42.060682 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be27b009-7941-4017-a4e4-c98623559f50 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:42.063013 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8052bec-6f52-4432-b719-4500e47b2f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:42.063652 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8052bec-6f52-4432-b719-4500e47b2f0c admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:42.063928 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8052bec-6f52-4432-b719-4500e47b2f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:42.064199 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8052bec-6f52-4432-b719-4500e47b2f0c admin admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:42.064938 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8052bec-6f52-4432-b719-4500e47b2f0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:18:42.065287 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8052bec-6f52-4432-b719-4500e47b2f0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:42.066905 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8052bec-6f52-4432-b719-4500e47b2f0c admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:42.070380 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be27b009-7941-4017-a4e4-c98623559f50 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:42.075537 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0d62a-ba70-41ef-8956-375960e92d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:42.076327 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0d62a-ba70-41ef-8956-375960e92d70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:42.076603 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0d62a-ba70-41ef-8956-375960e92d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:42.076875 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0d62a-ba70-41ef-8956-375960e92d70 admin admin] PATH_INFO: `/v3/projects/390f8a561df3403896fa17685726e78d/users/98eaae2a8bb246d79d340d0e5ed52314/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:42.082405 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 972/1945] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 17 18:18:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:18:42.083539 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8052bec-6f52-4432-b719-4500e47b2f0c admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:42.092853 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f0d62a-ba70-41ef-8956-375960e92d70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=390f8a561df3403896fa17685726e78d, user_id=98eaae2a8bb246d79d340d0e5ed52314, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:42.093315 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8052bec-6f52-4432-b719-4500e47b2f0c admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:42.095492 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f0d62a-ba70-41ef-8956-375960e92d70 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:42.097855 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9153f807-0a5a-490a-a492-eacdf1834c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:42.098587 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9153f807-0a5a-490a-a492-eacdf1834c15 admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:42.099025 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9153f807-0a5a-490a-a492-eacdf1834c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:42.099140 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9153f807-0a5a-490a-a492-eacdf1834c15 admin admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:42.099854 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9153f807-0a5a-490a-a492-eacdf1834c15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:42.102644 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9153f807-0a5a-490a-a492-eacdf1834c15 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:42.109684 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 974/1946] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:18:42 2022] PUT /identity/v3/projects/390f8a561df3403896fa17685726e78d/users/98eaae2a8bb246d79d340d0e5ed52314/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:42.113502 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0d62a-ba70-41ef-8956-375960e92d70 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:42.130810 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 973/1947] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:18:42 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:18:42.132050 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9153f807-0a5a-490a-a492-eacdf1834c15 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:42.178614 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0d62a-ba70-41ef-8956-375960e92d70 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:42.196328 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9153f807-0a5a-490a-a492-eacdf1834c15 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:42.201298 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9f5bf-5d3f-4991-a7b8-92847cb4a21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:42.202127 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9f5bf-5d3f-4991-a7b8-92847cb4a21f admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:42.202251 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9f5bf-5d3f-4991-a7b8-92847cb4a21f admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:42.202515 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9f5bf-5d3f-4991-a7b8-92847cb4a21f admin admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:42.203196 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd9f5bf-5d3f-4991-a7b8-92847cb4a21f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:42.205883 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd9f5bf-5d3f-4991-a7b8-92847cb4a21f admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:42.225764 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 974/1948] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:18:42 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:18:42.230816 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9f5bf-5d3f-4991-a7b8-92847cb4a21f admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:42.239925 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f4e5f-4902-4ee7-921c-c23b305167b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:42.240870 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f4e5f-4902-4ee7-921c-c23b305167b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:42.241262 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f4e5f-4902-4ee7-921c-c23b305167b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:42.241843 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f4e5f-4902-4ee7-921c-c23b305167b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:42.243287 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5f4e5f-4902-4ee7-921c-c23b305167b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:42.243549 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9f5bf-5d3f-4991-a7b8-92847cb4a21f admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:42.245173 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5f4e5f-4902-4ee7-921c-c23b305167b0 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:42.248510 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ffd55b-aa83-4fab-ac42-35e7208603a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:42.249178 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ffd55b-aa83-4fab-ac42-35e7208603a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:42.249440 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ffd55b-aa83-4fab-ac42-35e7208603a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:42.249741 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ffd55b-aa83-4fab-ac42-35e7208603a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:42.250466 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ffd55b-aa83-4fab-ac42-35e7208603a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:42.252040 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ffd55b-aa83-4fab-ac42-35e7208603a0 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:42.259830 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 975/1949] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:18:42.260670 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f4e5f-4902-4ee7-921c-c23b305167b0 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:42.262342 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 975/1950] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:18:42.265927 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ffd55b-aa83-4fab-ac42-35e7208603a0 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:42.273308 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f4e5f-4902-4ee7-921c-c23b305167b0 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:42.275832 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ffd55b-aa83-4fab-ac42-35e7208603a0 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:42.278167 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff2846-d06d-4b7b-bf9c-a1554a22f147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:42.279046 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff2846-d06d-4b7b-bf9c-a1554a22f147 admin admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:42.279326 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff2846-d06d-4b7b-bf9c-a1554a22f147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:42.279597 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff2846-d06d-4b7b-bf9c-a1554a22f147 admin admin] PATH_INFO: `/v3/projects/390f8a561df3403896fa17685726e78d/users/98eaae2a8bb246d79d340d0e5ed52314/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:42.281441 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07930411-d09b-47be-af8b-4f1480c263f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:42.281610 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff2846-d06d-4b7b-bf9c-a1554a22f147 admin admin] RBAC: Authorizing `identity:create_grant(project_id=390f8a561df3403896fa17685726e78d, user_id=98eaae2a8bb246d79d340d0e5ed52314, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:42.282112 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07930411-d09b-47be-af8b-4f1480c263f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:42.282393 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07930411-d09b-47be-af8b-4f1480c263f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:42.282803 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07930411-d09b-47be-af8b-4f1480c263f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:42.283550 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07930411-d09b-47be-af8b-4f1480c263f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:42.284267 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff2846-d06d-4b7b-bf9c-a1554a22f147 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:42.285079 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07930411-d09b-47be-af8b-4f1480c263f0 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:42.296588 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 976/1951] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:18:42.298065 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 976/1952] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:18:42 2022] PUT /identity/v3/projects/390f8a561df3403896fa17685726e78d/users/98eaae2a8bb246d79d340d0e5ed52314/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:42.308610 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07930411-d09b-47be-af8b-4f1480c263f0 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:42.311177 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ce103-dd51-4ca0-9caf-43208df09449 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:42.311534 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ce103-dd51-4ca0-9caf-43208df09449 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:42.311897 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ce103-dd51-4ca0-9caf-43208df09449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:42.319391 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07930411-d09b-47be-af8b-4f1480c263f0 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:42.346855 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-522ce103-dd51-4ca0-9caf-43208df09449 None None] MFA Rules not processed for user `98eaae2a8bb246d79d340d0e5ed52314`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:42.348955 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-522ce103-dd51-4ca0-9caf-43208df09449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:42.399676 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98310d-b077-45b0-aa64-8a86b789b643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:42.400643 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98310d-b077-45b0-aa64-8a86b789b643 admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:42.401099 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98310d-b077-45b0-aa64-8a86b789b643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:42.401928 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98310d-b077-45b0-aa64-8a86b789b643 admin admin] PATH_INFO: `/v3/projects/90b18b711b814afcbfbea43cd57effa9/users/31ee419c261c4b1ca95eef4b9bd81c11/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:42.419055 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d98310d-b077-45b0-aa64-8a86b789b643 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90b18b711b814afcbfbea43cd57effa9, user_id=31ee419c261c4b1ca95eef4b9bd81c11, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:42.422078 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d98310d-b077-45b0-aa64-8a86b789b643 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:42.453931 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 977/1953] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:42 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:42.454736 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 977/1954] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:18:42 2022] PUT /identity/v3/projects/90b18b711b814afcbfbea43cd57effa9/users/31ee419c261c4b1ca95eef4b9bd81c11/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:18:42.461069 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98310d-b077-45b0-aa64-8a86b789b643 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:42.462007 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28f87b-7f99-4acd-9bf1-04c73bf4770a None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:42.462288 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28f87b-7f99-4acd-9bf1-04c73bf4770a None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:42.474947 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28f87b-7f99-4acd-9bf1-04c73bf4770a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:42.482183 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-8d98310d-b077-45b0-aa64-8a86b789b643 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:42.523643 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-1f28f87b-7f99-4acd-9bf1-04c73bf4770a None None] MFA Rules not processed for user `31ee419c261c4b1ca95eef4b9bd81c11`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:42.525797 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-1f28f87b-7f99-4acd-9bf1-04c73bf4770a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:42.563541 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98310d-b077-45b0-aa64-8a86b789b643 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:42.567192 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648cec97-ddcd-4676-b41a-844a6ef16c25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:42.567863 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648cec97-ddcd-4676-b41a-844a6ef16c25 service cinder] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:42.568138 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648cec97-ddcd-4676-b41a-844a6ef16c25 service cinder] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:42.568406 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648cec97-ddcd-4676-b41a-844a6ef16c25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:42.606232 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 978/1955] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:42.643950 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648cec97-ddcd-4676-b41a-844a6ef16c25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:42.646156 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648cec97-ddcd-4676-b41a-844a6ef16c25 service cinder] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:42.665573 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f28f87b-7f99-4acd-9bf1-04c73bf4770a None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:42.666985 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-1f28f87b-7f99-4acd-9bf1-04c73bf4770a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:42.676791 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 978/1956] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:18:42 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:18:42.681616 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f28f87b-7f99-4acd-9bf1-04c73bf4770a None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:42.685906 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b869bd-0b76-4f8a-abc7-6b9d93446092 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:42.686686 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b869bd-0b76-4f8a-abc7-6b9d93446092 service cinder] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:42.686972 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b869bd-0b76-4f8a-abc7-6b9d93446092 service cinder] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:42.687242 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b869bd-0b76-4f8a-abc7-6b9d93446092 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:42.695174 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648cec97-ddcd-4676-b41a-844a6ef16c25 service cinder] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:42.703936 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b869bd-0b76-4f8a-abc7-6b9d93446092 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:42.706298 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b869bd-0b76-4f8a-abc7-6b9d93446092 service cinder] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:42.717104 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 979/1957] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:18:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:18:42.802817 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648cec97-ddcd-4676-b41a-844a6ef16c25 service cinder] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:42.809978 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f9c00-363e-4a5d-8797-7b081eb8d3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:42.811444 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f9c00-363e-4a5d-8797-7b081eb8d3d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:42.811723 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f9c00-363e-4a5d-8797-7b081eb8d3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:42.811990 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f9c00-363e-4a5d-8797-7b081eb8d3d1 admin admin] PATH_INFO: `/v3/users/9a8de63aa3c84047bce4df34ae1a5e8e` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:42.813247 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399f9c00-363e-4a5d-8797-7b081eb8d3d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a8de63aa3c84047bce4df34ae1a5e8e)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:42.815419 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399f9c00-363e-4a5d-8797-7b081eb8d3d1 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:42.878023 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-399f9c00-363e-4a5d-8797-7b081eb8d3d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a8de63aa3c84047bce4df34ae1a5e8e'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:42.890892 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-399f9c00-363e-4a5d-8797-7b081eb8d3d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a8de63aa3c84047bce4df34ae1a5e8e'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:42.891780 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-399f9c00-363e-4a5d-8797-7b081eb8d3d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a8de63aa3c84047bce4df34ae1a5e8e'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:42.906972 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-399f9c00-363e-4a5d-8797-7b081eb8d3d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a8de63aa3c84047bce4df34ae1a5e8e'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:42.907787 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-399f9c00-363e-4a5d-8797-7b081eb8d3d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a8de63aa3c84047bce4df34ae1a5e8e'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:42.934604 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 979/1958] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:18:42 2022] DELETE /identity/v3/users/9a8de63aa3c84047bce4df34ae1a5e8e => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:42.939384 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a7bcee-a291-4ae1-b44f-31e52634147d None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:42.939880 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a7bcee-a291-4ae1-b44f-31e52634147d None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:42.939978 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a7bcee-a291-4ae1-b44f-31e52634147d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:42.960708 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-d2a7bcee-a291-4ae1-b44f-31e52634147d None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:42.963001 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-d2a7bcee-a291-4ae1-b44f-31e52634147d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:43.055677 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 980/1959] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:43.064762 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f9c00-363e-4a5d-8797-7b081eb8d3d1 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:43.072173 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-399f9c00-363e-4a5d-8797-7b081eb8d3d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:43.201674 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f9c00-363e-4a5d-8797-7b081eb8d3d1 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:43.207824 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71250130-c2fe-43c1-9b09-ed9fa9ff67ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:43.208577 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71250130-c2fe-43c1-9b09-ed9fa9ff67ac service neutron] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:43.209578 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71250130-c2fe-43c1-9b09-ed9fa9ff67ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:43.209578 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71250130-c2fe-43c1-9b09-ed9fa9ff67ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:43.234005 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71250130-c2fe-43c1-9b09-ed9fa9ff67ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:43.235735 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71250130-c2fe-43c1-9b09-ed9fa9ff67ac service neutron] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:43.250582 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 980/1960] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:18:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:18:43.591861 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a7bcee-a291-4ae1-b44f-31e52634147d None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:43.593367 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-d2a7bcee-a291-4ae1-b44f-31e52634147d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:43.608879 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a7bcee-a291-4ae1-b44f-31e52634147d None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:43.613889 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecbf881-26e7-4212-9c26-82f842d4cc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:43.614946 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecbf881-26e7-4212-9c26-82f842d4cc4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:43.615228 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecbf881-26e7-4212-9c26-82f842d4cc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:43.615498 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecbf881-26e7-4212-9c26-82f842d4cc4a admin admin] PATH_INFO: `/v3/projects/7ab166dd1a1d4902b2e3eb74997ecbfd` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:43.616876 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecbf881-26e7-4212-9c26-82f842d4cc4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ab166dd1a1d4902b2e3eb74997ecbfd)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:43.619425 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecbf881-26e7-4212-9c26-82f842d4cc4a admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:43.672879 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-9ecbf881-26e7-4212-9c26-82f842d4cc4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ab166dd1a1d4902b2e3eb74997ecbfd', 'request_id': 'req-9ecbf881-26e7-4212-9c26-82f842d4cc4a'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:43.683511 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-9ecbf881-26e7-4212-9c26-82f842d4cc4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ab166dd1a1d4902b2e3eb74997ecbfd', 'request_id': 'req-9ecbf881-26e7-4212-9c26-82f842d4cc4a'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:43.692738 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-9ecbf881-26e7-4212-9c26-82f842d4cc4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ab166dd1a1d4902b2e3eb74997ecbfd', 'request_id': 'req-9ecbf881-26e7-4212-9c26-82f842d4cc4a'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:43.704241 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-9ecbf881-26e7-4212-9c26-82f842d4cc4a admin admin] The token cache is being invalidate because project 7ab166dd1a1d4902b2e3eb74997ecbfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:18:43.704523 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-9ecbf881-26e7-4212-9c26-82f842d4cc4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:43.705159 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-9ecbf881-26e7-4212-9c26-82f842d4cc4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:43.709967 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 981/1961] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:18:43 2022] DELETE /identity/v3/projects/7ab166dd1a1d4902b2e3eb74997ecbfd => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:43.711461 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71250130-c2fe-43c1-9b09-ed9fa9ff67ac service neutron] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:43.725959 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71250130-c2fe-43c1-9b09-ed9fa9ff67ac service neutron] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:43.804669 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc611b99-4c38-4b11-b587-da461a6d9ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:43.806133 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc611b99-4c38-4b11-b587-da461a6d9ea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:43.806418 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc611b99-4c38-4b11-b587-da461a6d9ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:43.807112 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc611b99-4c38-4b11-b587-da461a6d9ea0 admin admin] PATH_INFO: `/v3/users/98eaae2a8bb246d79d340d0e5ed52314` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:43.807862 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc611b99-4c38-4b11-b587-da461a6d9ea0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98eaae2a8bb246d79d340d0e5ed52314)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:43.810976 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc611b99-4c38-4b11-b587-da461a6d9ea0 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:43.879454 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-bc611b99-4c38-4b11-b587-da461a6d9ea0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98eaae2a8bb246d79d340d0e5ed52314'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:43.887267 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-bc611b99-4c38-4b11-b587-da461a6d9ea0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98eaae2a8bb246d79d340d0e5ed52314'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:43.887820 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-bc611b99-4c38-4b11-b587-da461a6d9ea0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98eaae2a8bb246d79d340d0e5ed52314'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:43.896634 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-bc611b99-4c38-4b11-b587-da461a6d9ea0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98eaae2a8bb246d79d340d0e5ed52314'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:43.897311 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-bc611b99-4c38-4b11-b587-da461a6d9ea0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98eaae2a8bb246d79d340d0e5ed52314'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:43.927028 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 981/1962] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:18:43 2022] DELETE /identity/v3/users/98eaae2a8bb246d79d340d0e5ed52314 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:44.359455 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecbf881-26e7-4212-9c26-82f842d4cc4a admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:44.361511 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-9ecbf881-26e7-4212-9c26-82f842d4cc4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:44.396007 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecbf881-26e7-4212-9c26-82f842d4cc4a admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:44.509258 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637f1912-6773-4196-a113-cf3548e5fea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:44.511375 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f1912-6773-4196-a113-cf3548e5fea3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:44.511659 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f1912-6773-4196-a113-cf3548e5fea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:44.511941 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f1912-6773-4196-a113-cf3548e5fea3 admin admin] PATH_INFO: `/v3/projects/390f8a561df3403896fa17685726e78d` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:44.513554 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637f1912-6773-4196-a113-cf3548e5fea3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=390f8a561df3403896fa17685726e78d)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:44.518878 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637f1912-6773-4196-a113-cf3548e5fea3 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:44.575233 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-637f1912-6773-4196-a113-cf3548e5fea3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '390f8a561df3403896fa17685726e78d', 'request_id': 'req-637f1912-6773-4196-a113-cf3548e5fea3'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:44.582273 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-637f1912-6773-4196-a113-cf3548e5fea3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '390f8a561df3403896fa17685726e78d', 'request_id': 'req-637f1912-6773-4196-a113-cf3548e5fea3'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:44.591108 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-637f1912-6773-4196-a113-cf3548e5fea3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '390f8a561df3403896fa17685726e78d', 'request_id': 'req-637f1912-6773-4196-a113-cf3548e5fea3'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:44.605692 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-637f1912-6773-4196-a113-cf3548e5fea3 admin admin] The token cache is being invalidate because project 390f8a561df3403896fa17685726e78d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:18:44.606399 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-637f1912-6773-4196-a113-cf3548e5fea3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:44.607501 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-637f1912-6773-4196-a113-cf3548e5fea3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:44.609210 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 982/1963] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:18:44 2022] DELETE /identity/v3/projects/390f8a561df3403896fa17685726e78d => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:44.614017 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0077bf-d332-41f2-a57b-740ee9051fe2 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:44.614342 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0077bf-d332-41f2-a57b-740ee9051fe2 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:44.614612 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0077bf-d332-41f2-a57b-740ee9051fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:44.635543 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-1c0077bf-d332-41f2-a57b-740ee9051fe2 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:44.636977 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-1c0077bf-d332-41f2-a57b-740ee9051fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:44.737616 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 982/1964] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:44.740097 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90421d06-a755-40f1-b9c3-c5ba479a023a None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:44.741033 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90421d06-a755-40f1-b9c3-c5ba479a023a None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:44.741692 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90421d06-a755-40f1-b9c3-c5ba479a023a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:44.788689 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-90421d06-a755-40f1-b9c3-c5ba479a023a None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:44.791490 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-90421d06-a755-40f1-b9c3-c5ba479a023a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:44.815196 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 983/1965] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:44.815878 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0077bf-d332-41f2-a57b-740ee9051fe2 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:44.840165 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0077bf-d332-41f2-a57b-740ee9051fe2 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:44.846061 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a0b238-35ba-4dec-bb97-be4f17725c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:44.846817 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a0b238-35ba-4dec-bb97-be4f17725c30 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:44.847367 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a0b238-35ba-4dec-bb97-be4f17725c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:44.847745 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a0b238-35ba-4dec-bb97-be4f17725c30 admin admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:44.848729 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a0b238-35ba-4dec-bb97-be4f17725c30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:18:44.849110 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a0b238-35ba-4dec-bb97-be4f17725c30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:44.851745 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a0b238-35ba-4dec-bb97-be4f17725c30 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:44.872761 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90421d06-a755-40f1-b9c3-c5ba479a023a None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:44.878634 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 983/1966] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 17 18:18:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:18:44.884536 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90421d06-a755-40f1-b9c3-c5ba479a023a None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:44.889406 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33ed03-8ed2-4776-923b-eb7f79a187e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:44.890767 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33ed03-8ed2-4776-923b-eb7f79a187e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:44.891146 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33ed03-8ed2-4776-923b-eb7f79a187e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:44.891519 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33ed03-8ed2-4776-923b-eb7f79a187e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:44.892317 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a33ed03-8ed2-4776-923b-eb7f79a187e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:44.894394 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a33ed03-8ed2-4776-923b-eb7f79a187e6 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:44.926668 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 984/1967] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:18:44 2022] POST /identity/v3/projects => generated 389 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:18:44.930281 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a0b238-35ba-4dec-bb97-be4f17725c30 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:44.943959 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a0b238-35ba-4dec-bb97-be4f17725c30 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:45.023111 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7593457-6b52-4e51-884e-a37c589d52a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:45.024518 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7593457-6b52-4e51-884e-a37c589d52a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:45.025736 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7593457-6b52-4e51-884e-a37c589d52a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:45.026114 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7593457-6b52-4e51-884e-a37c589d52a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:45.026951 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7593457-6b52-4e51-884e-a37c589d52a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:45.029290 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7593457-6b52-4e51-884e-a37c589d52a2 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:45.060061 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 984/1968] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:18:44 2022] POST /identity/v3/users => generated 295 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:18:45.061266 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33ed03-8ed2-4776-923b-eb7f79a187e6 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:45.079221 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33ed03-8ed2-4776-923b-eb7f79a187e6 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:45.086159 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3632d3a-5322-4f40-89dd-efa6caea0f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:45.087484 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3632d3a-5322-4f40-89dd-efa6caea0f93 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:45.088192 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3632d3a-5322-4f40-89dd-efa6caea0f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:45.088704 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3632d3a-5322-4f40-89dd-efa6caea0f93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:45.089946 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3632d3a-5322-4f40-89dd-efa6caea0f93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:45.099001 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3632d3a-5322-4f40-89dd-efa6caea0f93 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:45.107825 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 985/1969] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:18:45.111718 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7593457-6b52-4e51-884e-a37c589d52a2 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:45.121890 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7593457-6b52-4e51-884e-a37c589d52a2 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:45.130800 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3345df1b-8ac4-4b87-9adb-224e199f4faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:45.131553 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3345df1b-8ac4-4b87-9adb-224e199f4faa admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:45.131828 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3345df1b-8ac4-4b87-9adb-224e199f4faa admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:45.132149 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3345df1b-8ac4-4b87-9adb-224e199f4faa admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:45.132880 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3345df1b-8ac4-4b87-9adb-224e199f4faa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:45.136193 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3345df1b-8ac4-4b87-9adb-224e199f4faa admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:45.150945 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 985/1970] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:18:45.155432 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3632d3a-5322-4f40-89dd-efa6caea0f93 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:45.169026 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3632d3a-5322-4f40-89dd-efa6caea0f93 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:45.178445 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e76230-a982-4984-a837-7f6e246997d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:45.179448 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e76230-a982-4984-a837-7f6e246997d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:45.179728 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e76230-a982-4984-a837-7f6e246997d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:45.180351 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e76230-a982-4984-a837-7f6e246997d3 admin admin] PATH_INFO: `/v3/projects/5b92062945854706a6693e15a9ad3e6c/users/50cd5c1ab29f4a22bf8c99026163076b/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:45.199661 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e76230-a982-4984-a837-7f6e246997d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b92062945854706a6693e15a9ad3e6c, user_id=50cd5c1ab29f4a22bf8c99026163076b, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:45.203464 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e76230-a982-4984-a837-7f6e246997d3 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:45.247494 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 986/1971] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:18:45 2022] PUT /identity/v3/projects/5b92062945854706a6693e15a9ad3e6c/users/50cd5c1ab29f4a22bf8c99026163076b/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:18:45.251411 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409dcc8-9611-445b-ab81-f016e1b6bdf6 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:45.251693 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409dcc8-9611-445b-ab81-f016e1b6bdf6 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:45.251965 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409dcc8-9611-445b-ab81-f016e1b6bdf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:45.304068 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-6409dcc8-9611-445b-ab81-f016e1b6bdf6 None None] MFA Rules not processed for user `50cd5c1ab29f4a22bf8c99026163076b`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:45.306253 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-6409dcc8-9611-445b-ab81-f016e1b6bdf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:45.405837 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 986/1972] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:45.410191 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e76230-a982-4984-a837-7f6e246997d3 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:45.499151 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e76230-a982-4984-a837-7f6e246997d3 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:45.504086 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caef302-9303-4fdb-b5cd-c6c261fa9a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:45.504750 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caef302-9303-4fdb-b5cd-c6c261fa9a92 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:45.505023 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caef302-9303-4fdb-b5cd-c6c261fa9a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:45.505291 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caef302-9303-4fdb-b5cd-c6c261fa9a92 admin admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:45.506217 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caef302-9303-4fdb-b5cd-c6c261fa9a92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:45.508498 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caef302-9303-4fdb-b5cd-c6c261fa9a92 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:45.560638 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 987/1973] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:18:45 2022] POST /identity/v3/projects => generated 387 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:18:45.564787 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6409dcc8-9611-445b-ab81-f016e1b6bdf6 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:45.581868 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caef302-9303-4fdb-b5cd-c6c261fa9a92 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:45.583578 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6409dcc8-9611-445b-ab81-f016e1b6bdf6 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:45.584215 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-5caef302-9303-4fdb-b5cd-c6c261fa9a92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:45.708284 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe8ae38-f4bb-4e72-995d-adb5a98a541e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:45.709296 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8ae38-f4bb-4e72-995d-adb5a98a541e admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:45.709666 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8ae38-f4bb-4e72-995d-adb5a98a541e admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:45.710053 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8ae38-f4bb-4e72-995d-adb5a98a541e admin admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:45.710809 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe8ae38-f4bb-4e72-995d-adb5a98a541e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:45.712967 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe8ae38-f4bb-4e72-995d-adb5a98a541e admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:45.718940 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caef302-9303-4fdb-b5cd-c6c261fa9a92 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:45.724509 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ac5f8-db5d-46ae-a38e-304e8540b60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:45.725508 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ac5f8-db5d-46ae-a38e-304e8540b60a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:45.725884 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ac5f8-db5d-46ae-a38e-304e8540b60a admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:45.726229 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ac5f8-db5d-46ae-a38e-304e8540b60a admin admin] PATH_INFO: `/v3/users/31ee419c261c4b1ca95eef4b9bd81c11` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:45.727730 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662ac5f8-db5d-46ae-a38e-304e8540b60a admin admin] RBAC: Authorizing `identity:delete_user(user_id=31ee419c261c4b1ca95eef4b9bd81c11)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:45.731538 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662ac5f8-db5d-46ae-a38e-304e8540b60a admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:45.748584 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 987/1974] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:18:45 2022] POST /identity/v3/users => generated 300 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:18:45.754348 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe8ae38-f4bb-4e72-995d-adb5a98a541e admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:45.778486 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe8ae38-f4bb-4e72-995d-adb5a98a541e admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:45.786106 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e228448c-469a-46d2-af1f-e867f65e89fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:45.786993 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228448c-469a-46d2-af1f-e867f65e89fc admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:45.787307 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228448c-469a-46d2-af1f-e867f65e89fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:45.787632 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228448c-469a-46d2-af1f-e867f65e89fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:45.788541 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e228448c-469a-46d2-af1f-e867f65e89fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:45.789066 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-662ac5f8-db5d-46ae-a38e-304e8540b60a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31ee419c261c4b1ca95eef4b9bd81c11'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:45.791362 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e228448c-469a-46d2-af1f-e867f65e89fc admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:45.807073 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-662ac5f8-db5d-46ae-a38e-304e8540b60a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31ee419c261c4b1ca95eef4b9bd81c11'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:45.809343 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-662ac5f8-db5d-46ae-a38e-304e8540b60a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31ee419c261c4b1ca95eef4b9bd81c11'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:45.810251 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-662ac5f8-db5d-46ae-a38e-304e8540b60a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31ee419c261c4b1ca95eef4b9bd81c11'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:45.815590 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 988/1975] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:18:45.817369 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e228448c-469a-46d2-af1f-e867f65e89fc admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:45.817717 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-662ac5f8-db5d-46ae-a38e-304e8540b60a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31ee419c261c4b1ca95eef4b9bd81c11'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:45.820041 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-e228448c-469a-46d2-af1f-e867f65e89fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:45.840517 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e228448c-469a-46d2-af1f-e867f65e89fc admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:45.841729 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 988/1976] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:18:45 2022] DELETE /identity/v3/users/31ee419c261c4b1ca95eef4b9bd81c11 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:18:45.846945 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783323c5-e022-4cf0-bda2-34563dc05d3a None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:45.847293 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783323c5-e022-4cf0-bda2-34563dc05d3a None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:45.847622 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783323c5-e022-4cf0-bda2-34563dc05d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:45.865907 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-783323c5-e022-4cf0-bda2-34563dc05d3a None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:45.867942 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-783323c5-e022-4cf0-bda2-34563dc05d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:45.912245 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d30172-ef5e-465c-bff8-2fd353d4e60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:45.913131 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d30172-ef5e-465c-bff8-2fd353d4e60b admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:45.913410 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d30172-ef5e-465c-bff8-2fd353d4e60b admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:45.913747 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d30172-ef5e-465c-bff8-2fd353d4e60b admin admin] PATH_INFO: `/v3/projects/5b26b22d0ef940a1bb0afc8fa572a0c7/users/43f27ad350c34ddba878957e905720ba/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:45.929796 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d30172-ef5e-465c-bff8-2fd353d4e60b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b26b22d0ef940a1bb0afc8fa572a0c7, user_id=43f27ad350c34ddba878957e905720ba, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:45.932835 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 989/1977] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:45.933293 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d30172-ef5e-465c-bff8-2fd353d4e60b admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:45.939483 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783323c5-e022-4cf0-bda2-34563dc05d3a None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:45.940976 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-783323c5-e022-4cf0-bda2-34563dc05d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:45.949715 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 989/1978] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:18:45 2022] PUT /identity/v3/projects/5b26b22d0ef940a1bb0afc8fa572a0c7/users/43f27ad350c34ddba878957e905720ba/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:45.953487 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d30172-ef5e-465c-bff8-2fd353d4e60b admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:46.026453 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783323c5-e022-4cf0-bda2-34563dc05d3a None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:46.036147 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d30172-ef5e-465c-bff8-2fd353d4e60b admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:46.042473 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128987c7-3de3-4843-b829-bef26b24b068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:46.043166 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128987c7-3de3-4843-b829-bef26b24b068 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:46.043448 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128987c7-3de3-4843-b829-bef26b24b068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:46.043770 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128987c7-3de3-4843-b829-bef26b24b068 admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:46.044618 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128987c7-3de3-4843-b829-bef26b24b068 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:46.046545 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128987c7-3de3-4843-b829-bef26b24b068 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:46.058393 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 990/1979] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:18:46.062480 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128987c7-3de3-4843-b829-bef26b24b068 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:46.077569 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128987c7-3de3-4843-b829-bef26b24b068 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:46.086247 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ede7e3-c395-4a92-8e24-4bc4153b417f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:46.087811 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ede7e3-c395-4a92-8e24-4bc4153b417f admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:46.088213 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ede7e3-c395-4a92-8e24-4bc4153b417f admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:46.088989 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ede7e3-c395-4a92-8e24-4bc4153b417f admin admin] PATH_INFO: `/v3/projects/5b26b22d0ef940a1bb0afc8fa572a0c7/users/43f27ad350c34ddba878957e905720ba/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:46.091623 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ede7e3-c395-4a92-8e24-4bc4153b417f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b26b22d0ef940a1bb0afc8fa572a0c7, user_id=43f27ad350c34ddba878957e905720ba, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:46.094739 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ede7e3-c395-4a92-8e24-4bc4153b417f admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:46.096458 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0fe84e-f597-4bbe-863d-22bef91f69eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:46.097035 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0fe84e-f597-4bbe-863d-22bef91f69eb service neutron] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:46.097302 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0fe84e-f597-4bbe-863d-22bef91f69eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:46.097788 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0fe84e-f597-4bbe-863d-22bef91f69eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:46.119244 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 991/1980] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:18:46 2022] PUT /identity/v3/projects/5b26b22d0ef940a1bb0afc8fa572a0c7/users/43f27ad350c34ddba878957e905720ba/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:18:46.119813 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0fe84e-f597-4bbe-863d-22bef91f69eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:46.119813 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0fe84e-f597-4bbe-863d-22bef91f69eb service neutron] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:46.120995 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0ff86-ed9a-4271-8d6f-932dbab69862 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:46.121602 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0ff86-ed9a-4271-8d6f-932dbab69862 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:46.123134 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0ff86-ed9a-4271-8d6f-932dbab69862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:46.134878 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 990/1981] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:18:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:18:46.187009 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-fce0ff86-ed9a-4271-8d6f-932dbab69862 None None] MFA Rules not processed for user `43f27ad350c34ddba878957e905720ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:46.190018 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-fce0ff86-ed9a-4271-8d6f-932dbab69862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:46.361285 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 992/1982] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:46 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:46.375280 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0fe84e-f597-4bbe-863d-22bef91f69eb service neutron] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:46.376966 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-1f0fe84e-f597-4bbe-863d-22bef91f69eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:46.446954 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0fe84e-f597-4bbe-863d-22bef91f69eb service neutron] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:46.503369 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9133c0-f6b0-4557-82f0-448f6749acc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:46.504033 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9133c0-f6b0-4557-82f0-448f6749acc1 service cinder] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:46.504308 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9133c0-f6b0-4557-82f0-448f6749acc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:46.504579 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9133c0-f6b0-4557-82f0-448f6749acc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:46.515141 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9133c0-f6b0-4557-82f0-448f6749acc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:46.516590 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9133c0-f6b0-4557-82f0-448f6749acc1 service cinder] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:46.527364 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 991/1983] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:18:46 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:18:46.703572 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce0ff86-ed9a-4271-8d6f-932dbab69862 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:46.706473 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-fce0ff86-ed9a-4271-8d6f-932dbab69862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:46.727781 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9133c0-f6b0-4557-82f0-448f6749acc1 service cinder] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:46.814722 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce0ff86-ed9a-4271-8d6f-932dbab69862 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:46.820894 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c2555b-86a7-4d6b-b066-58a852388e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:46.821959 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2555b-86a7-4d6b-b066-58a852388e30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:46.822272 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2555b-86a7-4d6b-b066-58a852388e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:46.822736 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2555b-86a7-4d6b-b066-58a852388e30 admin admin] PATH_INFO: `/v3/projects/90b18b711b814afcbfbea43cd57effa9` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:46.824256 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c2555b-86a7-4d6b-b066-58a852388e30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90b18b711b814afcbfbea43cd57effa9)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:46.825930 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9133c0-f6b0-4557-82f0-448f6749acc1 service cinder] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:46.826550 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c2555b-86a7-4d6b-b066-58a852388e30 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:46.837804 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8910df3a-5648-44db-974e-14c4dd39fd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:46.838939 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910df3a-5648-44db-974e-14c4dd39fd6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:46.839460 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910df3a-5648-44db-974e-14c4dd39fd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:46.840007 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910df3a-5648-44db-974e-14c4dd39fd6d admin admin] PATH_INFO: `/v3/users/50cd5c1ab29f4a22bf8c99026163076b` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:46.842140 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8910df3a-5648-44db-974e-14c4dd39fd6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=50cd5c1ab29f4a22bf8c99026163076b)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:46.845542 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8910df3a-5648-44db-974e-14c4dd39fd6d admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:46.921696 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-48c2555b-86a7-4d6b-b066-58a852388e30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90b18b711b814afcbfbea43cd57effa9', 'request_id': 'req-48c2555b-86a7-4d6b-b066-58a852388e30'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:46.930494 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-48c2555b-86a7-4d6b-b066-58a852388e30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90b18b711b814afcbfbea43cd57effa9', 'request_id': 'req-48c2555b-86a7-4d6b-b066-58a852388e30'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:46.943523 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-48c2555b-86a7-4d6b-b066-58a852388e30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90b18b711b814afcbfbea43cd57effa9', 'request_id': 'req-48c2555b-86a7-4d6b-b066-58a852388e30'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:46.956973 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-8910df3a-5648-44db-974e-14c4dd39fd6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50cd5c1ab29f4a22bf8c99026163076b'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:46.964581 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-48c2555b-86a7-4d6b-b066-58a852388e30 admin admin] The token cache is being invalidate because project 90b18b711b814afcbfbea43cd57effa9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:18:46.965140 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-48c2555b-86a7-4d6b-b066-58a852388e30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:46.966478 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-48c2555b-86a7-4d6b-b066-58a852388e30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:46.974146 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-8910df3a-5648-44db-974e-14c4dd39fd6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50cd5c1ab29f4a22bf8c99026163076b'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:46.975184 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-8910df3a-5648-44db-974e-14c4dd39fd6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50cd5c1ab29f4a22bf8c99026163076b'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:46.975958 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-8910df3a-5648-44db-974e-14c4dd39fd6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50cd5c1ab29f4a22bf8c99026163076b'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:46.984324 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-8910df3a-5648-44db-974e-14c4dd39fd6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50cd5c1ab29f4a22bf8c99026163076b'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:46.984855 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 993/1984] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:18:46 2022] DELETE /identity/v3/projects/90b18b711b814afcbfbea43cd57effa9 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:46.993074 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8214b52d-0464-446f-9c5b-fbfe51bd58cc None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:46.993487 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8214b52d-0464-446f-9c5b-fbfe51bd58cc None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:46.998840 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8214b52d-0464-446f-9c5b-fbfe51bd58cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:47.014937 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 992/1985] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:18:46 2022] DELETE /identity/v3/users/50cd5c1ab29f4a22bf8c99026163076b => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:47.019068 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2ffd2-44e6-4e46-9742-cd2fdb20cd3f None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:47.019513 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2ffd2-44e6-4e46-9742-cd2fdb20cd3f None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:47.019943 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2ffd2-44e6-4e46-9742-cd2fdb20cd3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:47.032360 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-8214b52d-0464-446f-9c5b-fbfe51bd58cc None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:47.033701 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-8214b52d-0464-446f-9c5b-fbfe51bd58cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:47.042819 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-8ac2ffd2-44e6-4e46-9742-cd2fdb20cd3f None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:47.044092 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-8ac2ffd2-44e6-4e46-9742-cd2fdb20cd3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:47.106229 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 994/1986] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:18:47.113864 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb5eef0-bef8-431f-a369-5a509976884e None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:47.114184 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb5eef0-bef8-431f-a369-5a509976884e None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:47.114429 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb5eef0-bef8-431f-a369-5a509976884e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:47.128146 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 993/1987] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:18:47.135316 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac2ffd2-44e6-4e46-9742-cd2fdb20cd3f None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:47.136879 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-8ac2ffd2-44e6-4e46-9742-cd2fdb20cd3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:47.137184 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-bfb5eef0-bef8-431f-a369-5a509976884e None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:47.139473 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-bfb5eef0-bef8-431f-a369-5a509976884e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:47.149409 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 995/1988] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:18:47.153424 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb5eef0-bef8-431f-a369-5a509976884e None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:47.163274 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb5eef0-bef8-431f-a369-5a509976884e None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:47.168439 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e5c4ea-473b-4ca0-a2d7-dc34fb785a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:47.169182 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5c4ea-473b-4ca0-a2d7-dc34fb785a29 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:47.169672 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5c4ea-473b-4ca0-a2d7-dc34fb785a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:47.170022 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5c4ea-473b-4ca0-a2d7-dc34fb785a29 admin admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:47.170830 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e5c4ea-473b-4ca0-a2d7-dc34fb785a29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:18:47.171146 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e5c4ea-473b-4ca0-a2d7-dc34fb785a29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:47.172760 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e5c4ea-473b-4ca0-a2d7-dc34fb785a29 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:47.191372 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 996/1989] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 17 18:18:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:18:47.192900 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e5c4ea-473b-4ca0-a2d7-dc34fb785a29 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:47.204053 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e5c4ea-473b-4ca0-a2d7-dc34fb785a29 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:47.211065 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d934ff-a7c4-4216-aa3a-abed995e59f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:47.212205 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d934ff-a7c4-4216-aa3a-abed995e59f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:47.212741 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d934ff-a7c4-4216-aa3a-abed995e59f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:47.213020 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d934ff-a7c4-4216-aa3a-abed995e59f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:47.214157 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d934ff-a7c4-4216-aa3a-abed995e59f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:47.216249 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d934ff-a7c4-4216-aa3a-abed995e59f8 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:47.226383 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac2ffd2-44e6-4e46-9742-cd2fdb20cd3f None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:47.231020 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9070bd5d-6351-4a46-84fe-564626aca218 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:47.231886 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070bd5d-6351-4a46-84fe-564626aca218 service neutron] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:47.232323 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070bd5d-6351-4a46-84fe-564626aca218 service neutron] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:47.232640 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9070bd5d-6351-4a46-84fe-564626aca218 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:47.243649 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9070bd5d-6351-4a46-84fe-564626aca218 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:47.245194 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9070bd5d-6351-4a46-84fe-564626aca218 service neutron] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:47.255154 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 997/1990] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:18:47 2022] POST /identity/v3/projects => generated 373 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:18:47.259802 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 994/1991] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:18:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:18:47.260193 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d934ff-a7c4-4216-aa3a-abed995e59f8 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:47.332859 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d934ff-a7c4-4216-aa3a-abed995e59f8 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:47.338510 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe893e55-47fb-4ade-9e58-76636e8dca3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:47.339160 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe893e55-47fb-4ade-9e58-76636e8dca3a admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:47.339452 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe893e55-47fb-4ade-9e58-76636e8dca3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:47.339710 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe893e55-47fb-4ade-9e58-76636e8dca3a admin admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:47.340405 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe893e55-47fb-4ade-9e58-76636e8dca3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:47.342371 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe893e55-47fb-4ade-9e58-76636e8dca3a admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:47.363333 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 998/1992] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:18:47 2022] POST /identity/v3/users => generated 287 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:18:47.368144 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9070bd5d-6351-4a46-84fe-564626aca218 service neutron] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:47.378408 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9070bd5d-6351-4a46-84fe-564626aca218 service neutron] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:47.384260 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57fae2f-bf4b-4850-a6ae-7e547e90884f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:47.384931 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57fae2f-bf4b-4850-a6ae-7e547e90884f admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:47.385207 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57fae2f-bf4b-4850-a6ae-7e547e90884f admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:47.385547 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57fae2f-bf4b-4850-a6ae-7e547e90884f admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:47.386297 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57fae2f-bf4b-4850-a6ae-7e547e90884f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:47.387920 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57fae2f-bf4b-4850-a6ae-7e547e90884f admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:47.398023 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 995/1993] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:18:47.402043 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe893e55-47fb-4ade-9e58-76636e8dca3a admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:47.412027 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe893e55-47fb-4ade-9e58-76636e8dca3a admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:47.418746 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5303d54-c479-4b64-8ca7-98ec76d3e854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:47.419765 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5303d54-c479-4b64-8ca7-98ec76d3e854 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:47.420051 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5303d54-c479-4b64-8ca7-98ec76d3e854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:47.420320 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5303d54-c479-4b64-8ca7-98ec76d3e854 admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:47.421045 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5303d54-c479-4b64-8ca7-98ec76d3e854 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:47.422746 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5303d54-c479-4b64-8ca7-98ec76d3e854 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:47.434131 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 999/1994] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:18:47.438226 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57fae2f-bf4b-4850-a6ae-7e547e90884f admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:47.448747 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57fae2f-bf4b-4850-a6ae-7e547e90884f admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:47.453359 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3874633-45c3-442a-be85-f32135316e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:47.454343 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3874633-45c3-442a-be85-f32135316e33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:47.454685 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3874633-45c3-442a-be85-f32135316e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:47.455019 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3874633-45c3-442a-be85-f32135316e33 admin admin] PATH_INFO: `/v3/projects/4f60fdd09f5b450bb6cb18902bf860e0/users/c725fea1d5574c8382d3d8fb9fd61526/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:47.470685 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3874633-45c3-442a-be85-f32135316e33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f60fdd09f5b450bb6cb18902bf860e0, user_id=c725fea1d5574c8382d3d8fb9fd61526, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:47.473141 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3874633-45c3-442a-be85-f32135316e33 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:47.490075 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 996/1995] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:18:47 2022] PUT /identity/v3/projects/4f60fdd09f5b450bb6cb18902bf860e0/users/c725fea1d5574c8382d3d8fb9fd61526/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:47.502042 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e286ce79-3100-44fb-8ea3-f405aa8507ca None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:47.502533 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e286ce79-3100-44fb-8ea3-f405aa8507ca None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:47.502883 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e286ce79-3100-44fb-8ea3-f405aa8507ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:47.536822 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-e286ce79-3100-44fb-8ea3-f405aa8507ca None None] MFA Rules not processed for user `c725fea1d5574c8382d3d8fb9fd61526`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:47.538519 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-e286ce79-3100-44fb-8ea3-f405aa8507ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:47.554759 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3874633-45c3-442a-be85-f32135316e33 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:47.556537 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-f3874633-45c3-442a-be85-f32135316e33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:47.621592 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1000/1996] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:18:47.625562 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3874633-45c3-442a-be85-f32135316e33 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:47.630500 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b550f87-22b4-47ae-bdc6-1f3bc440f4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:47.631557 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b550f87-22b4-47ae-bdc6-1f3bc440f4f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:47.631685 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b550f87-22b4-47ae-bdc6-1f3bc440f4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:47.631885 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b550f87-22b4-47ae-bdc6-1f3bc440f4f2 admin admin] PATH_INFO: `/v3/projects/5b92062945854706a6693e15a9ad3e6c` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:47.632648 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e286ce79-3100-44fb-8ea3-f405aa8507ca None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:47.633132 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b550f87-22b4-47ae-bdc6-1f3bc440f4f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b92062945854706a6693e15a9ad3e6c)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:47.634488 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-e286ce79-3100-44fb-8ea3-f405aa8507ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:47.635063 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b550f87-22b4-47ae-bdc6-1f3bc440f4f2 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:47.682578 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-6b550f87-22b4-47ae-bdc6-1f3bc440f4f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b92062945854706a6693e15a9ad3e6c', 'request_id': 'req-6b550f87-22b4-47ae-bdc6-1f3bc440f4f2'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:47.688632 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-6b550f87-22b4-47ae-bdc6-1f3bc440f4f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b92062945854706a6693e15a9ad3e6c', 'request_id': 'req-6b550f87-22b4-47ae-bdc6-1f3bc440f4f2'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:47.691442 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e286ce79-3100-44fb-8ea3-f405aa8507ca None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:47.697343 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-6b550f87-22b4-47ae-bdc6-1f3bc440f4f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b92062945854706a6693e15a9ad3e6c', 'request_id': 'req-6b550f87-22b4-47ae-bdc6-1f3bc440f4f2'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:47.711561 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-6b550f87-22b4-47ae-bdc6-1f3bc440f4f2 admin admin] The token cache is being invalidate because project 5b92062945854706a6693e15a9ad3e6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:18:47.711868 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-6b550f87-22b4-47ae-bdc6-1f3bc440f4f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:47.712525 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-6b550f87-22b4-47ae-bdc6-1f3bc440f4f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:47.714550 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 997/1997] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:18:47 2022] DELETE /identity/v3/projects/5b92062945854706a6693e15a9ad3e6c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:18:47.719009 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b550f87-22b4-47ae-bdc6-1f3bc440f4f2 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:47.720596 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-6b550f87-22b4-47ae-bdc6-1f3bc440f4f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:47.757271 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e5ddc9-c10e-4083-8d7d-2044247e9846 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:47.758699 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5ddc9-c10e-4083-8d7d-2044247e9846 service cinder] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:47.759007 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5ddc9-c10e-4083-8d7d-2044247e9846 service cinder] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:47.759280 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5ddc9-c10e-4083-8d7d-2044247e9846 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:47.761343 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-97e5ddc9-c10e-4083-8d7d-2044247e9846 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:47.801784 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b550f87-22b4-47ae-bdc6-1f3bc440f4f2 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:47.807572 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d70a6e-58a8-40a6-bb6d-472361193469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:47.808719 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d70a6e-58a8-40a6-bb6d-472361193469 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:47.809216 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d70a6e-58a8-40a6-bb6d-472361193469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:47.809873 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d70a6e-58a8-40a6-bb6d-472361193469 admin admin] PATH_INFO: `/v3/users/43f27ad350c34ddba878957e905720ba` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:47.811234 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d70a6e-58a8-40a6-bb6d-472361193469 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43f27ad350c34ddba878957e905720ba)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:47.813520 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d70a6e-58a8-40a6-bb6d-472361193469 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:47.821279 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e5ddc9-c10e-4083-8d7d-2044247e9846 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:47.822765 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e5ddc9-c10e-4083-8d7d-2044247e9846 service cinder] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:47.839810 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1001/1998] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:18:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:18:47.879316 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-f7d70a6e-58a8-40a6-bb6d-472361193469 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43f27ad350c34ddba878957e905720ba'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:47.894158 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-f7d70a6e-58a8-40a6-bb6d-472361193469 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43f27ad350c34ddba878957e905720ba'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:47.894982 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-f7d70a6e-58a8-40a6-bb6d-472361193469 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43f27ad350c34ddba878957e905720ba'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:47.895777 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-f7d70a6e-58a8-40a6-bb6d-472361193469 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43f27ad350c34ddba878957e905720ba'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:47.904678 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-f7d70a6e-58a8-40a6-bb6d-472361193469 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43f27ad350c34ddba878957e905720ba'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:47.929651 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 998/1999] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:18:47 2022] DELETE /identity/v3/users/43f27ad350c34ddba878957e905720ba => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:48.316069 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e5ddc9-c10e-4083-8d7d-2044247e9846 service cinder] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:48.328883 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e5ddc9-c10e-4083-8d7d-2044247e9846 service cinder] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:48.391891 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99ed7ee-72a4-4b99-a07d-881ee1bfed04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:48.392790 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ed7ee-72a4-4b99-a07d-881ee1bfed04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:48.393064 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ed7ee-72a4-4b99-a07d-881ee1bfed04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:48.393332 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99ed7ee-72a4-4b99-a07d-881ee1bfed04 admin admin] PATH_INFO: `/v3/projects/5b26b22d0ef940a1bb0afc8fa572a0c7` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:48.394555 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99ed7ee-72a4-4b99-a07d-881ee1bfed04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b26b22d0ef940a1bb0afc8fa572a0c7)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:48.396455 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99ed7ee-72a4-4b99-a07d-881ee1bfed04 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:48.444279 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-d99ed7ee-72a4-4b99-a07d-881ee1bfed04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b26b22d0ef940a1bb0afc8fa572a0c7', 'request_id': 'req-d99ed7ee-72a4-4b99-a07d-881ee1bfed04'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:48.451205 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-d99ed7ee-72a4-4b99-a07d-881ee1bfed04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b26b22d0ef940a1bb0afc8fa572a0c7', 'request_id': 'req-d99ed7ee-72a4-4b99-a07d-881ee1bfed04'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:48.458482 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-d99ed7ee-72a4-4b99-a07d-881ee1bfed04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b26b22d0ef940a1bb0afc8fa572a0c7', 'request_id': 'req-d99ed7ee-72a4-4b99-a07d-881ee1bfed04'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:48.469511 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-d99ed7ee-72a4-4b99-a07d-881ee1bfed04 admin admin] The token cache is being invalidate because project 5b26b22d0ef940a1bb0afc8fa572a0c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:18:48.469789 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-d99ed7ee-72a4-4b99-a07d-881ee1bfed04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:48.470434 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-d99ed7ee-72a4-4b99-a07d-881ee1bfed04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:48.472027 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1002/2000] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:18:48 2022] DELETE /identity/v3/projects/5b26b22d0ef940a1bb0afc8fa572a0c7 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:18:48.477808 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062f8bc-838f-4736-a4ad-5450f0a896df None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:48.478325 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062f8bc-838f-4736-a4ad-5450f0a896df None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:48.478410 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062f8bc-838f-4736-a4ad-5450f0a896df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:48.497069 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-d062f8bc-838f-4736-a4ad-5450f0a896df None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:48.498316 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-d062f8bc-838f-4736-a4ad-5450f0a896df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:48.564720 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 999/2001] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:48.574585 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f413c-a36e-4966-9ab1-f7f65a01cdf2 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:48.574873 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f413c-a36e-4966-9ab1-f7f65a01cdf2 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:48.575151 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f413c-a36e-4966-9ab1-f7f65a01cdf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:48.594983 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-5d3f413c-a36e-4966-9ab1-f7f65a01cdf2 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:48.596366 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-5d3f413c-a36e-4966-9ab1-f7f65a01cdf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:48.605961 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1003/2002] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:48.610265 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062f8bc-838f-4736-a4ad-5450f0a896df None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:48.620886 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062f8bc-838f-4736-a4ad-5450f0a896df None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:48.625428 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286b7e77-044d-4d36-be05-32a84a6067d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:48.626101 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b7e77-044d-4d36-be05-32a84a6067d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:48.626386 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b7e77-044d-4d36-be05-32a84a6067d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:48.626662 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b7e77-044d-4d36-be05-32a84a6067d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:48.627384 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286b7e77-044d-4d36-be05-32a84a6067d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:18:48.627686 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286b7e77-044d-4d36-be05-32a84a6067d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:48.629426 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286b7e77-044d-4d36-be05-32a84a6067d3 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:48.644759 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1000/2003] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 17 18:18:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:18:48.645841 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f413c-a36e-4966-9ab1-f7f65a01cdf2 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:48.654893 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f413c-a36e-4966-9ab1-f7f65a01cdf2 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:48.659646 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200bba33-3572-46ca-a1f2-01e699cbe872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:48.660299 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200bba33-3572-46ca-a1f2-01e699cbe872 admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:48.660576 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200bba33-3572-46ca-a1f2-01e699cbe872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:48.660843 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200bba33-3572-46ca-a1f2-01e699cbe872 admin admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:48.661575 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200bba33-3572-46ca-a1f2-01e699cbe872 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:48.663462 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200bba33-3572-46ca-a1f2-01e699cbe872 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:48.688846 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1004/2004] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:18:48 2022] POST /identity/v3/projects => generated 377 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:18:48.693183 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286b7e77-044d-4d36-be05-32a84a6067d3 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:48.704179 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286b7e77-044d-4d36-be05-32a84a6067d3 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:48.761624 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b12e31-7fef-4d2c-a69b-7c1371bba390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:48.762296 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b12e31-7fef-4d2c-a69b-7c1371bba390 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:48.762576 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b12e31-7fef-4d2c-a69b-7c1371bba390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:48.762847 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b12e31-7fef-4d2c-a69b-7c1371bba390 admin admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:48.763531 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b12e31-7fef-4d2c-a69b-7c1371bba390 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:48.765441 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b12e31-7fef-4d2c-a69b-7c1371bba390 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:48.788129 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1001/2005] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:18:48 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:18:48.789410 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200bba33-3572-46ca-a1f2-01e699cbe872 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:48.799610 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200bba33-3572-46ca-a1f2-01e699cbe872 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:48.804418 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c3195-6c3b-4ed3-85ea-6012e4c0780d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:48.805756 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c3195-6c3b-4ed3-85ea-6012e4c0780d admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:48.806037 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c3195-6c3b-4ed3-85ea-6012e4c0780d admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:48.806363 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559c3195-6c3b-4ed3-85ea-6012e4c0780d admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:48.807119 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c3195-6c3b-4ed3-85ea-6012e4c0780d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:48.808719 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559c3195-6c3b-4ed3-85ea-6012e4c0780d admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:48.819178 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1005/2006] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:18:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:18:48.824086 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b12e31-7fef-4d2c-a69b-7c1371bba390 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:48.834392 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b12e31-7fef-4d2c-a69b-7c1371bba390 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:48.839338 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380373e3-639e-4ca7-aae0-84398dfd8c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:48.840000 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380373e3-639e-4ca7-aae0-84398dfd8c23 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:48.840279 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380373e3-639e-4ca7-aae0-84398dfd8c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:48.840554 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380373e3-639e-4ca7-aae0-84398dfd8c23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:48.841279 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380373e3-639e-4ca7-aae0-84398dfd8c23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:48.842922 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380373e3-639e-4ca7-aae0-84398dfd8c23 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:48.853805 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1002/2007] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:18:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:18:48.857720 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c3195-6c3b-4ed3-85ea-6012e4c0780d admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:48.868873 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559c3195-6c3b-4ed3-85ea-6012e4c0780d admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:48.874579 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d39a80-ceb3-4a72-84bb-8783f42db7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:48.875463 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d39a80-ceb3-4a72-84bb-8783f42db7aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:48.875742 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d39a80-ceb3-4a72-84bb-8783f42db7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:48.876015 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d39a80-ceb3-4a72-84bb-8783f42db7aa admin admin] PATH_INFO: `/v3/projects/c1a1a9d3a34e46e8b407c9f402feb3ce/users/b7b61d7833684321b8e021b687ff8457/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:48.891332 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d39a80-ceb3-4a72-84bb-8783f42db7aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1a1a9d3a34e46e8b407c9f402feb3ce, user_id=b7b61d7833684321b8e021b687ff8457, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:48.894187 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d39a80-ceb3-4a72-84bb-8783f42db7aa admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:48.913540 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1006/2008] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:18:48 2022] PUT /identity/v3/projects/c1a1a9d3a34e46e8b407c9f402feb3ce/users/b7b61d7833684321b8e021b687ff8457/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:48.925061 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061c53b-b9b0-4a49-8119-367b935f3e58 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:48.925350 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061c53b-b9b0-4a49-8119-367b935f3e58 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:48.925671 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f061c53b-b9b0-4a49-8119-367b935f3e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:48.961351 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-f061c53b-b9b0-4a49-8119-367b935f3e58 None None] MFA Rules not processed for user `b7b61d7833684321b8e021b687ff8457`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:48.963630 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-f061c53b-b9b0-4a49-8119-367b935f3e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:49.038969 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1003/2009] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:49.050422 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d39a80-ceb3-4a72-84bb-8783f42db7aa admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:49.052250 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-78d39a80-ceb3-4a72-84bb-8783f42db7aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:49.110526 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d39a80-ceb3-4a72-84bb-8783f42db7aa admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:49.114252 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f3b35-1790-4ff7-9cac-26d3f3ee9166 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce570634a66b45158d940151828f533a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:49.114895 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f3b35-1790-4ff7-9cac-26d3f3ee9166 service glance] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:49.115170 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f3b35-1790-4ff7-9cac-26d3f3ee9166 service glance] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:49.115439 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f3b35-1790-4ff7-9cac-26d3f3ee9166 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:49.124952 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68f3b35-1790-4ff7-9cac-26d3f3ee9166 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:49.126405 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68f3b35-1790-4ff7-9cac-26d3f3ee9166 service glance] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:49.135414 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1007/2010] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:18:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:18:49.246113 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061c53b-b9b0-4a49-8119-367b935f3e58 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:49.248854 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-f061c53b-b9b0-4a49-8119-367b935f3e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:49.330362 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6e1ef-5417-451f-aaaf-8c475dd011cf None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:49.331027 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6e1ef-5417-451f-aaaf-8c475dd011cf None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:49.331027 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6e1ef-5417-451f-aaaf-8c475dd011cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:49.354277 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-91b6e1ef-5417-451f-aaaf-8c475dd011cf None None] MFA Rules not processed for user `c725fea1d5574c8382d3d8fb9fd61526`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:49.355679 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-91b6e1ef-5417-451f-aaaf-8c475dd011cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:49.356182 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f061c53b-b9b0-4a49-8119-367b935f3e58 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:49.364478 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a6290-aa7c-4aef-b71b-9ac5f1c0c963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:49.365673 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a6290-aa7c-4aef-b71b-9ac5f1c0c963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:49.366001 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a6290-aa7c-4aef-b71b-9ac5f1c0c963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:49.366634 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a6290-aa7c-4aef-b71b-9ac5f1c0c963 admin admin] PATH_INFO: `/v3/users/211c52261d684423926d921296417218` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:49.368277 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03a6290-aa7c-4aef-b71b-9ac5f1c0c963 admin admin] RBAC: Authorizing `identity:delete_user(user_id=211c52261d684423926d921296417218)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:49.370355 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03a6290-aa7c-4aef-b71b-9ac5f1c0c963 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:49.432607 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-a03a6290-aa7c-4aef-b71b-9ac5f1c0c963 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '211c52261d684423926d921296417218'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:49.441141 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1008/2011] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:18:49.447632 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-a03a6290-aa7c-4aef-b71b-9ac5f1c0c963 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '211c52261d684423926d921296417218'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:49.449103 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-a03a6290-aa7c-4aef-b71b-9ac5f1c0c963 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '211c52261d684423926d921296417218'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:49.449999 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-a03a6290-aa7c-4aef-b71b-9ac5f1c0c963 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '211c52261d684423926d921296417218'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:49.477672 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-a03a6290-aa7c-4aef-b71b-9ac5f1c0c963 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '211c52261d684423926d921296417218'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:49.497013 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1004/2012] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:18:49 2022] DELETE /identity/v3/users/211c52261d684423926d921296417218 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:49.508653 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79107ecb-d58b-43d5-b25e-155b40588aad None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:49.509379 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79107ecb-d58b-43d5-b25e-155b40588aad None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:49.509714 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79107ecb-d58b-43d5-b25e-155b40588aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:49.542647 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-79107ecb-d58b-43d5-b25e-155b40588aad None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:49.543743 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-79107ecb-d58b-43d5-b25e-155b40588aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:49.635724 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1009/2013] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:49.646849 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a6290-aa7c-4aef-b71b-9ac5f1c0c963 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:49.648451 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-a03a6290-aa7c-4aef-b71b-9ac5f1c0c963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:49.772677 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a6290-aa7c-4aef-b71b-9ac5f1c0c963 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:49.777541 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36f9a7a-71fa-4159-aaf2-0252a4df8848 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:49.778646 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f9a7a-71fa-4159-aaf2-0252a4df8848 service neutron] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:49.778925 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f9a7a-71fa-4159-aaf2-0252a4df8848 service neutron] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:49.779607 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36f9a7a-71fa-4159-aaf2-0252a4df8848 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:49.790095 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36f9a7a-71fa-4159-aaf2-0252a4df8848 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:49.791891 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36f9a7a-71fa-4159-aaf2-0252a4df8848 service neutron] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:49.813771 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1005/2014] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:18:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:18:50.363803 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79107ecb-d58b-43d5-b25e-155b40588aad None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:50.365273 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-79107ecb-d58b-43d5-b25e-155b40588aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:50.388967 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79107ecb-d58b-43d5-b25e-155b40588aad None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:50.414744 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8b6f7-8960-452b-ab22-66aa986076ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:50.415820 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8b6f7-8960-452b-ab22-66aa986076ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:50.416108 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8b6f7-8960-452b-ab22-66aa986076ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:50.416391 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8b6f7-8960-452b-ab22-66aa986076ad admin admin] PATH_INFO: `/v3/projects/bd358a8987db47aa8e2800b80c17fe49` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:50.417774 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c8b6f7-8960-452b-ab22-66aa986076ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd358a8987db47aa8e2800b80c17fe49)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:50.419720 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c8b6f7-8960-452b-ab22-66aa986076ad admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:50.497371 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-a3c8b6f7-8960-452b-ab22-66aa986076ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd358a8987db47aa8e2800b80c17fe49', 'request_id': 'req-a3c8b6f7-8960-452b-ab22-66aa986076ad'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:50.525004 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-a3c8b6f7-8960-452b-ab22-66aa986076ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd358a8987db47aa8e2800b80c17fe49', 'request_id': 'req-a3c8b6f7-8960-452b-ab22-66aa986076ad'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:50.540069 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-a3c8b6f7-8960-452b-ab22-66aa986076ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd358a8987db47aa8e2800b80c17fe49', 'request_id': 'req-a3c8b6f7-8960-452b-ab22-66aa986076ad'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:50.569703 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-a3c8b6f7-8960-452b-ab22-66aa986076ad admin admin] The token cache is being invalidate because project bd358a8987db47aa8e2800b80c17fe49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:18:50.569703 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-a3c8b6f7-8960-452b-ab22-66aa986076ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:50.570219 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-a3c8b6f7-8960-452b-ab22-66aa986076ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:50.572862 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1010/2015] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:18:50 2022] DELETE /identity/v3/projects/bd358a8987db47aa8e2800b80c17fe49 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:50.578964 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50cdc2-191d-4894-a06a-1774633c5d98 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:50.579555 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50cdc2-191d-4894-a06a-1774633c5d98 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:50.579555 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d50cdc2-191d-4894-a06a-1774633c5d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:50.602020 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-8d50cdc2-191d-4894-a06a-1774633c5d98 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:50.603276 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-8d50cdc2-191d-4894-a06a-1774633c5d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:50.756781 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1006/2016] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:50.767061 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9163f-31cf-4100-8ab2-d282c80f1069 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:50.767809 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9163f-31cf-4100-8ab2-d282c80f1069 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:50.768372 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9163f-31cf-4100-8ab2-d282c80f1069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:50.808659 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-41c9163f-31cf-4100-8ab2-d282c80f1069 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:50.810824 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-41c9163f-31cf-4100-8ab2-d282c80f1069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:50.848290 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1011/2017] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:50.857500 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d50cdc2-191d-4894-a06a-1774633c5d98 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:50.878278 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d50cdc2-191d-4894-a06a-1774633c5d98 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:50.894539 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f764e9c-4c56-44d3-a6a3-17cdc510fb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:50.897836 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f764e9c-4c56-44d3-a6a3-17cdc510fb32 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:50.898144 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f764e9c-4c56-44d3-a6a3-17cdc510fb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:50.898458 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f764e9c-4c56-44d3-a6a3-17cdc510fb32 admin admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:50.900464 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f764e9c-4c56-44d3-a6a3-17cdc510fb32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:18:50.900776 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f764e9c-4c56-44d3-a6a3-17cdc510fb32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:50.907097 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f764e9c-4c56-44d3-a6a3-17cdc510fb32 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:50.931550 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1007/2018] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 17 18:18:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:18:50.933548 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c9163f-31cf-4100-8ab2-d282c80f1069 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:50.950284 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c9163f-31cf-4100-8ab2-d282c80f1069 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:50.967721 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a51b88-3b02-4e68-a74a-10ade3785604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:50.969016 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a51b88-3b02-4e68-a74a-10ade3785604 admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:50.969551 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a51b88-3b02-4e68-a74a-10ade3785604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:50.970051 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a51b88-3b02-4e68-a74a-10ade3785604 admin admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:50.971385 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a51b88-3b02-4e68-a74a-10ade3785604 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:50.977213 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a51b88-3b02-4e68-a74a-10ade3785604 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:51.031925 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1012/2019] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:18:50 2022] POST /identity/v3/projects => generated 381 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:18:51.035948 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f764e9c-4c56-44d3-a6a3-17cdc510fb32 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:51.079504 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f764e9c-4c56-44d3-a6a3-17cdc510fb32 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:51.152923 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b0f2f0-4ee9-4cb2-82bc-828ad08bd185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:51.154166 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0f2f0-4ee9-4cb2-82bc-828ad08bd185 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:51.154696 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0f2f0-4ee9-4cb2-82bc-828ad08bd185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:51.155206 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0f2f0-4ee9-4cb2-82bc-828ad08bd185 admin admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:51.156181 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b0f2f0-4ee9-4cb2-82bc-828ad08bd185 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:51.158663 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b0f2f0-4ee9-4cb2-82bc-828ad08bd185 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:51.184401 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1008/2020] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:18:51 2022] POST /identity/v3/users => generated 291 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:18:51.189863 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a51b88-3b02-4e68-a74a-10ade3785604 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:51.201607 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a51b88-3b02-4e68-a74a-10ade3785604 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:51.207594 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698be650-ca44-4f01-a84b-dbe36f6ed2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:51.208522 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698be650-ca44-4f01-a84b-dbe36f6ed2b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:51.209219 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698be650-ca44-4f01-a84b-dbe36f6ed2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:51.217415 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698be650-ca44-4f01-a84b-dbe36f6ed2b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:51.218788 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698be650-ca44-4f01-a84b-dbe36f6ed2b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:51.220534 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698be650-ca44-4f01-a84b-dbe36f6ed2b3 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:51.238638 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1013/2021] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:18:51.240379 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b0f2f0-4ee9-4cb2-82bc-828ad08bd185 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:51.260375 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b0f2f0-4ee9-4cb2-82bc-828ad08bd185 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:51.278088 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103edde0-d667-48e5-a58f-05d1a1a58c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:51.278815 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103edde0-d667-48e5-a58f-05d1a1a58c6c admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:51.279287 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103edde0-d667-48e5-a58f-05d1a1a58c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:51.279741 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103edde0-d667-48e5-a58f-05d1a1a58c6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:51.281014 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103edde0-d667-48e5-a58f-05d1a1a58c6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:51.282764 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103edde0-d667-48e5-a58f-05d1a1a58c6c admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:51.300103 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1009/2022] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:18:51.301843 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698be650-ca44-4f01-a84b-dbe36f6ed2b3 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:51.369688 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698be650-ca44-4f01-a84b-dbe36f6ed2b3 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:51.383565 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf71f21a-bc69-41a6-9e25-7d6c5ff9e3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:51.386164 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf71f21a-bc69-41a6-9e25-7d6c5ff9e3b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:51.386164 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf71f21a-bc69-41a6-9e25-7d6c5ff9e3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:51.386164 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf71f21a-bc69-41a6-9e25-7d6c5ff9e3b6 admin admin] PATH_INFO: `/v3/projects/80d1667aeb814212abe473f58d0ff420/users/8dc55bbbc4a544909a8c80d9638c3ea6/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:51.480809 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf71f21a-bc69-41a6-9e25-7d6c5ff9e3b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80d1667aeb814212abe473f58d0ff420, user_id=8dc55bbbc4a544909a8c80d9638c3ea6, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:51.486713 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf71f21a-bc69-41a6-9e25-7d6c5ff9e3b6 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:51.521354 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1014/2023] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:18:51 2022] PUT /identity/v3/projects/80d1667aeb814212abe473f58d0ff420/users/8dc55bbbc4a544909a8c80d9638c3ea6/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:18:51.522663 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367852e8-4836-4ad5-b5ac-603438743685 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:51.523347 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367852e8-4836-4ad5-b5ac-603438743685 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:51.524501 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367852e8-4836-4ad5-b5ac-603438743685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:51.549485 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-367852e8-4836-4ad5-b5ac-603438743685 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:51.551018 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-367852e8-4836-4ad5-b5ac-603438743685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:51.661966 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1010/2024] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:51.776628 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf71f21a-bc69-41a6-9e25-7d6c5ff9e3b6 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:51.778352 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-bf71f21a-bc69-41a6-9e25-7d6c5ff9e3b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:51.872708 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf71f21a-bc69-41a6-9e25-7d6c5ff9e3b6 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:51.878475 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a43e61-6d48-447c-8474-6d71b7b3ee16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:51.879465 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a43e61-6d48-447c-8474-6d71b7b3ee16 service neutron] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:51.880069 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a43e61-6d48-447c-8474-6d71b7b3ee16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:51.880497 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a43e61-6d48-447c-8474-6d71b7b3ee16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:51.896576 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a43e61-6d48-447c-8474-6d71b7b3ee16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:51.898143 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a43e61-6d48-447c-8474-6d71b7b3ee16 service neutron] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:51.925705 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1015/2025] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:18:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:18:53.480517 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab55ed-45bb-4943-9171-6a4ce4e563cb None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:53.481225 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab55ed-45bb-4943-9171-6a4ce4e563cb None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:53.481225 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab55ed-45bb-4943-9171-6a4ce4e563cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:53.521121 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-a5ab55ed-45bb-4943-9171-6a4ce4e563cb None None] MFA Rules not processed for user `8dc55bbbc4a544909a8c80d9638c3ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:53.522565 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-a5ab55ed-45bb-4943-9171-6a4ce4e563cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:53.654653 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1011/2026] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:53.667790 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a43e61-6d48-447c-8474-6d71b7b3ee16 service neutron] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:53.669310 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-38a43e61-6d48-447c-8474-6d71b7b3ee16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:53.785067 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a43e61-6d48-447c-8474-6d71b7b3ee16 service neutron] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:53.798321 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab7fa4-31b9-47f2-883a-bfe78dbf6c52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:53.799356 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab7fa4-31b9-47f2-883a-bfe78dbf6c52 service cinder] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:53.799640 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab7fa4-31b9-47f2-883a-bfe78dbf6c52 service cinder] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:53.799917 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab7fa4-31b9-47f2-883a-bfe78dbf6c52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:53.817092 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcab7fa4-31b9-47f2-883a-bfe78dbf6c52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:53.818583 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcab7fa4-31b9-47f2-883a-bfe78dbf6c52 service cinder] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:53.840542 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1016/2027] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:18:53 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:18:55.451835 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be59831-12a0-4a3d-b3fa-13664897a085 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:55.452325 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be59831-12a0-4a3d-b3fa-13664897a085 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:55.452406 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be59831-12a0-4a3d-b3fa-13664897a085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:55.513020 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-7be59831-12a0-4a3d-b3fa-13664897a085 None None] MFA Rules not processed for user `8dc55bbbc4a544909a8c80d9638c3ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:55.514486 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-7be59831-12a0-4a3d-b3fa-13664897a085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:55.548651 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1012/2028] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:57.962648 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab7fa4-31b9-47f2-883a-bfe78dbf6c52 service cinder] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:57.964208 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-fcab7fa4-31b9-47f2-883a-bfe78dbf6c52 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:57.980112 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab7fa4-31b9-47f2-883a-bfe78dbf6c52 service cinder] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:57.984802 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e148b5-dd8e-4062-99a9-b18067091842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:57.985701 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e148b5-dd8e-4062-99a9-b18067091842 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:57.985982 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e148b5-dd8e-4062-99a9-b18067091842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:57.986258 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e148b5-dd8e-4062-99a9-b18067091842 admin admin] PATH_INFO: `/v3/users/e64bccabbf334667a3e8de9f1b7bb878` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:57.987511 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e148b5-dd8e-4062-99a9-b18067091842 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e64bccabbf334667a3e8de9f1b7bb878)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:57.989777 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e148b5-dd8e-4062-99a9-b18067091842 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:58.037052 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-b7e148b5-dd8e-4062-99a9-b18067091842 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e64bccabbf334667a3e8de9f1b7bb878'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:58.043697 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-b7e148b5-dd8e-4062-99a9-b18067091842 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e64bccabbf334667a3e8de9f1b7bb878'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:58.044366 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-b7e148b5-dd8e-4062-99a9-b18067091842 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e64bccabbf334667a3e8de9f1b7bb878'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:58.050592 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-b7e148b5-dd8e-4062-99a9-b18067091842 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e64bccabbf334667a3e8de9f1b7bb878'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:58.051256 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-b7e148b5-dd8e-4062-99a9-b18067091842 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e64bccabbf334667a3e8de9f1b7bb878'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:58.069034 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1017/2029] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:18:57 2022] DELETE /identity/v3/users/e64bccabbf334667a3e8de9f1b7bb878 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:18:58.322380 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be59831-12a0-4a3d-b3fa-13664897a085 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:58.336338 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be59831-12a0-4a3d-b3fa-13664897a085 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:58.394107 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5b90a2-7123-4856-a94f-dc3f8e1ce781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:58.394948 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b90a2-7123-4856-a94f-dc3f8e1ce781 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:58.395224 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b90a2-7123-4856-a94f-dc3f8e1ce781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:58.395496 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b90a2-7123-4856-a94f-dc3f8e1ce781 admin admin] PATH_INFO: `/v3/projects/230486e6ce974ab89147f39cbf941839` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:58.396658 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5b90a2-7123-4856-a94f-dc3f8e1ce781 admin admin] RBAC: Authorizing `identity:delete_project(project_id=230486e6ce974ab89147f39cbf941839)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:58.398702 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5b90a2-7123-4856-a94f-dc3f8e1ce781 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:58.442494 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-1c5b90a2-7123-4856-a94f-dc3f8e1ce781 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '230486e6ce974ab89147f39cbf941839', 'request_id': 'req-1c5b90a2-7123-4856-a94f-dc3f8e1ce781'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:58.449266 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-1c5b90a2-7123-4856-a94f-dc3f8e1ce781 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '230486e6ce974ab89147f39cbf941839', 'request_id': 'req-1c5b90a2-7123-4856-a94f-dc3f8e1ce781'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:58.455959 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-1c5b90a2-7123-4856-a94f-dc3f8e1ce781 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '230486e6ce974ab89147f39cbf941839', 'request_id': 'req-1c5b90a2-7123-4856-a94f-dc3f8e1ce781'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:58.466655 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-1c5b90a2-7123-4856-a94f-dc3f8e1ce781 admin admin] The token cache is being invalidate because project 230486e6ce974ab89147f39cbf941839 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:18:58.466945 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-1c5b90a2-7123-4856-a94f-dc3f8e1ce781 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:58.467596 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-1c5b90a2-7123-4856-a94f-dc3f8e1ce781 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:58.469217 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1013/2030] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:18:58 2022] DELETE /identity/v3/projects/230486e6ce974ab89147f39cbf941839 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:58.474154 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f76f05-e25f-4789-8333-fad9fb56a8a0 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:58.474445 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f76f05-e25f-4789-8333-fad9fb56a8a0 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:58.474725 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f76f05-e25f-4789-8333-fad9fb56a8a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:58.494423 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-02f76f05-e25f-4789-8333-fad9fb56a8a0 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:58.495849 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-02f76f05-e25f-4789-8333-fad9fb56a8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:58.556421 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1018/2031] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:58.564241 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95cb447-1379-40ee-bef9-d41b4db104dc None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:58.564553 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95cb447-1379-40ee-bef9-d41b4db104dc None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:58.564826 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95cb447-1379-40ee-bef9-d41b4db104dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:58.584449 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-f95cb447-1379-40ee-bef9-d41b4db104dc None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:58.585659 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-f95cb447-1379-40ee-bef9-d41b4db104dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:58.593353 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1014/2032] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:58.597537 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f76f05-e25f-4789-8333-fad9fb56a8a0 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:58.608478 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f76f05-e25f-4789-8333-fad9fb56a8a0 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:58.613114 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da61d5fa-aaef-41c3-881c-aa214e6bf6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:58.613805 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61d5fa-aaef-41c3-881c-aa214e6bf6f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:58.614079 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61d5fa-aaef-41c3-881c-aa214e6bf6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:58.614357 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61d5fa-aaef-41c3-881c-aa214e6bf6f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:58.615072 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da61d5fa-aaef-41c3-881c-aa214e6bf6f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:18:58.615371 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da61d5fa-aaef-41c3-881c-aa214e6bf6f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:58.617520 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da61d5fa-aaef-41c3-881c-aa214e6bf6f7 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:58.629152 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1019/2033] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 17 18:18:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:18:58.634117 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95cb447-1379-40ee-bef9-d41b4db104dc None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:58.643087 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95cb447-1379-40ee-bef9-d41b4db104dc None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:58.647681 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d1091-23e5-465c-a03c-0217b6e4af31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:58.648342 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d1091-23e5-465c-a03c-0217b6e4af31 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:58.648621 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d1091-23e5-465c-a03c-0217b6e4af31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:58.648890 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d1091-23e5-465c-a03c-0217b6e4af31 admin admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:58.649612 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78d1091-23e5-465c-a03c-0217b6e4af31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:58.651485 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78d1091-23e5-465c-a03c-0217b6e4af31 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:58.676971 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1015/2034] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:18:58 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:18:58.682191 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da61d5fa-aaef-41c3-881c-aa214e6bf6f7 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:58.692004 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da61d5fa-aaef-41c3-881c-aa214e6bf6f7 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:58.761430 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f627f95-6b79-467d-9b6a-0058e7ca4f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:58.762841 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f627f95-6b79-467d-9b6a-0058e7ca4f57 admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:58.763199 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f627f95-6b79-467d-9b6a-0058e7ca4f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:58.763571 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f627f95-6b79-467d-9b6a-0058e7ca4f57 admin admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:58.764339 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f627f95-6b79-467d-9b6a-0058e7ca4f57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:58.766903 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f627f95-6b79-467d-9b6a-0058e7ca4f57 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:58.794432 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1020/2035] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:18:58 2022] POST /identity/v3/users => generated 292 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:18:58.798285 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d1091-23e5-465c-a03c-0217b6e4af31 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:58.810063 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d1091-23e5-465c-a03c-0217b6e4af31 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:58.814869 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384724cd-1dc7-442c-9f40-4d3468128624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:58.816155 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384724cd-1dc7-442c-9f40-4d3468128624 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:58.816155 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384724cd-1dc7-442c-9f40-4d3468128624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:58.816155 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384724cd-1dc7-442c-9f40-4d3468128624 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:58.817000 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384724cd-1dc7-442c-9f40-4d3468128624 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:58.818724 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384724cd-1dc7-442c-9f40-4d3468128624 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:58.841995 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1016/2036] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:18:58 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:18:58.846025 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f627f95-6b79-467d-9b6a-0058e7ca4f57 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:58.862332 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f627f95-6b79-467d-9b6a-0058e7ca4f57 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:58.875364 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9478d70-fe6c-4a91-b492-54c4cac69db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:58.876383 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9478d70-fe6c-4a91-b492-54c4cac69db5 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:58.876468 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9478d70-fe6c-4a91-b492-54c4cac69db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:58.876729 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9478d70-fe6c-4a91-b492-54c4cac69db5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:58.877472 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9478d70-fe6c-4a91-b492-54c4cac69db5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:58.879370 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9478d70-fe6c-4a91-b492-54c4cac69db5 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:58.890521 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1021/2037] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:18:58 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:18:58.894768 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384724cd-1dc7-442c-9f40-4d3468128624 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:58.905701 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384724cd-1dc7-442c-9f40-4d3468128624 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:58.912314 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d76ac62-41ce-4abf-a9aa-f5c254e64a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:58.914363 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76ac62-41ce-4abf-a9aa-f5c254e64a08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:58.914925 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76ac62-41ce-4abf-a9aa-f5c254e64a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:58.915696 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76ac62-41ce-4abf-a9aa-f5c254e64a08 admin admin] PATH_INFO: `/v3/projects/dda0e31bc2c8401180aeeb9133927878/users/b29a396ea8fa45248ccca47b2f33a960/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:58.936860 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d76ac62-41ce-4abf-a9aa-f5c254e64a08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dda0e31bc2c8401180aeeb9133927878, user_id=b29a396ea8fa45248ccca47b2f33a960, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:58.942143 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d76ac62-41ce-4abf-a9aa-f5c254e64a08 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:58.960649 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1017/2038] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:18:58 2022] PUT /identity/v3/projects/dda0e31bc2c8401180aeeb9133927878/users/b29a396ea8fa45248ccca47b2f33a960/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:58.972653 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71eca2b-5f8c-48e6-bdaf-9922ec46317b None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:58.973141 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71eca2b-5f8c-48e6-bdaf-9922ec46317b None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:58.973319 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71eca2b-5f8c-48e6-bdaf-9922ec46317b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:59.009336 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-a71eca2b-5f8c-48e6-bdaf-9922ec46317b None None] MFA Rules not processed for user `b29a396ea8fa45248ccca47b2f33a960`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:59.011089 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-a71eca2b-5f8c-48e6-bdaf-9922ec46317b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:59.080470 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1022/2039] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:18:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:59.091218 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d76ac62-41ce-4abf-a9aa-f5c254e64a08 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:59.092911 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-8d76ac62-41ce-4abf-a9aa-f5c254e64a08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:59.166291 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d76ac62-41ce-4abf-a9aa-f5c254e64a08 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:59.172044 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff6a9c-3089-462b-ae97-614d41560df2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b430b739cb54fc7911bc89f8ea2df72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:59.172701 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff6a9c-3089-462b-ae97-614d41560df2 service nova] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:59.172979 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff6a9c-3089-462b-ae97-614d41560df2 service nova] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:59.173246 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff6a9c-3089-462b-ae97-614d41560df2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:59.181614 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff6a9c-3089-462b-ae97-614d41560df2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:59.183192 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ff6a9c-3089-462b-ae97-614d41560df2 service nova] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:59.191859 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1018/2040] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:18:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:19:09.896555 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71eca2b-5f8c-48e6-bdaf-9922ec46317b None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:09.958769 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71eca2b-5f8c-48e6-bdaf-9922ec46317b None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:09.964107 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d914845b-4e97-4cc7-968b-5d6fe9e70a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:09.964988 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d914845b-4e97-4cc7-968b-5d6fe9e70a70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:09.965252 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d914845b-4e97-4cc7-968b-5d6fe9e70a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:09.965558 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d914845b-4e97-4cc7-968b-5d6fe9e70a70 admin admin] PATH_INFO: `/v3/users/b29a396ea8fa45248ccca47b2f33a960` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:09.966739 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d914845b-4e97-4cc7-968b-5d6fe9e70a70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b29a396ea8fa45248ccca47b2f33a960)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:09.968661 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d914845b-4e97-4cc7-968b-5d6fe9e70a70 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:10.011805 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-d914845b-4e97-4cc7-968b-5d6fe9e70a70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b29a396ea8fa45248ccca47b2f33a960'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:10.018321 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-d914845b-4e97-4cc7-968b-5d6fe9e70a70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b29a396ea8fa45248ccca47b2f33a960'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:10.018981 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-d914845b-4e97-4cc7-968b-5d6fe9e70a70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b29a396ea8fa45248ccca47b2f33a960'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:10.026285 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-d914845b-4e97-4cc7-968b-5d6fe9e70a70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b29a396ea8fa45248ccca47b2f33a960'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:10.026914 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-d914845b-4e97-4cc7-968b-5d6fe9e70a70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b29a396ea8fa45248ccca47b2f33a960'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:10.046292 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1023/2041] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:19:09 2022] DELETE /identity/v3/users/b29a396ea8fa45248ccca47b2f33a960 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:19:10.050974 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b3c92-a9bc-49c4-a89f-ad9679724e75 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:10.051547 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b3c92-a9bc-49c4-a89f-ad9679724e75 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:10.051547 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57b3c92-a9bc-49c4-a89f-ad9679724e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:10.074846 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-f57b3c92-a9bc-49c4-a89f-ad9679724e75 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:19:10.076551 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-f57b3c92-a9bc-49c4-a89f-ad9679724e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:10.158892 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1019/2042] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:19:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:19:10.171793 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d914845b-4e97-4cc7-968b-5d6fe9e70a70 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:10.173604 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-d914845b-4e97-4cc7-968b-5d6fe9e70a70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:10.246339 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d914845b-4e97-4cc7-968b-5d6fe9e70a70 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:10.250324 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efde103-bee0-48ad-88b7-f50f551bc6f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:10.250981 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efde103-bee0-48ad-88b7-f50f551bc6f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:10.251417 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efde103-bee0-48ad-88b7-f50f551bc6f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:10.251697 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efde103-bee0-48ad-88b7-f50f551bc6f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:10.262370 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efde103-bee0-48ad-88b7-f50f551bc6f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:10.263801 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efde103-bee0-48ad-88b7-f50f551bc6f9 service neutron] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:10.273693 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1024/2043] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:19:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:19:10.647519 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b3c92-a9bc-49c4-a89f-ad9679724e75 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:10.649775 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-f57b3c92-a9bc-49c4-a89f-ad9679724e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:10.668831 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57b3c92-a9bc-49c4-a89f-ad9679724e75 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:10.677042 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e042e0-3b2a-4e2d-b074-2611571a6fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:10.678209 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e042e0-3b2a-4e2d-b074-2611571a6fd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:10.678568 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e042e0-3b2a-4e2d-b074-2611571a6fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:10.681767 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e042e0-3b2a-4e2d-b074-2611571a6fd2 admin admin] PATH_INFO: `/v3/projects/dda0e31bc2c8401180aeeb9133927878` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:10.686841 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e042e0-3b2a-4e2d-b074-2611571a6fd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dda0e31bc2c8401180aeeb9133927878)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:10.687977 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e042e0-3b2a-4e2d-b074-2611571a6fd2 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:10.751875 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-65e042e0-3b2a-4e2d-b074-2611571a6fd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dda0e31bc2c8401180aeeb9133927878', 'request_id': 'req-65e042e0-3b2a-4e2d-b074-2611571a6fd2'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:10.761937 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-65e042e0-3b2a-4e2d-b074-2611571a6fd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dda0e31bc2c8401180aeeb9133927878', 'request_id': 'req-65e042e0-3b2a-4e2d-b074-2611571a6fd2'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:10.772575 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-65e042e0-3b2a-4e2d-b074-2611571a6fd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dda0e31bc2c8401180aeeb9133927878', 'request_id': 'req-65e042e0-3b2a-4e2d-b074-2611571a6fd2'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:10.785397 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-65e042e0-3b2a-4e2d-b074-2611571a6fd2 admin admin] The token cache is being invalidate because project dda0e31bc2c8401180aeeb9133927878 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:19:10.785719 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-65e042e0-3b2a-4e2d-b074-2611571a6fd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:10.786757 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-65e042e0-3b2a-4e2d-b074-2611571a6fd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:10.790157 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1020/2044] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:19:10 2022] DELETE /identity/v3/projects/dda0e31bc2c8401180aeeb9133927878 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:19:10.795161 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a7822-3608-43fd-85a8-2eea1f409ca6 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:10.795535 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a7822-3608-43fd-85a8-2eea1f409ca6 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:10.796656 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a7822-3608-43fd-85a8-2eea1f409ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:10.826779 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-b74a7822-3608-43fd-85a8-2eea1f409ca6 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:19:10.828374 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-b74a7822-3608-43fd-85a8-2eea1f409ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:10.895331 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1025/2045] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:19:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:19:10.903726 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e702a-b669-4c01-b961-bb99e5aa8cdb None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:10.904010 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e702a-b669-4c01-b961-bb99e5aa8cdb None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:10.904284 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e702a-b669-4c01-b961-bb99e5aa8cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:10.922859 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-c36e702a-b669-4c01-b961-bb99e5aa8cdb None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:19:10.924043 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-c36e702a-b669-4c01-b961-bb99e5aa8cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:10.932608 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1021/2046] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:19:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:19:10.936910 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a7822-3608-43fd-85a8-2eea1f409ca6 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:10.946598 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a7822-3608-43fd-85a8-2eea1f409ca6 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:10.951351 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81672d-9d9e-424d-b34a-a24ebaf88d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:10.951985 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81672d-9d9e-424d-b34a-a24ebaf88d26 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:10.952260 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81672d-9d9e-424d-b34a-a24ebaf88d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:10.952531 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81672d-9d9e-424d-b34a-a24ebaf88d26 admin admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:10.953241 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa81672d-9d9e-424d-b34a-a24ebaf88d26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:19:10.953590 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa81672d-9d9e-424d-b34a-a24ebaf88d26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:10.955160 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa81672d-9d9e-424d-b34a-a24ebaf88d26 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:10.966520 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1026/2047] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 17 18:19:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:19:10.970509 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36e702a-b669-4c01-b961-bb99e5aa8cdb None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:10.980067 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36e702a-b669-4c01-b961-bb99e5aa8cdb None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:10.984607 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b978bb20-7543-4d05-86d5-31790e482ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:10.985238 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b978bb20-7543-4d05-86d5-31790e482ec7 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:10.985536 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b978bb20-7543-4d05-86d5-31790e482ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:10.985808 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b978bb20-7543-4d05-86d5-31790e482ec7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:10.986494 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b978bb20-7543-4d05-86d5-31790e482ec7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:10.988399 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b978bb20-7543-4d05-86d5-31790e482ec7 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:11.013204 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1022/2048] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:19:10 2022] POST /identity/v3/projects => generated 405 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:19:11.017156 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81672d-9d9e-424d-b34a-a24ebaf88d26 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:11.027359 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81672d-9d9e-424d-b34a-a24ebaf88d26 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:11.081123 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2593f-4373-481b-8de4-d39d0fd9e1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:11.081733 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2593f-4373-481b-8de4-d39d0fd9e1a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:11.082027 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2593f-4373-481b-8de4-d39d0fd9e1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:11.082300 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2593f-4373-481b-8de4-d39d0fd9e1a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:11.082970 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f2593f-4373-481b-8de4-d39d0fd9e1a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:11.084855 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f2593f-4373-481b-8de4-d39d0fd9e1a3 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:11.104139 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1027/2049] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:19:11 2022] POST /identity/v3/users => generated 303 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:19:11.108239 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b978bb20-7543-4d05-86d5-31790e482ec7 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:11.118399 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b978bb20-7543-4d05-86d5-31790e482ec7 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:11.122913 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9d732-79d7-4d9c-be9a-3b1ac07a3c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:11.123560 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9d732-79d7-4d9c-be9a-3b1ac07a3c85 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:11.123834 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9d732-79d7-4d9c-be9a-3b1ac07a3c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:11.124101 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9d732-79d7-4d9c-be9a-3b1ac07a3c85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:11.124815 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a9d732-79d7-4d9c-be9a-3b1ac07a3c85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:11.126422 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a9d732-79d7-4d9c-be9a-3b1ac07a3c85 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:11.137513 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1023/2050] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:19:11.140344 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2593f-4373-481b-8de4-d39d0fd9e1a3 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:11.150691 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2593f-4373-481b-8de4-d39d0fd9e1a3 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:11.155382 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fef5bb-25f3-4655-b70c-e3fe73f793e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:11.156139 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fef5bb-25f3-4655-b70c-e3fe73f793e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:11.156446 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fef5bb-25f3-4655-b70c-e3fe73f793e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:11.156714 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fef5bb-25f3-4655-b70c-e3fe73f793e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:11.157434 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fef5bb-25f3-4655-b70c-e3fe73f793e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:11.159043 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fef5bb-25f3-4655-b70c-e3fe73f793e0 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:11.169693 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1028/2051] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:19:11.173761 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9d732-79d7-4d9c-be9a-3b1ac07a3c85 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:11.183926 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9d732-79d7-4d9c-be9a-3b1ac07a3c85 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:11.188573 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a2eca2-159d-4561-8a1f-54e748810966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:11.189449 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a2eca2-159d-4561-8a1f-54e748810966 admin admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:11.189757 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a2eca2-159d-4561-8a1f-54e748810966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:11.190030 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a2eca2-159d-4561-8a1f-54e748810966 admin admin] PATH_INFO: `/v3/projects/0753963043d94b07aa2b84813318e15e/users/2498ba43a9ca476a8bb612f6421251ee/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:11.204674 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a2eca2-159d-4561-8a1f-54e748810966 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0753963043d94b07aa2b84813318e15e, user_id=2498ba43a9ca476a8bb612f6421251ee, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:11.207471 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a2eca2-159d-4561-8a1f-54e748810966 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:11.221226 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1024/2052] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:19:11 2022] PUT /identity/v3/projects/0753963043d94b07aa2b84813318e15e/users/2498ba43a9ca476a8bb612f6421251ee/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:19:11.233186 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dcdcab-c0e2-4ef8-ba8c-00a4117e8091 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:11.233751 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dcdcab-c0e2-4ef8-ba8c-00a4117e8091 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:11.234256 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dcdcab-c0e2-4ef8-ba8c-00a4117e8091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:11.262941 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-e6dcdcab-c0e2-4ef8-ba8c-00a4117e8091 None None] MFA Rules not processed for user `2498ba43a9ca476a8bb612f6421251ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:19:11.264157 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-e6dcdcab-c0e2-4ef8-ba8c-00a4117e8091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:11.328689 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1029/2053] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:19:11 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:19:11.333201 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a2eca2-159d-4561-8a1f-54e748810966 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:11.393973 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a2eca2-159d-4561-8a1f-54e748810966 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:11.399205 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce3e24-d8dc-4714-a30d-5311b3684583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:11.399857 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce3e24-d8dc-4714-a30d-5311b3684583 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:11.400140 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce3e24-d8dc-4714-a30d-5311b3684583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:11.400415 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce3e24-d8dc-4714-a30d-5311b3684583 admin admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:11.401098 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ce3e24-d8dc-4714-a30d-5311b3684583 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:11.403010 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ce3e24-d8dc-4714-a30d-5311b3684583 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:11.427848 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1025/2054] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:19:11 2022] POST /identity/v3/projects => generated 405 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:19:11.431781 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dcdcab-c0e2-4ef8-ba8c-00a4117e8091 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:11.442267 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dcdcab-c0e2-4ef8-ba8c-00a4117e8091 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:11.510172 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16132dec-2a89-43c3-8a27-23a0481ea17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:11.510881 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16132dec-2a89-43c3-8a27-23a0481ea17f admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:11.511158 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16132dec-2a89-43c3-8a27-23a0481ea17f admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:11.511429 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16132dec-2a89-43c3-8a27-23a0481ea17f admin admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:11.512120 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16132dec-2a89-43c3-8a27-23a0481ea17f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:11.515127 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16132dec-2a89-43c3-8a27-23a0481ea17f admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:11.535966 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1030/2055] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:19:11 2022] POST /identity/v3/users => generated 309 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:19:11.539953 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce3e24-d8dc-4714-a30d-5311b3684583 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:11.550117 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce3e24-d8dc-4714-a30d-5311b3684583 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:11.554649 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c629bdb6-101b-48db-be3d-6072a9de60e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:11.555291 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c629bdb6-101b-48db-be3d-6072a9de60e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:11.555565 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c629bdb6-101b-48db-be3d-6072a9de60e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:11.555837 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c629bdb6-101b-48db-be3d-6072a9de60e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:11.556577 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c629bdb6-101b-48db-be3d-6072a9de60e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:11.558209 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c629bdb6-101b-48db-be3d-6072a9de60e3 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:11.568276 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1026/2056] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:19:11.572916 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16132dec-2a89-43c3-8a27-23a0481ea17f admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:11.583009 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16132dec-2a89-43c3-8a27-23a0481ea17f admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:11.588325 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204800a8-6d7d-4eaa-a99c-bf4f52c28121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:11.589147 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204800a8-6d7d-4eaa-a99c-bf4f52c28121 admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:11.589428 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204800a8-6d7d-4eaa-a99c-bf4f52c28121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:11.589735 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204800a8-6d7d-4eaa-a99c-bf4f52c28121 admin admin] PATH_INFO: `/v3/projects/6ee89d06af374f7c8cb6871d3b82d8d5/users/ca1912ab1d334052934dd8a3eaa7e866/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:11.603996 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204800a8-6d7d-4eaa-a99c-bf4f52c28121 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ee89d06af374f7c8cb6871d3b82d8d5, user_id=ca1912ab1d334052934dd8a3eaa7e866, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:11.606762 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204800a8-6d7d-4eaa-a99c-bf4f52c28121 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:11.619480 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1031/2057] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:19:11 2022] PUT /identity/v3/projects/6ee89d06af374f7c8cb6871d3b82d8d5/users/ca1912ab1d334052934dd8a3eaa7e866/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:19:11.623693 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c629bdb6-101b-48db-be3d-6072a9de60e3 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:11.634282 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c629bdb6-101b-48db-be3d-6072a9de60e3 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:11.689147 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e27b826-93f4-48a4-a667-7dc0ea5a6e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:11.689852 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27b826-93f4-48a4-a667-7dc0ea5a6e04 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:11.690136 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27b826-93f4-48a4-a667-7dc0ea5a6e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:11.690413 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e27b826-93f4-48a4-a667-7dc0ea5a6e04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:11.691142 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e27b826-93f4-48a4-a667-7dc0ea5a6e04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:11.692739 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e27b826-93f4-48a4-a667-7dc0ea5a6e04 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:11.704142 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1027/2058] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:19:11.708499 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204800a8-6d7d-4eaa-a99c-bf4f52c28121 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:11.720201 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204800a8-6d7d-4eaa-a99c-bf4f52c28121 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:11.725339 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c5641-dd66-41c5-b95b-020345031427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:11.726288 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c5641-dd66-41c5-b95b-020345031427 admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:11.726563 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c5641-dd66-41c5-b95b-020345031427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:11.726833 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c5641-dd66-41c5-b95b-020345031427 admin admin] PATH_INFO: `/v3/projects/6ee89d06af374f7c8cb6871d3b82d8d5/users/ca1912ab1d334052934dd8a3eaa7e866/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:11.728871 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065c5641-dd66-41c5-b95b-020345031427 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ee89d06af374f7c8cb6871d3b82d8d5, user_id=ca1912ab1d334052934dd8a3eaa7e866, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:11.731530 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065c5641-dd66-41c5-b95b-020345031427 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:11.742247 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1032/2059] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:19:11 2022] PUT /identity/v3/projects/6ee89d06af374f7c8cb6871d3b82d8d5/users/ca1912ab1d334052934dd8a3eaa7e866/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:19:11.753790 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc740e-e38e-41f9-a27a-7f75210b7476 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:11.754068 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc740e-e38e-41f9-a27a-7f75210b7476 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:11.754388 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbc740e-e38e-41f9-a27a-7f75210b7476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:11.783175 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-ecbc740e-e38e-41f9-a27a-7f75210b7476 None None] MFA Rules not processed for user `ca1912ab1d334052934dd8a3eaa7e866`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:19:11.784397 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-ecbc740e-e38e-41f9-a27a-7f75210b7476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:11.864714 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1028/2060] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:19:11 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:19:11.875603 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c5641-dd66-41c5-b95b-020345031427 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:11.877373 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-065c5641-dd66-41c5-b95b-020345031427 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:11.939044 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c5641-dd66-41c5-b95b-020345031427 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:11.943024 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01fa8c1-e3e3-4cb4-9170-a34eda0ed6a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:11.943997 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01fa8c1-e3e3-4cb4-9170-a34eda0ed6a7 service cinder] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:11.943997 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01fa8c1-e3e3-4cb4-9170-a34eda0ed6a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:11.944172 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01fa8c1-e3e3-4cb4-9170-a34eda0ed6a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:11.954834 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01fa8c1-e3e3-4cb4-9170-a34eda0ed6a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:11.956304 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01fa8c1-e3e3-4cb4-9170-a34eda0ed6a7 service cinder] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:11.966293 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1033/2061] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:19:11 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:19:12.099095 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc740e-e38e-41f9-a27a-7f75210b7476 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:12.162203 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbc740e-e38e-41f9-a27a-7f75210b7476 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:12.167195 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badaeb74-52c2-45d0-b9b4-3b87c6785104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:12.168061 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badaeb74-52c2-45d0-b9b4-3b87c6785104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:12.168340 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badaeb74-52c2-45d0-b9b4-3b87c6785104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:12.168610 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badaeb74-52c2-45d0-b9b4-3b87c6785104 admin admin] PATH_INFO: `/v3/users/2498ba43a9ca476a8bb612f6421251ee` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:12.169833 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badaeb74-52c2-45d0-b9b4-3b87c6785104 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2498ba43a9ca476a8bb612f6421251ee)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:12.171792 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badaeb74-52c2-45d0-b9b4-3b87c6785104 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:12.217781 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-badaeb74-52c2-45d0-b9b4-3b87c6785104 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2498ba43a9ca476a8bb612f6421251ee'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:12.229380 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-badaeb74-52c2-45d0-b9b4-3b87c6785104 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2498ba43a9ca476a8bb612f6421251ee'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:12.230059 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-badaeb74-52c2-45d0-b9b4-3b87c6785104 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2498ba43a9ca476a8bb612f6421251ee'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:12.230681 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-badaeb74-52c2-45d0-b9b4-3b87c6785104 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2498ba43a9ca476a8bb612f6421251ee'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:12.237170 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-badaeb74-52c2-45d0-b9b4-3b87c6785104 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2498ba43a9ca476a8bb612f6421251ee'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:12.249602 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1029/2062] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:19:12 2022] DELETE /identity/v3/users/2498ba43a9ca476a8bb612f6421251ee => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:19:12.254074 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed86134-6476-4bc9-a253-e21d74d4279d None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:12.254356 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed86134-6476-4bc9-a253-e21d74d4279d None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:12.254631 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed86134-6476-4bc9-a253-e21d74d4279d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:12.273156 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-aed86134-6476-4bc9-a253-e21d74d4279d None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:19:12.274381 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-aed86134-6476-4bc9-a253-e21d74d4279d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:12.332138 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1034/2063] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:19:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:19:12.341573 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badaeb74-52c2-45d0-b9b4-3b87c6785104 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:12.343024 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-badaeb74-52c2-45d0-b9b4-3b87c6785104 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:12.400956 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badaeb74-52c2-45d0-b9b4-3b87c6785104 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:12.404536 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fcea68-779a-4212-9a93-2cf755d08867 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:12.405163 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fcea68-779a-4212-9a93-2cf755d08867 service neutron] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:12.405437 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fcea68-779a-4212-9a93-2cf755d08867 service neutron] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:12.405734 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fcea68-779a-4212-9a93-2cf755d08867 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:12.415935 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fcea68-779a-4212-9a93-2cf755d08867 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:12.417676 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fcea68-779a-4212-9a93-2cf755d08867 service neutron] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:12.427406 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1030/2064] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:19:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:19:12.764544 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed86134-6476-4bc9-a253-e21d74d4279d None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:12.766556 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-aed86134-6476-4bc9-a253-e21d74d4279d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:12.787930 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed86134-6476-4bc9-a253-e21d74d4279d None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:12.793337 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7509dff7-8d72-4700-869b-d59f620c2c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:12.794247 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509dff7-8d72-4700-869b-d59f620c2c4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:12.794521 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509dff7-8d72-4700-869b-d59f620c2c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:12.795334 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7509dff7-8d72-4700-869b-d59f620c2c4a admin admin] PATH_INFO: `/v3/projects/0753963043d94b07aa2b84813318e15e` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:12.796544 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7509dff7-8d72-4700-869b-d59f620c2c4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0753963043d94b07aa2b84813318e15e)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:12.798495 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7509dff7-8d72-4700-869b-d59f620c2c4a admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:12.864701 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-7509dff7-8d72-4700-869b-d59f620c2c4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0753963043d94b07aa2b84813318e15e', 'request_id': 'req-7509dff7-8d72-4700-869b-d59f620c2c4a'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:12.872693 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-7509dff7-8d72-4700-869b-d59f620c2c4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0753963043d94b07aa2b84813318e15e', 'request_id': 'req-7509dff7-8d72-4700-869b-d59f620c2c4a'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:12.883114 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-7509dff7-8d72-4700-869b-d59f620c2c4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0753963043d94b07aa2b84813318e15e', 'request_id': 'req-7509dff7-8d72-4700-869b-d59f620c2c4a'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:12.896156 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-7509dff7-8d72-4700-869b-d59f620c2c4a admin admin] The token cache is being invalidate because project 0753963043d94b07aa2b84813318e15e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:19:12.896572 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-7509dff7-8d72-4700-869b-d59f620c2c4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:12.897678 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-7509dff7-8d72-4700-869b-d59f620c2c4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:12.902724 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1035/2065] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:19:12 2022] DELETE /identity/v3/projects/0753963043d94b07aa2b84813318e15e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:19:12.904264 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fcea68-779a-4212-9a93-2cf755d08867 service neutron] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:12.914320 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fcea68-779a-4212-9a93-2cf755d08867 service neutron] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:13.002398 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0cf528-8c90-4ce0-a876-9135aef678df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:13.003411 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0cf528-8c90-4ce0-a876-9135aef678df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:13.003696 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0cf528-8c90-4ce0-a876-9135aef678df admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:13.003972 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0cf528-8c90-4ce0-a876-9135aef678df admin admin] PATH_INFO: `/v3/users/ca1912ab1d334052934dd8a3eaa7e866` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:13.005201 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0cf528-8c90-4ce0-a876-9135aef678df admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca1912ab1d334052934dd8a3eaa7e866)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:13.008118 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0cf528-8c90-4ce0-a876-9135aef678df admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:13.066428 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-ad0cf528-8c90-4ce0-a876-9135aef678df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca1912ab1d334052934dd8a3eaa7e866'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:13.078596 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-ad0cf528-8c90-4ce0-a876-9135aef678df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca1912ab1d334052934dd8a3eaa7e866'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:13.079272 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-ad0cf528-8c90-4ce0-a876-9135aef678df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca1912ab1d334052934dd8a3eaa7e866'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:13.079893 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-ad0cf528-8c90-4ce0-a876-9135aef678df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca1912ab1d334052934dd8a3eaa7e866'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:13.086884 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-ad0cf528-8c90-4ce0-a876-9135aef678df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca1912ab1d334052934dd8a3eaa7e866'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:13.101654 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1031/2066] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:19:12 2022] DELETE /identity/v3/users/ca1912ab1d334052934dd8a3eaa7e866 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:19:13.411686 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7509dff7-8d72-4700-869b-d59f620c2c4a admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:13.414472 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-7509dff7-8d72-4700-869b-d59f620c2c4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:13.428601 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7509dff7-8d72-4700-869b-d59f620c2c4a admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:13.489064 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65315610-3d7c-4ef2-80e4-5eaa436b0527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:13.489872 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65315610-3d7c-4ef2-80e4-5eaa436b0527 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:13.490149 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65315610-3d7c-4ef2-80e4-5eaa436b0527 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:13.490420 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65315610-3d7c-4ef2-80e4-5eaa436b0527 admin admin] PATH_INFO: `/v3/projects/6ee89d06af374f7c8cb6871d3b82d8d5` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:13.491671 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65315610-3d7c-4ef2-80e4-5eaa436b0527 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ee89d06af374f7c8cb6871d3b82d8d5)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:13.493617 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65315610-3d7c-4ef2-80e4-5eaa436b0527 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:13.541247 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-65315610-3d7c-4ef2-80e4-5eaa436b0527 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ee89d06af374f7c8cb6871d3b82d8d5', 'request_id': 'req-65315610-3d7c-4ef2-80e4-5eaa436b0527'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:13.547565 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-65315610-3d7c-4ef2-80e4-5eaa436b0527 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ee89d06af374f7c8cb6871d3b82d8d5', 'request_id': 'req-65315610-3d7c-4ef2-80e4-5eaa436b0527'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:13.555188 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-65315610-3d7c-4ef2-80e4-5eaa436b0527 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ee89d06af374f7c8cb6871d3b82d8d5', 'request_id': 'req-65315610-3d7c-4ef2-80e4-5eaa436b0527'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:13.565740 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-65315610-3d7c-4ef2-80e4-5eaa436b0527 admin admin] The token cache is being invalidate because project 6ee89d06af374f7c8cb6871d3b82d8d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:19:13.566026 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-65315610-3d7c-4ef2-80e4-5eaa436b0527 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:13.566769 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-65315610-3d7c-4ef2-80e4-5eaa436b0527 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:13.568483 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1036/2067] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:19:13 2022] DELETE /identity/v3/projects/6ee89d06af374f7c8cb6871d3b82d8d5 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:19:13.573676 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc17c350-8c1b-409b-87d5-2197aeecb872 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:13.574153 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc17c350-8c1b-409b-87d5-2197aeecb872 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:13.574242 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc17c350-8c1b-409b-87d5-2197aeecb872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:13.592590 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-fc17c350-8c1b-409b-87d5-2197aeecb872 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:19:13.593879 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-fc17c350-8c1b-409b-87d5-2197aeecb872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:13.650596 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1032/2068] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:19:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:19:13.658287 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c12f7-fb5f-4cb5-afd2-6999af87b6ba None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:13.658572 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c12f7-fb5f-4cb5-afd2-6999af87b6ba None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:13.658848 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c12f7-fb5f-4cb5-afd2-6999af87b6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:13.676914 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-d44c12f7-fb5f-4cb5-afd2-6999af87b6ba None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:19:13.678153 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-d44c12f7-fb5f-4cb5-afd2-6999af87b6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:13.687143 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1037/2069] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:19:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:19:13.690660 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc17c350-8c1b-409b-87d5-2197aeecb872 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:13.701225 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc17c350-8c1b-409b-87d5-2197aeecb872 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:13.705858 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be9358-45f8-43d4-a26a-3df03780b056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:13.706516 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be9358-45f8-43d4-a26a-3df03780b056 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:13.706793 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be9358-45f8-43d4-a26a-3df03780b056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:13.707066 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be9358-45f8-43d4-a26a-3df03780b056 admin admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:13.707792 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2be9358-45f8-43d4-a26a-3df03780b056 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:19:13.708095 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2be9358-45f8-43d4-a26a-3df03780b056 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:13.709726 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2be9358-45f8-43d4-a26a-3df03780b056 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:13.726199 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1033/2070] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 17 18:19:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:19:13.727299 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c12f7-fb5f-4cb5-afd2-6999af87b6ba None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:13.736438 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c12f7-fb5f-4cb5-afd2-6999af87b6ba None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:13.741892 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8125247-bb66-488f-a8ff-a16d02ede191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:13.742560 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8125247-bb66-488f-a8ff-a16d02ede191 admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:13.742837 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8125247-bb66-488f-a8ff-a16d02ede191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:13.743107 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8125247-bb66-488f-a8ff-a16d02ede191 admin admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:13.743791 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8125247-bb66-488f-a8ff-a16d02ede191 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:13.745979 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8125247-bb66-488f-a8ff-a16d02ede191 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:13.771947 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1038/2071] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:19:13 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:19:13.776459 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be9358-45f8-43d4-a26a-3df03780b056 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:13.786504 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be9358-45f8-43d4-a26a-3df03780b056 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:13.843074 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e54742-ac45-4320-9cbf-a55d18522f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:13.843865 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e54742-ac45-4320-9cbf-a55d18522f5f admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:13.844149 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e54742-ac45-4320-9cbf-a55d18522f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:13.844503 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e54742-ac45-4320-9cbf-a55d18522f5f admin admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:13.845308 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e54742-ac45-4320-9cbf-a55d18522f5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:13.847297 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e54742-ac45-4320-9cbf-a55d18522f5f admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:13.871470 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1034/2072] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:19:13 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:19:13.872492 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8125247-bb66-488f-a8ff-a16d02ede191 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:13.882961 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8125247-bb66-488f-a8ff-a16d02ede191 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:13.887721 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8542786-6a2d-415b-8190-1cdebb5905fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:13.888525 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8542786-6a2d-415b-8190-1cdebb5905fb admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:13.888891 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8542786-6a2d-415b-8190-1cdebb5905fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:13.889226 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8542786-6a2d-415b-8190-1cdebb5905fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:13.890066 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8542786-6a2d-415b-8190-1cdebb5905fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:13.891722 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8542786-6a2d-415b-8190-1cdebb5905fb admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:13.902848 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1039/2073] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:19:13.906566 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e54742-ac45-4320-9cbf-a55d18522f5f admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:13.916283 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e54742-ac45-4320-9cbf-a55d18522f5f admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:13.920783 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b8df2-29c9-4cde-b9ac-b09e423dfd90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:13.921430 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b8df2-29c9-4cde-b9ac-b09e423dfd90 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:13.921734 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b8df2-29c9-4cde-b9ac-b09e423dfd90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:13.922004 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b8df2-29c9-4cde-b9ac-b09e423dfd90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:13.922716 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b8df2-29c9-4cde-b9ac-b09e423dfd90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:13.924313 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b8df2-29c9-4cde-b9ac-b09e423dfd90 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:13.935607 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1035/2074] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:19:13.940103 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8542786-6a2d-415b-8190-1cdebb5905fb admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:13.951192 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8542786-6a2d-415b-8190-1cdebb5905fb admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:13.956083 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8682aa0b-cbce-4251-92cd-f399b44d93d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:13.956978 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8682aa0b-cbce-4251-92cd-f399b44d93d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:13.957253 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8682aa0b-cbce-4251-92cd-f399b44d93d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:13.957553 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8682aa0b-cbce-4251-92cd-f399b44d93d5 admin admin] PATH_INFO: `/v3/projects/8531497ecc14421a86bb985d32f16e90/users/3ab22d357fa448a0aff385cfeb9a0aca/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:13.982486 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8682aa0b-cbce-4251-92cd-f399b44d93d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8531497ecc14421a86bb985d32f16e90, user_id=3ab22d357fa448a0aff385cfeb9a0aca, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:13.984017 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8682aa0b-cbce-4251-92cd-f399b44d93d5 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:13.997685 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1040/2075] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:19:13 2022] PUT /identity/v3/projects/8531497ecc14421a86bb985d32f16e90/users/3ab22d357fa448a0aff385cfeb9a0aca/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:19:14.009321 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b018c-2eaf-4933-af92-8c5c168d0a93 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:14.009627 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b018c-2eaf-4933-af92-8c5c168d0a93 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:14.009899 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87b018c-2eaf-4933-af92-8c5c168d0a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:14.058477 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-d87b018c-2eaf-4933-af92-8c5c168d0a93 None None] MFA Rules not processed for user `3ab22d357fa448a0aff385cfeb9a0aca`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:19:14.060161 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-d87b018c-2eaf-4933-af92-8c5c168d0a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:14.138660 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1036/2076] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:19:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:19:14.143144 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8682aa0b-cbce-4251-92cd-f399b44d93d5 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:14.210840 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8682aa0b-cbce-4251-92cd-f399b44d93d5 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:14.216011 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71ba948-410c-4511-b466-e3505c6adeef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:14.216583 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ba948-410c-4511-b466-e3505c6adeef admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:14.218422 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ba948-410c-4511-b466-e3505c6adeef admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:14.218422 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ba948-410c-4511-b466-e3505c6adeef admin admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:14.218422 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71ba948-410c-4511-b466-e3505c6adeef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:14.219993 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71ba948-410c-4511-b466-e3505c6adeef admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:14.247304 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1041/2077] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:19:14 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:19:14.251162 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87b018c-2eaf-4933-af92-8c5c168d0a93 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:14.262434 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87b018c-2eaf-4933-af92-8c5c168d0a93 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:14.318242 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd9ade-263a-41a1-9fc7-6ca07668f120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:14.318903 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd9ade-263a-41a1-9fc7-6ca07668f120 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:14.319197 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd9ade-263a-41a1-9fc7-6ca07668f120 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:14.319447 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd9ade-263a-41a1-9fc7-6ca07668f120 admin admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:14.320688 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd9ade-263a-41a1-9fc7-6ca07668f120 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:14.322627 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd9ade-263a-41a1-9fc7-6ca07668f120 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:14.342716 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1037/2078] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:19:14 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:19:14.346758 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71ba948-410c-4511-b466-e3505c6adeef admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:14.356747 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71ba948-410c-4511-b466-e3505c6adeef admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:14.361378 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48581d-af23-40b6-b303-7fda84a680f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:14.362051 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48581d-af23-40b6-b303-7fda84a680f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:14.362324 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48581d-af23-40b6-b303-7fda84a680f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:14.362594 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da48581d-af23-40b6-b303-7fda84a680f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:14.363307 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da48581d-af23-40b6-b303-7fda84a680f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:14.364882 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da48581d-af23-40b6-b303-7fda84a680f9 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:14.375943 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1042/2079] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:19:14.380141 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd9ade-263a-41a1-9fc7-6ca07668f120 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:14.390524 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd9ade-263a-41a1-9fc7-6ca07668f120 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:14.395287 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e7c24f-fef3-4c46-aadd-182ed885d781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:14.396171 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e7c24f-fef3-4c46-aadd-182ed885d781 admin admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:14.396465 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e7c24f-fef3-4c46-aadd-182ed885d781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:14.396758 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e7c24f-fef3-4c46-aadd-182ed885d781 admin admin] PATH_INFO: `/v3/projects/f2ef656783fc41f6862c9d5b570ec78a/users/d85db642b9014292a28bf44ecdb64775/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:14.410672 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e7c24f-fef3-4c46-aadd-182ed885d781 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2ef656783fc41f6862c9d5b570ec78a, user_id=d85db642b9014292a28bf44ecdb64775, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:14.413290 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e7c24f-fef3-4c46-aadd-182ed885d781 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:14.426289 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1038/2080] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:19:14 2022] PUT /identity/v3/projects/f2ef656783fc41f6862c9d5b570ec78a/users/d85db642b9014292a28bf44ecdb64775/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:19:14.430767 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48581d-af23-40b6-b303-7fda84a680f9 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:14.440369 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da48581d-af23-40b6-b303-7fda84a680f9 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:14.494685 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d630f572-2ee8-45fe-8bf3-3fdae5eb8e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:14.495338 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630f572-2ee8-45fe-8bf3-3fdae5eb8e49 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:14.495616 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630f572-2ee8-45fe-8bf3-3fdae5eb8e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:14.495886 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630f572-2ee8-45fe-8bf3-3fdae5eb8e49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:14.496594 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d630f572-2ee8-45fe-8bf3-3fdae5eb8e49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:14.498287 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d630f572-2ee8-45fe-8bf3-3fdae5eb8e49 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:14.509009 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1043/2081] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:19:14.513225 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e7c24f-fef3-4c46-aadd-182ed885d781 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:14.523108 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e7c24f-fef3-4c46-aadd-182ed885d781 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:14.527765 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65592ed9-26d9-49c3-9e68-e535a2eeef35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:14.528636 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65592ed9-26d9-49c3-9e68-e535a2eeef35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:14.528910 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65592ed9-26d9-49c3-9e68-e535a2eeef35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:14.529174 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65592ed9-26d9-49c3-9e68-e535a2eeef35 admin admin] PATH_INFO: `/v3/projects/f2ef656783fc41f6862c9d5b570ec78a/users/d85db642b9014292a28bf44ecdb64775/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:14.531143 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65592ed9-26d9-49c3-9e68-e535a2eeef35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2ef656783fc41f6862c9d5b570ec78a, user_id=d85db642b9014292a28bf44ecdb64775, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:14.533783 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65592ed9-26d9-49c3-9e68-e535a2eeef35 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:14.546099 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1039/2082] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:19:14 2022] PUT /identity/v3/projects/f2ef656783fc41f6862c9d5b570ec78a/users/d85db642b9014292a28bf44ecdb64775/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:19:14.558572 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de59c8-6b88-4423-bfd7-180bbee83c50 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:14.558861 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de59c8-6b88-4423-bfd7-180bbee83c50 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:14.559141 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de59c8-6b88-4423-bfd7-180bbee83c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:14.586014 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-d9de59c8-6b88-4423-bfd7-180bbee83c50 None None] MFA Rules not processed for user `d85db642b9014292a28bf44ecdb64775`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:19:14.587207 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-d9de59c8-6b88-4423-bfd7-180bbee83c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:14.651161 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1044/2083] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:19:14 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:19:14.662339 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65592ed9-26d9-49c3-9e68-e535a2eeef35 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:14.664511 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-65592ed9-26d9-49c3-9e68-e535a2eeef35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:14.719749 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65592ed9-26d9-49c3-9e68-e535a2eeef35 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:14.723458 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1228d9ee-0003-4174-8d88-89e2e56ca804 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:14.724084 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228d9ee-0003-4174-8d88-89e2e56ca804 service cinder] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:14.724363 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228d9ee-0003-4174-8d88-89e2e56ca804 service cinder] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:14.724635 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228d9ee-0003-4174-8d88-89e2e56ca804 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:14.733377 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1228d9ee-0003-4174-8d88-89e2e56ca804 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:14.734834 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1228d9ee-0003-4174-8d88-89e2e56ca804 service cinder] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:14.744454 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1040/2084] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:19:14 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:19:15.101967 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de59c8-6b88-4423-bfd7-180bbee83c50 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:15.162631 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de59c8-6b88-4423-bfd7-180bbee83c50 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:15.167562 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ac4f45-8d8d-4b8e-ba68-fd50d4661703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:15.168412 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac4f45-8d8d-4b8e-ba68-fd50d4661703 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:15.168685 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac4f45-8d8d-4b8e-ba68-fd50d4661703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:15.168951 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ac4f45-8d8d-4b8e-ba68-fd50d4661703 admin admin] PATH_INFO: `/v3/users/3ab22d357fa448a0aff385cfeb9a0aca` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:15.170131 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ac4f45-8d8d-4b8e-ba68-fd50d4661703 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ab22d357fa448a0aff385cfeb9a0aca)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:15.172055 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ac4f45-8d8d-4b8e-ba68-fd50d4661703 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:15.216292 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-a9ac4f45-8d8d-4b8e-ba68-fd50d4661703 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ab22d357fa448a0aff385cfeb9a0aca'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:15.223710 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-a9ac4f45-8d8d-4b8e-ba68-fd50d4661703 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ab22d357fa448a0aff385cfeb9a0aca'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:15.224384 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-a9ac4f45-8d8d-4b8e-ba68-fd50d4661703 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ab22d357fa448a0aff385cfeb9a0aca'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:15.232193 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-a9ac4f45-8d8d-4b8e-ba68-fd50d4661703 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ab22d357fa448a0aff385cfeb9a0aca'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:15.232826 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-a9ac4f45-8d8d-4b8e-ba68-fd50d4661703 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ab22d357fa448a0aff385cfeb9a0aca'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:15.253203 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1045/2085] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:19:15 2022] DELETE /identity/v3/users/3ab22d357fa448a0aff385cfeb9a0aca => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:19:15.255074 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd822b39-507a-429d-928b-1a31aa8d1cc4 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:15.255423 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd822b39-507a-429d-928b-1a31aa8d1cc4 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:15.255765 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd822b39-507a-429d-928b-1a31aa8d1cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:15.274299 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-bd822b39-507a-429d-928b-1a31aa8d1cc4 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:19:15.275520 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-bd822b39-507a-429d-928b-1a31aa8d1cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:15.335856 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1041/2086] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:19:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:19:15.345645 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ac4f45-8d8d-4b8e-ba68-fd50d4661703 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:15.347031 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-a9ac4f45-8d8d-4b8e-ba68-fd50d4661703 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:15.403563 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ac4f45-8d8d-4b8e-ba68-fd50d4661703 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:15.407665 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08602c8-8e93-4f00-b750-9a260f972aea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:15.408238 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08602c8-8e93-4f00-b750-9a260f972aea service neutron] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:15.408699 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08602c8-8e93-4f00-b750-9a260f972aea service neutron] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:15.408807 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08602c8-8e93-4f00-b750-9a260f972aea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:15.419455 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08602c8-8e93-4f00-b750-9a260f972aea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:15.421197 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08602c8-8e93-4f00-b750-9a260f972aea service neutron] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:15.431965 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1046/2087] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:19:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:19:15.693634 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd822b39-507a-429d-928b-1a31aa8d1cc4 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:15.695144 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-bd822b39-507a-429d-928b-1a31aa8d1cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:15.708887 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd822b39-507a-429d-928b-1a31aa8d1cc4 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:15.715207 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd8c12-0dea-4666-bd90-2c78068a674e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:15.716405 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd8c12-0dea-4666-bd90-2c78068a674e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:15.716685 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd8c12-0dea-4666-bd90-2c78068a674e admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:15.716951 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd8c12-0dea-4666-bd90-2c78068a674e admin admin] PATH_INFO: `/v3/projects/8531497ecc14421a86bb985d32f16e90` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:15.718183 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdd8c12-0dea-4666-bd90-2c78068a674e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8531497ecc14421a86bb985d32f16e90)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:15.720059 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdd8c12-0dea-4666-bd90-2c78068a674e admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:15.765287 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-ffdd8c12-0dea-4666-bd90-2c78068a674e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8531497ecc14421a86bb985d32f16e90', 'request_id': 'req-ffdd8c12-0dea-4666-bd90-2c78068a674e'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:15.771180 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-ffdd8c12-0dea-4666-bd90-2c78068a674e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8531497ecc14421a86bb985d32f16e90', 'request_id': 'req-ffdd8c12-0dea-4666-bd90-2c78068a674e'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:15.778436 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-ffdd8c12-0dea-4666-bd90-2c78068a674e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8531497ecc14421a86bb985d32f16e90', 'request_id': 'req-ffdd8c12-0dea-4666-bd90-2c78068a674e'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:15.788267 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-ffdd8c12-0dea-4666-bd90-2c78068a674e admin admin] The token cache is being invalidate because project 8531497ecc14421a86bb985d32f16e90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:19:15.789096 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-ffdd8c12-0dea-4666-bd90-2c78068a674e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:15.789741 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-ffdd8c12-0dea-4666-bd90-2c78068a674e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:15.791358 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1042/2088] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:19:15 2022] DELETE /identity/v3/projects/8531497ecc14421a86bb985d32f16e90 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:19:15.795475 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08602c8-8e93-4f00-b750-9a260f972aea service neutron] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:15.804740 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08602c8-8e93-4f00-b750-9a260f972aea service neutron] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:15.858967 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c905c-aeca-4a14-b94e-afe5debaf4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:15.859852 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c905c-aeca-4a14-b94e-afe5debaf4b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:15.860127 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c905c-aeca-4a14-b94e-afe5debaf4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:15.860395 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c905c-aeca-4a14-b94e-afe5debaf4b4 admin admin] PATH_INFO: `/v3/users/d85db642b9014292a28bf44ecdb64775` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:15.861589 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c905c-aeca-4a14-b94e-afe5debaf4b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d85db642b9014292a28bf44ecdb64775)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:15.863486 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c905c-aeca-4a14-b94e-afe5debaf4b4 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:15.906582 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-cc5c905c-aeca-4a14-b94e-afe5debaf4b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd85db642b9014292a28bf44ecdb64775'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:15.913225 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-cc5c905c-aeca-4a14-b94e-afe5debaf4b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd85db642b9014292a28bf44ecdb64775'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:15.913882 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-cc5c905c-aeca-4a14-b94e-afe5debaf4b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd85db642b9014292a28bf44ecdb64775'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:15.920659 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-cc5c905c-aeca-4a14-b94e-afe5debaf4b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd85db642b9014292a28bf44ecdb64775'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:15.921259 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-cc5c905c-aeca-4a14-b94e-afe5debaf4b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd85db642b9014292a28bf44ecdb64775'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:15.937733 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1047/2089] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:19:15 2022] DELETE /identity/v3/users/d85db642b9014292a28bf44ecdb64775 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:19:16.193131 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd8c12-0dea-4666-bd90-2c78068a674e admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:16.195157 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-ffdd8c12-0dea-4666-bd90-2c78068a674e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:16.208126 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd8c12-0dea-4666-bd90-2c78068a674e admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:16.263897 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6128f92-ecdd-4e1c-badb-227f74048578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:16.264752 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6128f92-ecdd-4e1c-badb-227f74048578 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:16.265030 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6128f92-ecdd-4e1c-badb-227f74048578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:16.265293 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6128f92-ecdd-4e1c-badb-227f74048578 admin admin] PATH_INFO: `/v3/projects/f2ef656783fc41f6862c9d5b570ec78a` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:16.266518 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6128f92-ecdd-4e1c-badb-227f74048578 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2ef656783fc41f6862c9d5b570ec78a)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:16.268415 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6128f92-ecdd-4e1c-badb-227f74048578 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:16.311878 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-d6128f92-ecdd-4e1c-badb-227f74048578 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2ef656783fc41f6862c9d5b570ec78a', 'request_id': 'req-d6128f92-ecdd-4e1c-badb-227f74048578'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:16.317680 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-d6128f92-ecdd-4e1c-badb-227f74048578 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2ef656783fc41f6862c9d5b570ec78a', 'request_id': 'req-d6128f92-ecdd-4e1c-badb-227f74048578'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:16.325603 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-d6128f92-ecdd-4e1c-badb-227f74048578 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2ef656783fc41f6862c9d5b570ec78a', 'request_id': 'req-d6128f92-ecdd-4e1c-badb-227f74048578'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:16.335325 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-d6128f92-ecdd-4e1c-badb-227f74048578 admin admin] The token cache is being invalidate because project f2ef656783fc41f6862c9d5b570ec78a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:19:16.335603 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-d6128f92-ecdd-4e1c-badb-227f74048578 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:16.336210 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-d6128f92-ecdd-4e1c-badb-227f74048578 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:16.337764 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1043/2090] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:19:16 2022] DELETE /identity/v3/projects/f2ef656783fc41f6862c9d5b570ec78a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:19:16.342852 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ac813-b233-4583-8fa4-3bd9cc7cc0c5 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:16.343139 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ac813-b233-4583-8fa4-3bd9cc7cc0c5 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:16.343430 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ac813-b233-4583-8fa4-3bd9cc7cc0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:16.361018 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-b96ac813-b233-4583-8fa4-3bd9cc7cc0c5 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:19:16.362256 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-b96ac813-b233-4583-8fa4-3bd9cc7cc0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:16.419141 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1048/2091] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:19:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:19:16.427075 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3188cdc-8da8-46a0-9ca6-b80219eacc93 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:16.427574 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3188cdc-8da8-46a0-9ca6-b80219eacc93 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:16.428031 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3188cdc-8da8-46a0-9ca6-b80219eacc93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:16.448999 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-c3188cdc-8da8-46a0-9ca6-b80219eacc93 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:19:16.450528 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-c3188cdc-8da8-46a0-9ca6-b80219eacc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:16.462586 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1044/2092] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:19:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:19:16.463491 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ac813-b233-4583-8fa4-3bd9cc7cc0c5 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:16.478316 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ac813-b233-4583-8fa4-3bd9cc7cc0c5 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:16.483764 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678c5ba-7e6d-4e9e-9a43-a2effccc6602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:16.484423 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678c5ba-7e6d-4e9e-9a43-a2effccc6602 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:16.484701 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678c5ba-7e6d-4e9e-9a43-a2effccc6602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:16.485064 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9678c5ba-7e6d-4e9e-9a43-a2effccc6602 admin admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:16.485818 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9678c5ba-7e6d-4e9e-9a43-a2effccc6602 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:19:16.486145 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9678c5ba-7e6d-4e9e-9a43-a2effccc6602 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:16.487727 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9678c5ba-7e6d-4e9e-9a43-a2effccc6602 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:16.505677 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1049/2093] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 17 18:19:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:19:16.508972 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3188cdc-8da8-46a0-9ca6-b80219eacc93 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:16.518758 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3188cdc-8da8-46a0-9ca6-b80219eacc93 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:16.524509 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b8c343-dac9-40f2-8ee9-6f6fa3e8d9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:16.525676 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8c343-dac9-40f2-8ee9-6f6fa3e8d9bc admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:16.525905 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8c343-dac9-40f2-8ee9-6f6fa3e8d9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:16.527092 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8c343-dac9-40f2-8ee9-6f6fa3e8d9bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:16.527952 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b8c343-dac9-40f2-8ee9-6f6fa3e8d9bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:16.530305 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b8c343-dac9-40f2-8ee9-6f6fa3e8d9bc admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:16.562349 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1045/2094] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:19:16 2022] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:19:16.566638 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678c5ba-7e6d-4e9e-9a43-a2effccc6602 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:16.578151 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9678c5ba-7e6d-4e9e-9a43-a2effccc6602 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:16.687447 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa71408-57c2-4ff6-a9aa-19e27eec8c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:16.688408 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa71408-57c2-4ff6-a9aa-19e27eec8c0a admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:16.688755 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa71408-57c2-4ff6-a9aa-19e27eec8c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:16.689096 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa71408-57c2-4ff6-a9aa-19e27eec8c0a admin admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:16.689911 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa71408-57c2-4ff6-a9aa-19e27eec8c0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:16.692777 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa71408-57c2-4ff6-a9aa-19e27eec8c0a admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:16.728253 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1050/2095] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:19:16 2022] POST /identity/v3/users => generated 290 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:19:16.732904 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b8c343-dac9-40f2-8ee9-6f6fa3e8d9bc admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:16.745009 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b8c343-dac9-40f2-8ee9-6f6fa3e8d9bc admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:16.749964 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b98cd-beda-4716-b5d0-b1eea5c51666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:16.750620 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b98cd-beda-4716-b5d0-b1eea5c51666 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:16.750895 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b98cd-beda-4716-b5d0-b1eea5c51666 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:16.751166 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b98cd-beda-4716-b5d0-b1eea5c51666 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:16.751888 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895b98cd-beda-4716-b5d0-b1eea5c51666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:16.753688 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895b98cd-beda-4716-b5d0-b1eea5c51666 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:16.767992 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1046/2096] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:19:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:19:16.769208 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa71408-57c2-4ff6-a9aa-19e27eec8c0a admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:16.784843 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa71408-57c2-4ff6-a9aa-19e27eec8c0a admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:16.790240 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b46f395-63cd-4756-aaf7-326a4440da49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:16.790908 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46f395-63cd-4756-aaf7-326a4440da49 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:16.791188 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46f395-63cd-4756-aaf7-326a4440da49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:16.791461 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b46f395-63cd-4756-aaf7-326a4440da49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:16.792671 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b46f395-63cd-4756-aaf7-326a4440da49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:16.793967 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b46f395-63cd-4756-aaf7-326a4440da49 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:16.806319 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1051/2097] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:19:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:19:16.810149 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b98cd-beda-4716-b5d0-b1eea5c51666 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:16.820541 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b98cd-beda-4716-b5d0-b1eea5c51666 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:16.827816 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda9bb7-893c-4ccb-8dd0-800f7d353dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:16.829529 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda9bb7-893c-4ccb-8dd0-800f7d353dd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:16.830253 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda9bb7-893c-4ccb-8dd0-800f7d353dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:16.830697 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda9bb7-893c-4ccb-8dd0-800f7d353dd0 admin admin] PATH_INFO: `/v3/projects/c36f68d1845a485b9577462e8cc45dd7/users/f1751b96bd8e4fc59a0861771aa14b60/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:16.852752 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda9bb7-893c-4ccb-8dd0-800f7d353dd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c36f68d1845a485b9577462e8cc45dd7, user_id=f1751b96bd8e4fc59a0861771aa14b60, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:16.855482 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda9bb7-893c-4ccb-8dd0-800f7d353dd0 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:16.869242 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1047/2098] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:19:16 2022] PUT /identity/v3/projects/c36f68d1845a485b9577462e8cc45dd7/users/f1751b96bd8e4fc59a0861771aa14b60/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:19:16.879603 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b147c9c-d7b5-4963-8f27-6cc15eb37ad8 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:16.879890 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b147c9c-d7b5-4963-8f27-6cc15eb37ad8 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:16.880166 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b147c9c-d7b5-4963-8f27-6cc15eb37ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:16.908679 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-7b147c9c-d7b5-4963-8f27-6cc15eb37ad8 None None] MFA Rules not processed for user `f1751b96bd8e4fc59a0861771aa14b60`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:19:16.909939 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-7b147c9c-d7b5-4963-8f27-6cc15eb37ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:16.983896 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1052/2099] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:19:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:19:16.988503 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda9bb7-893c-4ccb-8dd0-800f7d353dd0 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:17.061043 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda9bb7-893c-4ccb-8dd0-800f7d353dd0 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:17.066517 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b881d3-0165-495d-a5de-9a8d66eb0a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:17.067179 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b881d3-0165-495d-a5de-9a8d66eb0a95 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:17.067509 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b881d3-0165-495d-a5de-9a8d66eb0a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:17.067778 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b881d3-0165-495d-a5de-9a8d66eb0a95 admin admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:17.068482 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b881d3-0165-495d-a5de-9a8d66eb0a95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:17.070717 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b881d3-0165-495d-a5de-9a8d66eb0a95 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:17.101475 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1048/2100] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:19:16 2022] POST /identity/v3/projects => generated 381 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:19:17.106020 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b147c9c-d7b5-4963-8f27-6cc15eb37ad8 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:17.117138 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b147c9c-d7b5-4963-8f27-6cc15eb37ad8 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:17.175349 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c17cb-85fb-4536-84c3-e6b388fb1b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:17.176008 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c17cb-85fb-4536-84c3-e6b388fb1b75 admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:17.176284 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c17cb-85fb-4536-84c3-e6b388fb1b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:17.176553 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c17cb-85fb-4536-84c3-e6b388fb1b75 admin admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:17.177288 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542c17cb-85fb-4536-84c3-e6b388fb1b75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:17.179492 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542c17cb-85fb-4536-84c3-e6b388fb1b75 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:17.202864 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1053/2101] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:19:17 2022] POST /identity/v3/users => generated 297 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:19:17.204081 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b881d3-0165-495d-a5de-9a8d66eb0a95 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:17.217601 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b881d3-0165-495d-a5de-9a8d66eb0a95 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:17.232088 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb848680-cda8-413d-8d8e-4d9d1d13367c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:17.232785 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb848680-cda8-413d-8d8e-4d9d1d13367c admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:17.233186 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb848680-cda8-413d-8d8e-4d9d1d13367c admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:17.233494 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb848680-cda8-413d-8d8e-4d9d1d13367c admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:17.234256 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb848680-cda8-413d-8d8e-4d9d1d13367c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:17.236226 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb848680-cda8-413d-8d8e-4d9d1d13367c admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:17.256938 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1049/2102] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:19:17.261380 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c17cb-85fb-4536-84c3-e6b388fb1b75 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:17.271861 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c17cb-85fb-4536-84c3-e6b388fb1b75 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:17.278428 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad31355-8b36-45ea-bc1a-a8cbfcb2f24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:17.279336 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad31355-8b36-45ea-bc1a-a8cbfcb2f24d admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:17.279650 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad31355-8b36-45ea-bc1a-a8cbfcb2f24d admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:17.279880 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad31355-8b36-45ea-bc1a-a8cbfcb2f24d admin admin] PATH_INFO: `/v3/projects/b8cd55108ac94572b91273c3ba50261a/users/030de9f6f59a46a8b8bb371f28955b36/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:17.295762 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad31355-8b36-45ea-bc1a-a8cbfcb2f24d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8cd55108ac94572b91273c3ba50261a, user_id=030de9f6f59a46a8b8bb371f28955b36, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:17.298661 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad31355-8b36-45ea-bc1a-a8cbfcb2f24d admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:17.315138 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1054/2103] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:19:17 2022] PUT /identity/v3/projects/b8cd55108ac94572b91273c3ba50261a/users/030de9f6f59a46a8b8bb371f28955b36/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:19:17.323088 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb848680-cda8-413d-8d8e-4d9d1d13367c admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:17.333425 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb848680-cda8-413d-8d8e-4d9d1d13367c admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:17.396110 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbeebef-4219-413a-8a44-704476ba2615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:17.396777 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbeebef-4219-413a-8a44-704476ba2615 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:17.397053 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbeebef-4219-413a-8a44-704476ba2615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:17.397318 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbeebef-4219-413a-8a44-704476ba2615 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:17.398658 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbeebef-4219-413a-8a44-704476ba2615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:17.400297 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbeebef-4219-413a-8a44-704476ba2615 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:17.409969 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1050/2104] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:19:17.414151 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad31355-8b36-45ea-bc1a-a8cbfcb2f24d admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:17.424279 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad31355-8b36-45ea-bc1a-a8cbfcb2f24d admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:17.428954 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae6e5c-663b-4763-95c2-1367ee5fef8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:17.429927 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae6e5c-663b-4763-95c2-1367ee5fef8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:17.430286 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae6e5c-663b-4763-95c2-1367ee5fef8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:17.430629 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae6e5c-663b-4763-95c2-1367ee5fef8d admin admin] PATH_INFO: `/v3/projects/b8cd55108ac94572b91273c3ba50261a/users/030de9f6f59a46a8b8bb371f28955b36/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:17.432682 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ae6e5c-663b-4763-95c2-1367ee5fef8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8cd55108ac94572b91273c3ba50261a, user_id=030de9f6f59a46a8b8bb371f28955b36, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:17.435398 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ae6e5c-663b-4763-95c2-1367ee5fef8d admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:17.450277 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1055/2105] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:19:17 2022] PUT /identity/v3/projects/b8cd55108ac94572b91273c3ba50261a/users/030de9f6f59a46a8b8bb371f28955b36/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:19:17.462172 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8952ef-d26a-486d-b163-427329689aa8 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:17.462467 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8952ef-d26a-486d-b163-427329689aa8 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:17.462770 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8952ef-d26a-486d-b163-427329689aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:17.490459 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-fd8952ef-d26a-486d-b163-427329689aa8 None None] MFA Rules not processed for user `030de9f6f59a46a8b8bb371f28955b36`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:19:17.491701 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-fd8952ef-d26a-486d-b163-427329689aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:17.568733 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1051/2106] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:19:17 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:19:17.581707 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae6e5c-663b-4763-95c2-1367ee5fef8d admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:17.586703 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-47ae6e5c-663b-4763-95c2-1367ee5fef8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:17.644009 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae6e5c-663b-4763-95c2-1367ee5fef8d admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:17.647581 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f031c3f-a48f-474f-abc9-961d5595f383 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:17.648847 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f031c3f-a48f-474f-abc9-961d5595f383 service cinder] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:17.649121 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f031c3f-a48f-474f-abc9-961d5595f383 service cinder] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:17.649390 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f031c3f-a48f-474f-abc9-961d5595f383 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:17.659249 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f031c3f-a48f-474f-abc9-961d5595f383 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:17.660749 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f031c3f-a48f-474f-abc9-961d5595f383 service cinder] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:17.671888 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1056/2107] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:19:17 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:19:18.112817 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8952ef-d26a-486d-b163-427329689aa8 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:18.122562 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8952ef-d26a-486d-b163-427329689aa8 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:18.127469 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c874fb0a-7908-4556-a60b-45d50eb3c092 tempest-VolumeQuotaClassesTest-1254237514 tempest-VolumeQuotaClassesTest-1254237514-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030de9f6f59a46a8b8bb371f28955b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8cd55108ac94572b91273c3ba50261a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:18.128460 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874fb0a-7908-4556-a60b-45d50eb3c092 tempest-VolumeQuotaClassesTest-1254237514 tempest-VolumeQuotaClassesTest-1254237514-project-admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:18.128911 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874fb0a-7908-4556-a60b-45d50eb3c092 tempest-VolumeQuotaClassesTest-1254237514 tempest-VolumeQuotaClassesTest-1254237514-project-admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:18.129447 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c874fb0a-7908-4556-a60b-45d50eb3c092 tempest-VolumeQuotaClassesTest-1254237514 tempest-VolumeQuotaClassesTest-1254237514-project-admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:18.130198 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c874fb0a-7908-4556-a60b-45d50eb3c092 tempest-VolumeQuotaClassesTest-1254237514 tempest-VolumeQuotaClassesTest-1254237514-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:19:18.130653 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c874fb0a-7908-4556-a60b-45d50eb3c092 tempest-VolumeQuotaClassesTest-1254237514 tempest-VolumeQuotaClassesTest-1254237514-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:18.133548 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c874fb0a-7908-4556-a60b-45d50eb3c092 tempest-VolumeQuotaClassesTest-1254237514 tempest-VolumeQuotaClassesTest-1254237514-project-admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:18.149355 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1052/2108] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 17 18:19:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:19:18.150612 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f031c3f-a48f-474f-abc9-961d5595f383 service cinder] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:18.160605 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f031c3f-a48f-474f-abc9-961d5595f383 service cinder] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:18.166072 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52b6fd-28fd-4282-ba0e-8215c23a228e tempest-VolumeQuotaClassesTest-1254237514 tempest-VolumeQuotaClassesTest-1254237514-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030de9f6f59a46a8b8bb371f28955b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8cd55108ac94572b91273c3ba50261a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:18.166965 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52b6fd-28fd-4282-ba0e-8215c23a228e tempest-VolumeQuotaClassesTest-1254237514 tempest-VolumeQuotaClassesTest-1254237514-project-admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:18.167405 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52b6fd-28fd-4282-ba0e-8215c23a228e tempest-VolumeQuotaClassesTest-1254237514 tempest-VolumeQuotaClassesTest-1254237514-project-admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:18.167675 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b52b6fd-28fd-4282-ba0e-8215c23a228e tempest-VolumeQuotaClassesTest-1254237514 tempest-VolumeQuotaClassesTest-1254237514-project-admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:18.168657 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b52b6fd-28fd-4282-ba0e-8215c23a228e tempest-VolumeQuotaClassesTest-1254237514 tempest-VolumeQuotaClassesTest-1254237514-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:18.170622 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b52b6fd-28fd-4282-ba0e-8215c23a228e tempest-VolumeQuotaClassesTest-1254237514 tempest-VolumeQuotaClassesTest-1254237514-project-admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:18.201276 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1057/2109] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:19:18 2022] POST /identity/v3/projects => generated 352 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:19:18.206706 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c874fb0a-7908-4556-a60b-45d50eb3c092 tempest-VolumeQuotaClassesTest-1254237514 tempest-VolumeQuotaClassesTest-1254237514-project-admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:18.221508 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c874fb0a-7908-4556-a60b-45d50eb3c092 tempest-VolumeQuotaClassesTest-1254237514 tempest-VolumeQuotaClassesTest-1254237514-project-admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:18.279866 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d844f578-9f49-4908-9cce-20ede99fa89d tempest-VolumeQuotaClassesTest-1254237514 tempest-VolumeQuotaClassesTest-1254237514-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030de9f6f59a46a8b8bb371f28955b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8cd55108ac94572b91273c3ba50261a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:18.280656 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d844f578-9f49-4908-9cce-20ede99fa89d tempest-VolumeQuotaClassesTest-1254237514 tempest-VolumeQuotaClassesTest-1254237514-project-admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:18.280941 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d844f578-9f49-4908-9cce-20ede99fa89d tempest-VolumeQuotaClassesTest-1254237514 tempest-VolumeQuotaClassesTest-1254237514-project-admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:18.281213 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d844f578-9f49-4908-9cce-20ede99fa89d tempest-VolumeQuotaClassesTest-1254237514 tempest-VolumeQuotaClassesTest-1254237514-project-admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:18.282033 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d844f578-9f49-4908-9cce-20ede99fa89d tempest-VolumeQuotaClassesTest-1254237514 tempest-VolumeQuotaClassesTest-1254237514-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:19:18.282337 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d844f578-9f49-4908-9cce-20ede99fa89d tempest-VolumeQuotaClassesTest-1254237514 tempest-VolumeQuotaClassesTest-1254237514-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:18.283928 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d844f578-9f49-4908-9cce-20ede99fa89d tempest-VolumeQuotaClassesTest-1254237514 tempest-VolumeQuotaClassesTest-1254237514-project-admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:18.296876 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1053/2110] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 17 18:19:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:19:18.337206 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52b6fd-28fd-4282-ba0e-8215c23a228e tempest-VolumeQuotaClassesTest-1254237514 tempest-VolumeQuotaClassesTest-1254237514-project-admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:18.349714 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b52b6fd-28fd-4282-ba0e-8215c23a228e tempest-VolumeQuotaClassesTest-1254237514 tempest-VolumeQuotaClassesTest-1254237514-project-admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:18.356368 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13a1bf-2493-4ae4-80ce-478d6533e3e7 tempest-VolumeQuotaClassesTest-1254237514 tempest-VolumeQuotaClassesTest-1254237514-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '030de9f6f59a46a8b8bb371f28955b36', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b8cd55108ac94572b91273c3ba50261a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:18.357229 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13a1bf-2493-4ae4-80ce-478d6533e3e7 tempest-VolumeQuotaClassesTest-1254237514 tempest-VolumeQuotaClassesTest-1254237514-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:18.357531 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13a1bf-2493-4ae4-80ce-478d6533e3e7 tempest-VolumeQuotaClassesTest-1254237514 tempest-VolumeQuotaClassesTest-1254237514-project-admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:18.357810 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea13a1bf-2493-4ae4-80ce-478d6533e3e7 tempest-VolumeQuotaClassesTest-1254237514 tempest-VolumeQuotaClassesTest-1254237514-project-admin] PATH_INFO: `/v3/projects/e7a40fd3fa974a4db316c9da2cd42c21` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:18.359016 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea13a1bf-2493-4ae4-80ce-478d6533e3e7 tempest-VolumeQuotaClassesTest-1254237514 tempest-VolumeQuotaClassesTest-1254237514-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e7a40fd3fa974a4db316c9da2cd42c21)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:18.367918 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea13a1bf-2493-4ae4-80ce-478d6533e3e7 tempest-VolumeQuotaClassesTest-1254237514 tempest-VolumeQuotaClassesTest-1254237514-project-admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:18.423355 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-ea13a1bf-2493-4ae4-80ce-478d6533e3e7 tempest-VolumeQuotaClassesTest-1254237514 tempest-VolumeQuotaClassesTest-1254237514-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7a40fd3fa974a4db316c9da2cd42c21', 'request_id': 'req-ea13a1bf-2493-4ae4-80ce-478d6533e3e7'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:18.430255 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-ea13a1bf-2493-4ae4-80ce-478d6533e3e7 tempest-VolumeQuotaClassesTest-1254237514 tempest-VolumeQuotaClassesTest-1254237514-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7a40fd3fa974a4db316c9da2cd42c21', 'request_id': 'req-ea13a1bf-2493-4ae4-80ce-478d6533e3e7'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:18.440543 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-ea13a1bf-2493-4ae4-80ce-478d6533e3e7 tempest-VolumeQuotaClassesTest-1254237514 tempest-VolumeQuotaClassesTest-1254237514-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7a40fd3fa974a4db316c9da2cd42c21', 'request_id': 'req-ea13a1bf-2493-4ae4-80ce-478d6533e3e7'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:18.451051 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-ea13a1bf-2493-4ae4-80ce-478d6533e3e7 tempest-VolumeQuotaClassesTest-1254237514 tempest-VolumeQuotaClassesTest-1254237514-project-admin] The token cache is being invalidate because project e7a40fd3fa974a4db316c9da2cd42c21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:19:18.451361 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-ea13a1bf-2493-4ae4-80ce-478d6533e3e7 tempest-VolumeQuotaClassesTest-1254237514 tempest-VolumeQuotaClassesTest-1254237514-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:18.452017 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-ea13a1bf-2493-4ae4-80ce-478d6533e3e7 tempest-VolumeQuotaClassesTest-1254237514 tempest-VolumeQuotaClassesTest-1254237514-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:18.453636 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1058/2111] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:19:18 2022] DELETE /identity/v3/projects/e7a40fd3fa974a4db316c9da2cd42c21 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:19:18.616193 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d844f578-9f49-4908-9cce-20ede99fa89d tempest-VolumeQuotaClassesTest-1254237514 tempest-VolumeQuotaClassesTest-1254237514-project-admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:18.617984 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-d844f578-9f49-4908-9cce-20ede99fa89d tempest-VolumeQuotaClassesTest-1254237514 tempest-VolumeQuotaClassesTest-1254237514-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:18.651506 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13a1bf-2493-4ae4-80ce-478d6533e3e7 tempest-VolumeQuotaClassesTest-1254237514 tempest-VolumeQuotaClassesTest-1254237514-project-admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:18.652921 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-ea13a1bf-2493-4ae4-80ce-478d6533e3e7 tempest-VolumeQuotaClassesTest-1254237514 tempest-VolumeQuotaClassesTest-1254237514-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:18.685770 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d844f578-9f49-4908-9cce-20ede99fa89d tempest-VolumeQuotaClassesTest-1254237514 tempest-VolumeQuotaClassesTest-1254237514-project-admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:18.723267 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea13a1bf-2493-4ae4-80ce-478d6533e3e7 tempest-VolumeQuotaClassesTest-1254237514 tempest-VolumeQuotaClassesTest-1254237514-project-admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:18.728583 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b5277f-1388-4025-9b4c-c81d5a2cf9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:18.729478 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5277f-1388-4025-9b4c-c81d5a2cf9e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:18.729759 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5277f-1388-4025-9b4c-c81d5a2cf9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:18.730036 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b5277f-1388-4025-9b4c-c81d5a2cf9e3 admin admin] PATH_INFO: `/v3/users/f1751b96bd8e4fc59a0861771aa14b60` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:18.731233 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b5277f-1388-4025-9b4c-c81d5a2cf9e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1751b96bd8e4fc59a0861771aa14b60)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:18.733158 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b5277f-1388-4025-9b4c-c81d5a2cf9e3 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:18.747728 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6123f9c-dec1-4614-b7ec-bcf8e000d1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:18.748699 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6123f9c-dec1-4614-b7ec-bcf8e000d1d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:18.748972 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6123f9c-dec1-4614-b7ec-bcf8e000d1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:18.749252 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6123f9c-dec1-4614-b7ec-bcf8e000d1d6 admin admin] PATH_INFO: `/v3/users/b7b61d7833684321b8e021b687ff8457` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:18.750544 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6123f9c-dec1-4614-b7ec-bcf8e000d1d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7b61d7833684321b8e021b687ff8457)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:18.752477 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6123f9c-dec1-4614-b7ec-bcf8e000d1d6 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:18.781825 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-c3b5277f-1388-4025-9b4c-c81d5a2cf9e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1751b96bd8e4fc59a0861771aa14b60'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:18.789734 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-c3b5277f-1388-4025-9b4c-c81d5a2cf9e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1751b96bd8e4fc59a0861771aa14b60'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:18.790433 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-c3b5277f-1388-4025-9b4c-c81d5a2cf9e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1751b96bd8e4fc59a0861771aa14b60'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:18.798557 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-c3b5277f-1388-4025-9b4c-c81d5a2cf9e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1751b96bd8e4fc59a0861771aa14b60'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:18.800164 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-c3b5277f-1388-4025-9b4c-c81d5a2cf9e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1751b96bd8e4fc59a0861771aa14b60'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:18.808271 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-c6123f9c-dec1-4614-b7ec-bcf8e000d1d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7b61d7833684321b8e021b687ff8457'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:18.818834 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1059/2112] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:19:18 2022] DELETE /identity/v3/users/f1751b96bd8e4fc59a0861771aa14b60 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:19:18.823251 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217a2dd-a38b-4c7e-8e65-30bf4d16d403 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:18.823836 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217a2dd-a38b-4c7e-8e65-30bf4d16d403 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:18.824123 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217a2dd-a38b-4c7e-8e65-30bf4d16d403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:18.838710 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-c6123f9c-dec1-4614-b7ec-bcf8e000d1d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7b61d7833684321b8e021b687ff8457'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:18.839108 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-c6123f9c-dec1-4614-b7ec-bcf8e000d1d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7b61d7833684321b8e021b687ff8457'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:18.840058 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-c6123f9c-dec1-4614-b7ec-bcf8e000d1d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7b61d7833684321b8e021b687ff8457'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:18.851809 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-c6123f9c-dec1-4614-b7ec-bcf8e000d1d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7b61d7833684321b8e021b687ff8457'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:18.854508 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-8217a2dd-a38b-4c7e-8e65-30bf4d16d403 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:19:18.855708 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-8217a2dd-a38b-4c7e-8e65-30bf4d16d403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:18.868684 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1054/2113] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:19:18 2022] DELETE /identity/v3/users/b7b61d7833684321b8e021b687ff8457 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:19:18.873098 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9da59c-ebb9-4c59-b799-a8f6d1ed6bf6 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:18.873383 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9da59c-ebb9-4c59-b799-a8f6d1ed6bf6 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:18.873683 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9da59c-ebb9-4c59-b799-a8f6d1ed6bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:18.892724 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-4c9da59c-ebb9-4c59-b799-a8f6d1ed6bf6 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:19:18.894207 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-4c9da59c-ebb9-4c59-b799-a8f6d1ed6bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:18.930028 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1060/2114] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:19:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:19:18.942928 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217a2dd-a38b-4c7e-8e65-30bf4d16d403 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:18.944330 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-8217a2dd-a38b-4c7e-8e65-30bf4d16d403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:18.965702 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1055/2115] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:19:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:19:18.967149 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe747254-e504-479f-b4f4-1dd0a8e385ca None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:18.967442 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe747254-e504-479f-b4f4-1dd0a8e385ca None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:18.967732 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe747254-e504-479f-b4f4-1dd0a8e385ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:18.988104 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-fe747254-e504-479f-b4f4-1dd0a8e385ca None None] MFA Rules not processed for user `f370e353067848b5843c5650183be347`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:19:18.989308 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-fe747254-e504-479f-b4f4-1dd0a8e385ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:19.005706 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217a2dd-a38b-4c7e-8e65-30bf4d16d403 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:19.042856 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1056/2116] 10.222.0.65 () {58 vars in 1009 bytes} [Tue May 17 18:19:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:19:19.043591 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe747254-e504-479f-b4f4-1dd0a8e385ca None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:19.044893 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-fe747254-e504-479f-b4f4-1dd0a8e385ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:19.054986 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89060ad9-9638-4ecf-b3dd-01b4da25f904 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:19.055666 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89060ad9-9638-4ecf-b3dd-01b4da25f904 service neutron] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:19.055950 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89060ad9-9638-4ecf-b3dd-01b4da25f904 service neutron] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:19.056225 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89060ad9-9638-4ecf-b3dd-01b4da25f904 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:19.070478 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89060ad9-9638-4ecf-b3dd-01b4da25f904 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:19.071937 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89060ad9-9638-4ecf-b3dd-01b4da25f904 service neutron] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:19.082653 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1061/2117] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:19:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:19:19.090687 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89060ad9-9638-4ecf-b3dd-01b4da25f904 service neutron] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:19.092076 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-89060ad9-9638-4ecf-b3dd-01b4da25f904 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:19.106699 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe747254-e504-479f-b4f4-1dd0a8e385ca None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:19.110538 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99bbddf-616c-491c-bad4-d0ac91033c77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:19.111191 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99bbddf-616c-491c-bad4-d0ac91033c77 service neutron] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:19.111470 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99bbddf-616c-491c-bad4-d0ac91033c77 service neutron] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:19.111743 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99bbddf-616c-491c-bad4-d0ac91033c77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:19.123092 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99bbddf-616c-491c-bad4-d0ac91033c77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:19.124925 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99bbddf-616c-491c-bad4-d0ac91033c77 service neutron] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:19.140893 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1057/2118] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:19:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:19:19.174216 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89060ad9-9638-4ecf-b3dd-01b4da25f904 service neutron] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:19.185115 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbddf89-b48f-497e-94a1-15f69661a53b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1464e84a3a2d4321a98b98d398bc7be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:19.185865 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbddf89-b48f-497e-94a1-15f69661a53b service swift] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:19.186293 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbddf89-b48f-497e-94a1-15f69661a53b service swift] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:19.186801 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbddf89-b48f-497e-94a1-15f69661a53b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:19.199586 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbddf89-b48f-497e-94a1-15f69661a53b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:19.201845 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbddf89-b48f-497e-94a1-15f69661a53b service swift] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:19.213278 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1062/2119] 10.222.0.65 () {60 vars in 1384 bytes} [Tue May 17 18:19:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 18:19:19.495735 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99bbddf-616c-491c-bad4-d0ac91033c77 service neutron] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:19.497923 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-b99bbddf-616c-491c-bad4-d0ac91033c77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:19.523983 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99bbddf-616c-491c-bad4-d0ac91033c77 service neutron] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:19.529755 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659de07a-ef18-47a7-8850-e7f4311fd06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:19.531127 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659de07a-ef18-47a7-8850-e7f4311fd06b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:19.531500 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659de07a-ef18-47a7-8850-e7f4311fd06b admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:19.531865 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659de07a-ef18-47a7-8850-e7f4311fd06b admin admin] PATH_INFO: `/v3/projects/c1a1a9d3a34e46e8b407c9f402feb3ce` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:19.533225 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659de07a-ef18-47a7-8850-e7f4311fd06b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1a1a9d3a34e46e8b407c9f402feb3ce)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:19.535578 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659de07a-ef18-47a7-8850-e7f4311fd06b admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:19.565431 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbddf89-b48f-497e-94a1-15f69661a53b service swift] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:19.569156 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-0fbddf89-b48f-497e-94a1-15f69661a53b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:19.596959 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbddf89-b48f-497e-94a1-15f69661a53b service swift] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:19.603034 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08cc70-5553-4ad8-b303-3600d2212048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:19.604250 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08cc70-5553-4ad8-b303-3600d2212048 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:19.604769 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08cc70-5553-4ad8-b303-3600d2212048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:19.605360 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a08cc70-5553-4ad8-b303-3600d2212048 admin admin] PATH_INFO: `/v3/projects/c36f68d1845a485b9577462e8cc45dd7` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:19.608387 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a08cc70-5553-4ad8-b303-3600d2212048 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c36f68d1845a485b9577462e8cc45dd7)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:19.612869 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a08cc70-5553-4ad8-b303-3600d2212048 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:19.620661 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-659de07a-ef18-47a7-8850-e7f4311fd06b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1a1a9d3a34e46e8b407c9f402feb3ce', 'request_id': 'req-659de07a-ef18-47a7-8850-e7f4311fd06b'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:19.629821 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-659de07a-ef18-47a7-8850-e7f4311fd06b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1a1a9d3a34e46e8b407c9f402feb3ce', 'request_id': 'req-659de07a-ef18-47a7-8850-e7f4311fd06b'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:19.651913 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-659de07a-ef18-47a7-8850-e7f4311fd06b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1a1a9d3a34e46e8b407c9f402feb3ce', 'request_id': 'req-659de07a-ef18-47a7-8850-e7f4311fd06b'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:19.664540 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-659de07a-ef18-47a7-8850-e7f4311fd06b admin admin] The token cache is being invalidate because project c1a1a9d3a34e46e8b407c9f402feb3ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:19:19.664870 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-659de07a-ef18-47a7-8850-e7f4311fd06b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:19.665742 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-659de07a-ef18-47a7-8850-e7f4311fd06b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:19.667483 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1058/2120] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:19:19 2022] DELETE /identity/v3/projects/c1a1a9d3a34e46e8b407c9f402feb3ce => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:19:19.674011 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556498a8-20e6-4888-903f-a2113b271661 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:19.674298 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556498a8-20e6-4888-903f-a2113b271661 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:19.674598 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556498a8-20e6-4888-903f-a2113b271661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:19.693356 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-5a08cc70-5553-4ad8-b303-3600d2212048 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c36f68d1845a485b9577462e8cc45dd7', 'request_id': 'req-5a08cc70-5553-4ad8-b303-3600d2212048'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:19.702114 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-5a08cc70-5553-4ad8-b303-3600d2212048 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c36f68d1845a485b9577462e8cc45dd7', 'request_id': 'req-5a08cc70-5553-4ad8-b303-3600d2212048'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:19.713720 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-556498a8-20e6-4888-903f-a2113b271661 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:19:19.715835 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-556498a8-20e6-4888-903f-a2113b271661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:19.724446 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-5a08cc70-5553-4ad8-b303-3600d2212048 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c36f68d1845a485b9577462e8cc45dd7', 'request_id': 'req-5a08cc70-5553-4ad8-b303-3600d2212048'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:19.742592 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-5a08cc70-5553-4ad8-b303-3600d2212048 admin admin] The token cache is being invalidate because project c36f68d1845a485b9577462e8cc45dd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:19:19.742953 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-5a08cc70-5553-4ad8-b303-3600d2212048 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:19.744052 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-5a08cc70-5553-4ad8-b303-3600d2212048 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:19.747112 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1063/2121] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:19:19 2022] DELETE /identity/v3/projects/c36f68d1845a485b9577462e8cc45dd7 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:19:19.751805 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08cc70-5553-4ad8-b303-3600d2212048 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:19.758192 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-5a08cc70-5553-4ad8-b303-3600d2212048 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:19.796039 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1059/2122] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:19:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:19:19.804668 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab4f5d-3fa0-4bd2-af54-7692875462ce None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:19.805739 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab4f5d-3fa0-4bd2-af54-7692875462ce None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:19.806367 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab4f5d-3fa0-4bd2-af54-7692875462ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:19.828756 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-00ab4f5d-3fa0-4bd2-af54-7692875462ce None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:19:19.831164 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-00ab4f5d-3fa0-4bd2-af54-7692875462ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:19.833279 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a08cc70-5553-4ad8-b303-3600d2212048 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:19.839332 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5fdabf-6e19-47b2-aa3a-c48f0fb386d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:19.840210 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5fdabf-6e19-47b2-aa3a-c48f0fb386d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:19.840493 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5fdabf-6e19-47b2-aa3a-c48f0fb386d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:19.840766 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5fdabf-6e19-47b2-aa3a-c48f0fb386d3 admin admin] PATH_INFO: `/v3/users/030de9f6f59a46a8b8bb371f28955b36` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:19.842004 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5fdabf-6e19-47b2-aa3a-c48f0fb386d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=030de9f6f59a46a8b8bb371f28955b36)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:19.843934 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5fdabf-6e19-47b2-aa3a-c48f0fb386d3 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:19.848536 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1060/2123] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:19:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:19:19.853414 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab4f5d-3fa0-4bd2-af54-7692875462ce None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:19.863370 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab4f5d-3fa0-4bd2-af54-7692875462ce None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:19.871850 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a2e62-6e32-41cf-856e-7c263ce8270a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:19.872256 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a2e62-6e32-41cf-856e-7c263ce8270a admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:19.872538 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a2e62-6e32-41cf-856e-7c263ce8270a admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:19.872811 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a2e62-6e32-41cf-856e-7c263ce8270a admin admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:19.873638 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365a2e62-6e32-41cf-856e-7c263ce8270a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:19:19.873949 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365a2e62-6e32-41cf-856e-7c263ce8270a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:19.875646 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365a2e62-6e32-41cf-856e-7c263ce8270a admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:19.888272 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1061/2124] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 17 18:19:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:19:19.893038 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a2e62-6e32-41cf-856e-7c263ce8270a admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:19.903131 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a2e62-6e32-41cf-856e-7c263ce8270a admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:19.904437 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-0c5fdabf-6e19-47b2-aa3a-c48f0fb386d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '030de9f6f59a46a8b8bb371f28955b36'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:19.910288 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d87cf-e5e4-4098-8f33-326df7e28870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:19.911039 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d87cf-e5e4-4098-8f33-326df7e28870 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:19.911386 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d87cf-e5e4-4098-8f33-326df7e28870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:19.911691 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d87cf-e5e4-4098-8f33-326df7e28870 admin admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:19.912451 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41d87cf-e5e4-4098-8f33-326df7e28870 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:19.916241 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-0c5fdabf-6e19-47b2-aa3a-c48f0fb386d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '030de9f6f59a46a8b8bb371f28955b36'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:19.917429 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41d87cf-e5e4-4098-8f33-326df7e28870 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:19.917573 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-0c5fdabf-6e19-47b2-aa3a-c48f0fb386d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '030de9f6f59a46a8b8bb371f28955b36'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:19.925705 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-0c5fdabf-6e19-47b2-aa3a-c48f0fb386d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '030de9f6f59a46a8b8bb371f28955b36'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:19.927005 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-0c5fdabf-6e19-47b2-aa3a-c48f0fb386d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '030de9f6f59a46a8b8bb371f28955b36'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:19.948932 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1062/2125] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:19:19 2022] POST /identity/v3/projects => generated 363 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:19:19.958927 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1064/2126] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:19:19 2022] DELETE /identity/v3/users/030de9f6f59a46a8b8bb371f28955b36 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:19:19.959350 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d87cf-e5e4-4098-8f33-326df7e28870 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:19.960908 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-b41d87cf-e5e4-4098-8f33-326df7e28870 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:19.969110 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2dd92-4494-4210-8cb4-ce4041ba4ea5 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:19.969490 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2dd92-4494-4210-8cb4-ce4041ba4ea5 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:19.969849 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2dd92-4494-4210-8cb4-ce4041ba4ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:19.989924 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-caf2dd92-4494-4210-8cb4-ce4041ba4ea5 None None] MFA Rules not processed for user `f370e353067848b5843c5650183be347`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:19:19.991131 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-caf2dd92-4494-4210-8cb4-ce4041ba4ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:20.037153 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d87cf-e5e4-4098-8f33-326df7e28870 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:20.058027 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1065/2127] 10.222.0.65 () {58 vars in 967 bytes} [Tue May 17 18:19:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:19:20.071341 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2dd92-4494-4210-8cb4-ce4041ba4ea5 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:20.072611 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-caf2dd92-4494-4210-8cb4-ce4041ba4ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:20.102406 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c76647-2d61-4893-a90a-68f9356e290e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:20.103008 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c76647-2d61-4893-a90a-68f9356e290e admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:20.103331 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c76647-2d61-4893-a90a-68f9356e290e admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:20.103723 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c76647-2d61-4893-a90a-68f9356e290e admin admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:20.104416 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c76647-2d61-4893-a90a-68f9356e290e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:20.106922 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c76647-2d61-4893-a90a-68f9356e290e admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:20.141145 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1063/2128] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:19:19 2022] POST /identity/v3/users => generated 282 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:19:20.145123 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c76647-2d61-4893-a90a-68f9356e290e admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:20.157773 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c76647-2d61-4893-a90a-68f9356e290e admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:20.164555 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ebd6b3-82e4-404f-a871-6e650bc881ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:20.165657 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ebd6b3-82e4-404f-a871-6e650bc881ad admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:20.166083 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ebd6b3-82e4-404f-a871-6e650bc881ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:20.166538 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ebd6b3-82e4-404f-a871-6e650bc881ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:20.166679 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf2dd92-4494-4210-8cb4-ce4041ba4ea5 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:20.167963 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ebd6b3-82e4-404f-a871-6e650bc881ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:20.170268 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ebd6b3-82e4-404f-a871-6e650bc881ad admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:20.177057 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea9051-7608-4702-b9b4-585bcbac2441 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1464e84a3a2d4321a98b98d398bc7be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:20.177751 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea9051-7608-4702-b9b4-585bcbac2441 service swift] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:20.178035 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea9051-7608-4702-b9b4-585bcbac2441 service swift] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:20.178306 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea9051-7608-4702-b9b4-585bcbac2441 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:20.182809 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1064/2129] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:19:20.186920 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ebd6b3-82e4-404f-a871-6e650bc881ad admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:20.189043 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ea9051-7608-4702-b9b4-585bcbac2441 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:20.190674 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ea9051-7608-4702-b9b4-585bcbac2441 service swift] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:20.197088 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ebd6b3-82e4-404f-a871-6e650bc881ad admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:20.201262 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1066/2130] 10.222.0.65 () {60 vars in 1384 bytes} [Tue May 17 18:19:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 17 18:19:20.202793 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b3621-b40f-437c-bdc8-d4bf4a7c2043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:20.203505 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b3621-b40f-437c-bdc8-d4bf4a7c2043 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:20.203789 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b3621-b40f-437c-bdc8-d4bf4a7c2043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:20.204314 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b3621-b40f-437c-bdc8-d4bf4a7c2043 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:20.204967 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8b3621-b40f-437c-bdc8-d4bf4a7c2043 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:20.206731 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8b3621-b40f-437c-bdc8-d4bf4a7c2043 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:20.219398 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1065/2131] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:19:20.224515 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea9051-7608-4702-b9b4-585bcbac2441 service swift] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:20.245578 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ea9051-7608-4702-b9b4-585bcbac2441 service swift] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:20.250561 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888dd66a-2b19-43b3-9319-bf17f1a4ca5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:20.251479 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888dd66a-2b19-43b3-9319-bf17f1a4ca5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:20.251713 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888dd66a-2b19-43b3-9319-bf17f1a4ca5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:20.252350 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888dd66a-2b19-43b3-9319-bf17f1a4ca5e admin admin] PATH_INFO: `/v3/projects/b0437188f24d4bca8821b2b370adb4dc/users/d387383777d74e62a1c6e9947e7067be/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:20.269151 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b3621-b40f-437c-bdc8-d4bf4a7c2043 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:20.271552 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-ab8b3621-b40f-437c-bdc8-d4bf4a7c2043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:20.273345 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888dd66a-2b19-43b3-9319-bf17f1a4ca5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0437188f24d4bca8821b2b370adb4dc, user_id=d387383777d74e62a1c6e9947e7067be, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:20.281100 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888dd66a-2b19-43b3-9319-bf17f1a4ca5e admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:20.290173 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b3621-b40f-437c-bdc8-d4bf4a7c2043 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:20.299058 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1067/2132] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:19:20 2022] PUT /identity/v3/projects/b0437188f24d4bca8821b2b370adb4dc/users/d387383777d74e62a1c6e9947e7067be/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:19:20.310203 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e5cbc-936a-4463-93c3-cb10be87a70a None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:20.310836 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e5cbc-936a-4463-93c3-cb10be87a70a None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:20.311204 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e5cbc-936a-4463-93c3-cb10be87a70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:20.345817 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-2e5e5cbc-936a-4463-93c3-cb10be87a70a None None] MFA Rules not processed for user `d387383777d74e62a1c6e9947e7067be`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:19:20.347100 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-2e5e5cbc-936a-4463-93c3-cb10be87a70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:20.369487 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83ebc15-8be9-4de7-99bc-8f5eb17b82ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:20.369487 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ebc15-8be9-4de7-99bc-8f5eb17b82ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:20.369487 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ebc15-8be9-4de7-99bc-8f5eb17b82ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:20.369487 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ebc15-8be9-4de7-99bc-8f5eb17b82ab admin admin] PATH_INFO: `/v3/projects/b8cd55108ac94572b91273c3ba50261a` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:20.369965 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83ebc15-8be9-4de7-99bc-8f5eb17b82ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8cd55108ac94572b91273c3ba50261a)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:20.369965 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83ebc15-8be9-4de7-99bc-8f5eb17b82ab admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:20.426656 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-e83ebc15-8be9-4de7-99bc-8f5eb17b82ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8cd55108ac94572b91273c3ba50261a', 'request_id': 'req-e83ebc15-8be9-4de7-99bc-8f5eb17b82ab'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:20.433973 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-e83ebc15-8be9-4de7-99bc-8f5eb17b82ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8cd55108ac94572b91273c3ba50261a', 'request_id': 'req-e83ebc15-8be9-4de7-99bc-8f5eb17b82ab'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:20.435083 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1068/2133] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:19:20 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:19:20.442637 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-e83ebc15-8be9-4de7-99bc-8f5eb17b82ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8cd55108ac94572b91273c3ba50261a', 'request_id': 'req-e83ebc15-8be9-4de7-99bc-8f5eb17b82ab'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:20.449271 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e5cbc-936a-4463-93c3-cb10be87a70a None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:20.450814 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-2e5e5cbc-936a-4463-93c3-cb10be87a70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:20.469092 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-e83ebc15-8be9-4de7-99bc-8f5eb17b82ab admin admin] The token cache is being invalidate because project b8cd55108ac94572b91273c3ba50261a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:19:20.469666 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-e83ebc15-8be9-4de7-99bc-8f5eb17b82ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:20.470526 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-e83ebc15-8be9-4de7-99bc-8f5eb17b82ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:20.472633 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1066/2134] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:19:20 2022] DELETE /identity/v3/projects/b8cd55108ac94572b91273c3ba50261a => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:19:20.478292 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380a573-356a-411e-96df-f0bd950739f6 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:20.478595 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380a573-356a-411e-96df-f0bd950739f6 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:20.478906 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380a573-356a-411e-96df-f0bd950739f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:20.500814 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-f380a573-356a-411e-96df-f0bd950739f6 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:19:20.501585 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-f380a573-356a-411e-96df-f0bd950739f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:20.536111 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e5cbc-936a-4463-93c3-cb10be87a70a None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:20.597714 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1067/2135] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:19:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:19:20.597714 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998e6d0-c23f-421b-8028-0a9ca6163938 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:20.597714 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998e6d0-c23f-421b-8028-0a9ca6163938 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:20.597714 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5998e6d0-c23f-421b-8028-0a9ca6163938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:20.604788 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015144e4-4a19-4895-9d15-0ede533e9887 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:20.605626 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015144e4-4a19-4895-9d15-0ede533e9887 service cinder] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:20.605983 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015144e4-4a19-4895-9d15-0ede533e9887 service cinder] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:20.606647 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015144e4-4a19-4895-9d15-0ede533e9887 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:20.608528 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-015144e4-4a19-4895-9d15-0ede533e9887 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:20.616710 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-5998e6d0-c23f-421b-8028-0a9ca6163938 None None] MFA Rules not processed for user `f370e353067848b5843c5650183be347`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:19:20.617945 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-5998e6d0-c23f-421b-8028-0a9ca6163938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:20.674523 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1068/2136] 10.222.0.65 () {58 vars in 1009 bytes} [Tue May 17 18:19:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:19:20.675833 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74dc04c-5349-4f78-8632-dc61b1860df3 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:20.676090 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74dc04c-5349-4f78-8632-dc61b1860df3 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:20.676365 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74dc04c-5349-4f78-8632-dc61b1860df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:20.683629 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015144e4-4a19-4895-9d15-0ede533e9887 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:20.685191 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015144e4-4a19-4895-9d15-0ede533e9887 service cinder] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:20.695005 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1069/2137] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:19:20 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:19:20.695814 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015144e4-4a19-4895-9d15-0ede533e9887 service cinder] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:20.697108 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-015144e4-4a19-4895-9d15-0ede533e9887 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:20.700522 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-c74dc04c-5349-4f78-8632-dc61b1860df3 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:19:20.701744 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-c74dc04c-5349-4f78-8632-dc61b1860df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:20.713507 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1069/2138] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:19:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:19:20.718545 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74dc04c-5349-4f78-8632-dc61b1860df3 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:20.731917 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74dc04c-5349-4f78-8632-dc61b1860df3 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:20.736842 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f81e7cf-d197-486b-862d-8f2ee33daeac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:20.737716 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f81e7cf-d197-486b-862d-8f2ee33daeac admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:20.737940 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f81e7cf-d197-486b-862d-8f2ee33daeac admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:20.738339 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f81e7cf-d197-486b-862d-8f2ee33daeac admin admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:20.739077 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f81e7cf-d197-486b-862d-8f2ee33daeac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:19:20.739379 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f81e7cf-d197-486b-862d-8f2ee33daeac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:20.742144 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f81e7cf-d197-486b-862d-8f2ee33daeac admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:20.761690 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1070/2139] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 17 18:19:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:19:20.762831 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f81e7cf-d197-486b-862d-8f2ee33daeac admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:20.778540 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f81e7cf-d197-486b-862d-8f2ee33daeac admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:20.783446 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1b6b0-985b-4aba-9acd-566a356f193a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:20.784094 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1b6b0-985b-4aba-9acd-566a356f193a admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:20.784371 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1b6b0-985b-4aba-9acd-566a356f193a admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:20.784641 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1b6b0-985b-4aba-9acd-566a356f193a admin admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:20.785375 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae1b6b0-985b-4aba-9acd-566a356f193a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:20.787308 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae1b6b0-985b-4aba-9acd-566a356f193a admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:20.791687 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015144e4-4a19-4895-9d15-0ede533e9887 service cinder] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:20.796862 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea71b3-762a-41ff-915a-03a2c9543d8d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1464e84a3a2d4321a98b98d398bc7be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:20.797447 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea71b3-762a-41ff-915a-03a2c9543d8d service swift] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:20.797756 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea71b3-762a-41ff-915a-03a2c9543d8d service swift] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:20.798031 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ea71b3-762a-41ff-915a-03a2c9543d8d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:20.811100 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ea71b3-762a-41ff-915a-03a2c9543d8d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:20.812708 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ea71b3-762a-41ff-915a-03a2c9543d8d service swift] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:20.823241 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1071/2140] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:19:20 2022] POST /identity/v3/projects => generated 369 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:19:20.825641 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1070/2141] 10.222.0.65 () {60 vars in 1384 bytes} [Tue May 17 18:19:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 18:19:20.827257 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1b6b0-985b-4aba-9acd-566a356f193a admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:20.922634 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1b6b0-985b-4aba-9acd-566a356f193a admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:20.930497 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13922ced-5b66-4620-9212-1ccdcc2c100f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:20.931381 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13922ced-5b66-4620-9212-1ccdcc2c100f admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:20.931663 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13922ced-5b66-4620-9212-1ccdcc2c100f admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:20.931990 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13922ced-5b66-4620-9212-1ccdcc2c100f admin admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:20.933300 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13922ced-5b66-4620-9212-1ccdcc2c100f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:20.936211 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13922ced-5b66-4620-9212-1ccdcc2c100f admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:21.004290 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1072/2142] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:19:20 2022] POST /identity/v3/users => generated 285 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:19:21.005533 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea71b3-762a-41ff-915a-03a2c9543d8d service swift] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:21.076856 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ea71b3-762a-41ff-915a-03a2c9543d8d service swift] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:21.084799 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ac55c8-d004-4e6e-8d8e-f6f9d08155ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:21.084799 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac55c8-d004-4e6e-8d8e-f6f9d08155ce admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:21.084799 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac55c8-d004-4e6e-8d8e-f6f9d08155ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:21.084799 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac55c8-d004-4e6e-8d8e-f6f9d08155ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:21.085268 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ac55c8-d004-4e6e-8d8e-f6f9d08155ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:21.086138 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ac55c8-d004-4e6e-8d8e-f6f9d08155ce admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:21.096567 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1071/2143] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:19:21.101132 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13922ced-5b66-4620-9212-1ccdcc2c100f admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:21.147982 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13922ced-5b66-4620-9212-1ccdcc2c100f admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:21.152684 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ea2f3-9d4a-4204-8881-9be9a686984c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:21.153449 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ea2f3-9d4a-4204-8881-9be9a686984c admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:21.153760 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ea2f3-9d4a-4204-8881-9be9a686984c admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:21.154029 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ea2f3-9d4a-4204-8881-9be9a686984c admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:21.154740 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503ea2f3-9d4a-4204-8881-9be9a686984c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:21.156477 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503ea2f3-9d4a-4204-8881-9be9a686984c admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:21.166969 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1073/2144] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:19:21.171045 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ac55c8-d004-4e6e-8d8e-f6f9d08155ce admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:21.182281 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ac55c8-d004-4e6e-8d8e-f6f9d08155ce admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:21.187488 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2019cc-3609-4c0b-a36b-668f9af00e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:21.188596 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2019cc-3609-4c0b-a36b-668f9af00e6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:21.189000 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2019cc-3609-4c0b-a36b-668f9af00e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:21.189283 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2019cc-3609-4c0b-a36b-668f9af00e6c admin admin] PATH_INFO: `/v3/projects/664d4c468c7e4ddc97894995427d449c/users/f53aff60752f458482d20880c54e3250/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:21.211109 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2019cc-3609-4c0b-a36b-668f9af00e6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=664d4c468c7e4ddc97894995427d449c, user_id=f53aff60752f458482d20880c54e3250, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:21.213956 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2019cc-3609-4c0b-a36b-668f9af00e6c admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:21.228164 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1072/2145] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:19:21 2022] PUT /identity/v3/projects/664d4c468c7e4ddc97894995427d449c/users/f53aff60752f458482d20880c54e3250/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:19:21.229911 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44f67d-9db7-438c-9791-d332d08d7bbb None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:21.230195 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44f67d-9db7-438c-9791-d332d08d7bbb None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:21.230470 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44f67d-9db7-438c-9791-d332d08d7bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:21.238120 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12abe86e-97f2-4ced-a2a1-e04629701560 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:21.238414 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12abe86e-97f2-4ced-a2a1-e04629701560 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:21.238710 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12abe86e-97f2-4ced-a2a1-e04629701560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:21.250667 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-9a44f67d-9db7-438c-9791-d332d08d7bbb None None] MFA Rules not processed for user `f370e353067848b5843c5650183be347`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:19:21.252745 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-9a44f67d-9db7-438c-9791-d332d08d7bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:21.266013 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-12abe86e-97f2-4ced-a2a1-e04629701560 None None] MFA Rules not processed for user `f53aff60752f458482d20880c54e3250`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:19:21.267374 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-12abe86e-97f2-4ced-a2a1-e04629701560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:21.328203 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1074/2146] 10.222.0.65 () {58 vars in 967 bytes} [Tue May 17 18:19:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:19:21.335783 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1073/2147] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:19:21 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:19:21.340403 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a44f67d-9db7-438c-9791-d332d08d7bbb None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:21.406236 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a44f67d-9db7-438c-9791-d332d08d7bbb None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:21.411312 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362df43a-5ccc-4e8d-a87b-63a87007bc2b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1464e84a3a2d4321a98b98d398bc7be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:21.411954 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362df43a-5ccc-4e8d-a87b-63a87007bc2b service swift] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:21.412235 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362df43a-5ccc-4e8d-a87b-63a87007bc2b service swift] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:21.412509 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362df43a-5ccc-4e8d-a87b-63a87007bc2b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:21.421074 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362df43a-5ccc-4e8d-a87b-63a87007bc2b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:21.422872 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362df43a-5ccc-4e8d-a87b-63a87007bc2b service swift] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:21.431346 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1075/2148] 10.222.0.65 () {60 vars in 1384 bytes} [Tue May 17 18:19:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 18:19:21.530680 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12abe86e-97f2-4ced-a2a1-e04629701560 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:21.532115 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-12abe86e-97f2-4ced-a2a1-e04629701560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:21.593807 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12abe86e-97f2-4ced-a2a1-e04629701560 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:21.597899 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51508e-ac58-4e0c-aca7-97eba4f24790 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce570634a66b45158d940151828f533a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:21.598556 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51508e-ac58-4e0c-aca7-97eba4f24790 service glance] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:21.598842 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51508e-ac58-4e0c-aca7-97eba4f24790 service glance] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:21.599320 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51508e-ac58-4e0c-aca7-97eba4f24790 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:21.609342 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51508e-ac58-4e0c-aca7-97eba4f24790 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:21.610835 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51508e-ac58-4e0c-aca7-97eba4f24790 service glance] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:21.620822 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1074/2149] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:19:21 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:19:23.599892 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362df43a-5ccc-4e8d-a87b-63a87007bc2b service swift] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:23.601436 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-362df43a-5ccc-4e8d-a87b-63a87007bc2b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:23.666147 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362df43a-5ccc-4e8d-a87b-63a87007bc2b service swift] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:23.670444 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f8dc99-882d-4770-82ff-70d711d6818d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:23.671303 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8dc99-882d-4770-82ff-70d711d6818d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:23.671579 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8dc99-882d-4770-82ff-70d711d6818d admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:23.671852 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8dc99-882d-4770-82ff-70d711d6818d admin admin] PATH_INFO: `/v3/users/c725fea1d5574c8382d3d8fb9fd61526` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:23.673150 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f8dc99-882d-4770-82ff-70d711d6818d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c725fea1d5574c8382d3d8fb9fd61526)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:23.675154 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f8dc99-882d-4770-82ff-70d711d6818d admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:23.733096 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-49f8dc99-882d-4770-82ff-70d711d6818d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c725fea1d5574c8382d3d8fb9fd61526'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:23.749384 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-49f8dc99-882d-4770-82ff-70d711d6818d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c725fea1d5574c8382d3d8fb9fd61526'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:23.749384 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-49f8dc99-882d-4770-82ff-70d711d6818d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c725fea1d5574c8382d3d8fb9fd61526'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:23.749384 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-49f8dc99-882d-4770-82ff-70d711d6818d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c725fea1d5574c8382d3d8fb9fd61526'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:23.754105 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-49f8dc99-882d-4770-82ff-70d711d6818d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c725fea1d5574c8382d3d8fb9fd61526'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:23.767461 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1076/2150] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:19:23 2022] DELETE /identity/v3/users/c725fea1d5574c8382d3d8fb9fd61526 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:19:23.771776 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1591f621-5482-4140-b513-0dddf9224209 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:23.772280 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1591f621-5482-4140-b513-0dddf9224209 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:23.772377 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1591f621-5482-4140-b513-0dddf9224209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:23.800567 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-1591f621-5482-4140-b513-0dddf9224209 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:19:23.801877 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-1591f621-5482-4140-b513-0dddf9224209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:23.870544 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1075/2151] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:19:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:19:23.879940 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f8dc99-882d-4770-82ff-70d711d6818d admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:23.881317 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-49f8dc99-882d-4770-82ff-70d711d6818d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:23.962203 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f8dc99-882d-4770-82ff-70d711d6818d admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:23.966025 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb0b756-c62c-4913-a7b3-8ed7caf28e49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:23.966686 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb0b756-c62c-4913-a7b3-8ed7caf28e49 service neutron] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:23.966961 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb0b756-c62c-4913-a7b3-8ed7caf28e49 service neutron] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:23.967234 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb0b756-c62c-4913-a7b3-8ed7caf28e49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:23.976999 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb0b756-c62c-4913-a7b3-8ed7caf28e49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:23.978458 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb0b756-c62c-4913-a7b3-8ed7caf28e49 service neutron] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:23.992137 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1077/2152] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:19:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:19:24.169174 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1591f621-5482-4140-b513-0dddf9224209 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:24.177903 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-1591f621-5482-4140-b513-0dddf9224209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:24.200443 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1591f621-5482-4140-b513-0dddf9224209 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:24.205155 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d909b8af-a73d-4f3d-8406-5b409b53eefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:24.206035 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909b8af-a73d-4f3d-8406-5b409b53eefb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:24.206847 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909b8af-a73d-4f3d-8406-5b409b53eefb admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:24.207129 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909b8af-a73d-4f3d-8406-5b409b53eefb admin admin] PATH_INFO: `/v3/projects/4f60fdd09f5b450bb6cb18902bf860e0` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:24.208330 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d909b8af-a73d-4f3d-8406-5b409b53eefb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f60fdd09f5b450bb6cb18902bf860e0)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:24.210426 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d909b8af-a73d-4f3d-8406-5b409b53eefb admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:24.262740 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-d909b8af-a73d-4f3d-8406-5b409b53eefb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f60fdd09f5b450bb6cb18902bf860e0', 'request_id': 'req-d909b8af-a73d-4f3d-8406-5b409b53eefb'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:24.268645 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-d909b8af-a73d-4f3d-8406-5b409b53eefb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f60fdd09f5b450bb6cb18902bf860e0', 'request_id': 'req-d909b8af-a73d-4f3d-8406-5b409b53eefb'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:24.276696 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-d909b8af-a73d-4f3d-8406-5b409b53eefb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f60fdd09f5b450bb6cb18902bf860e0', 'request_id': 'req-d909b8af-a73d-4f3d-8406-5b409b53eefb'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:24.286832 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-d909b8af-a73d-4f3d-8406-5b409b53eefb admin admin] The token cache is being invalidate because project 4f60fdd09f5b450bb6cb18902bf860e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:19:24.287140 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-d909b8af-a73d-4f3d-8406-5b409b53eefb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:24.287774 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-d909b8af-a73d-4f3d-8406-5b409b53eefb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:24.289371 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1076/2153] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:19:24 2022] DELETE /identity/v3/projects/4f60fdd09f5b450bb6cb18902bf860e0 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:20:03.609644 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b30540-b88e-4f41-965b-eeb5fdd8beb5 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:03.610196 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b30540-b88e-4f41-965b-eeb5fdd8beb5 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:03.610196 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b30540-b88e-4f41-965b-eeb5fdd8beb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:03.627171 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-e0b30540-b88e-4f41-965b-eeb5fdd8beb5 None None] MFA Rules not processed for user `5e6f035cadd24a59803eec21c7b9e2c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:03.628353 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-e0b30540-b88e-4f41-965b-eeb5fdd8beb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:03.681191 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1078/2154] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:20:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:20:34.506765 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d909b8af-a73d-4f3d-8406-5b409b53eefb admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:34.508153 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-d909b8af-a73d-4f3d-8406-5b409b53eefb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:34.596916 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d909b8af-a73d-4f3d-8406-5b409b53eefb admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:34.601919 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0401ed-c68d-4ad8-979a-8377e830fe41 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ddf11ac3e14d03b1159868b3b73fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:34.602555 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0401ed-c68d-4ad8-979a-8377e830fe41 service placement] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:34.602829 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0401ed-c68d-4ad8-979a-8377e830fe41 service placement] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:34.603098 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0401ed-c68d-4ad8-979a-8377e830fe41 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:34.605368 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-1a0401ed-c68d-4ad8-979a-8377e830fe41 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:34.616405 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0401ed-c68d-4ad8-979a-8377e830fe41 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:34.617995 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0401ed-c68d-4ad8-979a-8377e830fe41 service placement] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:34.628147 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1077/2155] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:20:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:20:45.095142 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b30540-b88e-4f41-965b-eeb5fdd8beb5 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:45.096618 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-e0b30540-b88e-4f41-965b-eeb5fdd8beb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:45.164788 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b30540-b88e-4f41-965b-eeb5fdd8beb5 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:45.171536 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158f4e3-8674-4ff9-8aff-f1c2b463babb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:45.172539 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158f4e3-8674-4ff9-8aff-f1c2b463babb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:45.172851 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158f4e3-8674-4ff9-8aff-f1c2b463babb admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:45.173209 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158f4e3-8674-4ff9-8aff-f1c2b463babb admin admin] PATH_INFO: `/v3/users/d387383777d74e62a1c6e9947e7067be` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:45.174448 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f158f4e3-8674-4ff9-8aff-f1c2b463babb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d387383777d74e62a1c6e9947e7067be)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:45.176673 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f158f4e3-8674-4ff9-8aff-f1c2b463babb admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:45.235413 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-f158f4e3-8674-4ff9-8aff-f1c2b463babb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd387383777d74e62a1c6e9947e7067be'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:45.250868 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-f158f4e3-8674-4ff9-8aff-f1c2b463babb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd387383777d74e62a1c6e9947e7067be'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:45.251627 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-f158f4e3-8674-4ff9-8aff-f1c2b463babb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd387383777d74e62a1c6e9947e7067be'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:45.252251 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-f158f4e3-8674-4ff9-8aff-f1c2b463babb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd387383777d74e62a1c6e9947e7067be'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:45.259943 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-f158f4e3-8674-4ff9-8aff-f1c2b463babb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd387383777d74e62a1c6e9947e7067be'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:45.274062 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1079/2156] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:20:45 2022] DELETE /identity/v3/users/d387383777d74e62a1c6e9947e7067be => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:20:45.279732 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff512d89-c059-4f12-b1d5-9ecaf256313d None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:45.280249 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff512d89-c059-4f12-b1d5-9ecaf256313d None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:45.280249 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff512d89-c059-4f12-b1d5-9ecaf256313d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:45.297042 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-ff512d89-c059-4f12-b1d5-9ecaf256313d None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:45.298276 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-ff512d89-c059-4f12-b1d5-9ecaf256313d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:45.359425 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1078/2157] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:20:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:20:45.369115 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158f4e3-8674-4ff9-8aff-f1c2b463babb admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:45.371141 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-f158f4e3-8674-4ff9-8aff-f1c2b463babb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:45.430784 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158f4e3-8674-4ff9-8aff-f1c2b463babb admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:45.435596 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c331bd9-54b6-44fa-acae-f1a54affcd11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:45.436249 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c331bd9-54b6-44fa-acae-f1a54affcd11 service neutron] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:45.436511 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c331bd9-54b6-44fa-acae-f1a54affcd11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:45.436786 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c331bd9-54b6-44fa-acae-f1a54affcd11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:45.446367 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c331bd9-54b6-44fa-acae-f1a54affcd11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:45.448477 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c331bd9-54b6-44fa-acae-f1a54affcd11 service neutron] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:45.458914 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1080/2158] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:20:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:20:45.725846 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff512d89-c059-4f12-b1d5-9ecaf256313d None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:45.727191 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-ff512d89-c059-4f12-b1d5-9ecaf256313d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:45.739485 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff512d89-c059-4f12-b1d5-9ecaf256313d None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:45.744178 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0dfd24-0aa0-4db6-b35c-dc207053e86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:45.745649 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0dfd24-0aa0-4db6-b35c-dc207053e86d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:45.745925 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0dfd24-0aa0-4db6-b35c-dc207053e86d admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:45.746193 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0dfd24-0aa0-4db6-b35c-dc207053e86d admin admin] PATH_INFO: `/v3/projects/b0437188f24d4bca8821b2b370adb4dc` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:45.747406 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0dfd24-0aa0-4db6-b35c-dc207053e86d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0437188f24d4bca8821b2b370adb4dc)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:45.749284 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0dfd24-0aa0-4db6-b35c-dc207053e86d admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:45.797317 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-fd0dfd24-0aa0-4db6-b35c-dc207053e86d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0437188f24d4bca8821b2b370adb4dc', 'request_id': 'req-fd0dfd24-0aa0-4db6-b35c-dc207053e86d'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:45.803756 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-fd0dfd24-0aa0-4db6-b35c-dc207053e86d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0437188f24d4bca8821b2b370adb4dc', 'request_id': 'req-fd0dfd24-0aa0-4db6-b35c-dc207053e86d'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:45.811590 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-fd0dfd24-0aa0-4db6-b35c-dc207053e86d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0437188f24d4bca8821b2b370adb4dc', 'request_id': 'req-fd0dfd24-0aa0-4db6-b35c-dc207053e86d'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:45.822476 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-fd0dfd24-0aa0-4db6-b35c-dc207053e86d admin admin] The token cache is being invalidate because project b0437188f24d4bca8821b2b370adb4dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:20:45.822766 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-fd0dfd24-0aa0-4db6-b35c-dc207053e86d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:45.823414 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-fd0dfd24-0aa0-4db6-b35c-dc207053e86d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:45.825427 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1079/2159] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:20:45 2022] DELETE /identity/v3/projects/b0437188f24d4bca8821b2b370adb4dc => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:20:45.833512 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3b73b-ef4e-4e19-8f36-7ee518401dce None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:45.833512 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3b73b-ef4e-4e19-8f36-7ee518401dce None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:45.833512 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3b73b-ef4e-4e19-8f36-7ee518401dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:45.885727 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-34d3b73b-ef4e-4e19-8f36-7ee518401dce None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:45.886997 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-34d3b73b-ef4e-4e19-8f36-7ee518401dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:45.953610 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1081/2160] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:20:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:20:45.959391 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ef678-d1dd-4498-b6cc-1f6f3249cfc9 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:45.959673 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ef678-d1dd-4498-b6cc-1f6f3249cfc9 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:45.959945 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8ef678-d1dd-4498-b6cc-1f6f3249cfc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:45.980989 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-2c8ef678-d1dd-4498-b6cc-1f6f3249cfc9 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:45.982983 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-2c8ef678-d1dd-4498-b6cc-1f6f3249cfc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:45.990428 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1080/2161] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:20:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:20:45.994661 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3b73b-ef4e-4e19-8f36-7ee518401dce None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:46.004720 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3b73b-ef4e-4e19-8f36-7ee518401dce None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:46.009593 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b73084d-3681-412e-b866-093ba02675a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:46.010856 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73084d-3681-412e-b866-093ba02675a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:46.011195 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73084d-3681-412e-b866-093ba02675a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:46.011533 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73084d-3681-412e-b866-093ba02675a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:46.012257 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b73084d-3681-412e-b866-093ba02675a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:20:46.012558 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b73084d-3681-412e-b866-093ba02675a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:46.014182 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b73084d-3681-412e-b866-093ba02675a3 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:46.028607 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1082/2162] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 17 18:20:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:20:46.030878 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ef678-d1dd-4498-b6cc-1f6f3249cfc9 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:46.039790 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8ef678-d1dd-4498-b6cc-1f6f3249cfc9 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:46.044548 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ada7fa-b3cb-4e0c-9398-de42c1b2cd35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:46.045193 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ada7fa-b3cb-4e0c-9398-de42c1b2cd35 admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:46.045484 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ada7fa-b3cb-4e0c-9398-de42c1b2cd35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:46.045777 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ada7fa-b3cb-4e0c-9398-de42c1b2cd35 admin admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:46.047019 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ada7fa-b3cb-4e0c-9398-de42c1b2cd35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:46.049112 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ada7fa-b3cb-4e0c-9398-de42c1b2cd35 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:46.076812 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1081/2163] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:20:46 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:20:46.080960 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b73084d-3681-412e-b866-093ba02675a3 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:46.092205 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b73084d-3681-412e-b866-093ba02675a3 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:46.149108 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e315c-d966-43b6-8def-44a2f3113c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:46.149799 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e315c-d966-43b6-8def-44a2f3113c57 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:46.150074 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e315c-d966-43b6-8def-44a2f3113c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:46.150346 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e315c-d966-43b6-8def-44a2f3113c57 admin admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:46.151205 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340e315c-d966-43b6-8def-44a2f3113c57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:46.153159 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340e315c-d966-43b6-8def-44a2f3113c57 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:46.176769 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1083/2164] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:20:46 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:20:46.177936 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ada7fa-b3cb-4e0c-9398-de42c1b2cd35 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:46.188567 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ada7fa-b3cb-4e0c-9398-de42c1b2cd35 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:46.193196 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0946e44-0f34-4e3e-b177-d4c007ba9e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:46.194183 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0946e44-0f34-4e3e-b177-d4c007ba9e0c admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:46.194183 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0946e44-0f34-4e3e-b177-d4c007ba9e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:46.194404 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0946e44-0f34-4e3e-b177-d4c007ba9e0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:46.195127 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0946e44-0f34-4e3e-b177-d4c007ba9e0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:46.196724 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0946e44-0f34-4e3e-b177-d4c007ba9e0c admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:46.208765 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1082/2165] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:20:46.213032 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e315c-d966-43b6-8def-44a2f3113c57 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:46.224080 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e315c-d966-43b6-8def-44a2f3113c57 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:46.228793 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc542803-5ba3-4dcf-a1c3-ec568b715e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:46.229520 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc542803-5ba3-4dcf-a1c3-ec568b715e15 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:46.229803 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc542803-5ba3-4dcf-a1c3-ec568b715e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:46.230077 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc542803-5ba3-4dcf-a1c3-ec568b715e15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:46.230805 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc542803-5ba3-4dcf-a1c3-ec568b715e15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:46.232397 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc542803-5ba3-4dcf-a1c3-ec568b715e15 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:46.243387 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1084/2166] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:20:46.249446 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0946e44-0f34-4e3e-b177-d4c007ba9e0c admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:46.262277 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0946e44-0f34-4e3e-b177-d4c007ba9e0c admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:46.268839 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a333f-a180-4e33-a4bb-f89cb75be417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:46.269821 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a333f-a180-4e33-a4bb-f89cb75be417 admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:46.269970 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a333f-a180-4e33-a4bb-f89cb75be417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:46.270127 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a333f-a180-4e33-a4bb-f89cb75be417 admin admin] PATH_INFO: `/v3/projects/481c26193c6141588dd15fd5c593de86/users/861ad9a7c63a4d66a1806c4576cddce5/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:46.287010 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a333f-a180-4e33-a4bb-f89cb75be417 admin admin] RBAC: Authorizing `identity:create_grant(project_id=481c26193c6141588dd15fd5c593de86, user_id=861ad9a7c63a4d66a1806c4576cddce5, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:46.289720 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a333f-a180-4e33-a4bb-f89cb75be417 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:46.303188 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1083/2167] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:20:46 2022] PUT /identity/v3/projects/481c26193c6141588dd15fd5c593de86/users/861ad9a7c63a4d66a1806c4576cddce5/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:20:46.309138 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37600b89-9495-4f7a-a45f-da43f2c97132 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:46.309413 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37600b89-9495-4f7a-a45f-da43f2c97132 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:46.309708 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37600b89-9495-4f7a-a45f-da43f2c97132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:46.332336 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-37600b89-9495-4f7a-a45f-da43f2c97132 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:46.333701 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-37600b89-9495-4f7a-a45f-da43f2c97132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:46.400314 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1085/2168] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:20:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:20:46.409432 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a333f-a180-4e33-a4bb-f89cb75be417 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:46.411122 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-762a333f-a180-4e33-a4bb-f89cb75be417 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:46.466112 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a333f-a180-4e33-a4bb-f89cb75be417 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:46.469814 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f977b0-04df-49fa-b68b-88925cb182d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:46.470440 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f977b0-04df-49fa-b68b-88925cb182d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:46.470716 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f977b0-04df-49fa-b68b-88925cb182d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:46.470986 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f977b0-04df-49fa-b68b-88925cb182d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:46.480325 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f977b0-04df-49fa-b68b-88925cb182d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:46.481772 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f977b0-04df-49fa-b68b-88925cb182d4 service neutron] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:46.490960 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1084/2169] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:20:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:20:48.578444 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37600b89-9495-4f7a-a45f-da43f2c97132 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:48.579945 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-37600b89-9495-4f7a-a45f-da43f2c97132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:48.593583 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37600b89-9495-4f7a-a45f-da43f2c97132 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:48.598845 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8769f698-f532-4307-be23-d7041dc93af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:48.600145 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769f698-f532-4307-be23-d7041dc93af1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:48.600665 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769f698-f532-4307-be23-d7041dc93af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:48.601166 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769f698-f532-4307-be23-d7041dc93af1 admin admin] PATH_INFO: `/v3/users/f53aff60752f458482d20880c54e3250` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:48.602687 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8769f698-f532-4307-be23-d7041dc93af1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f53aff60752f458482d20880c54e3250)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:48.605364 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8769f698-f532-4307-be23-d7041dc93af1 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:48.656095 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-8769f698-f532-4307-be23-d7041dc93af1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f53aff60752f458482d20880c54e3250'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:48.668757 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-8769f698-f532-4307-be23-d7041dc93af1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f53aff60752f458482d20880c54e3250'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:48.669833 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-8769f698-f532-4307-be23-d7041dc93af1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f53aff60752f458482d20880c54e3250'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:48.670779 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-8769f698-f532-4307-be23-d7041dc93af1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f53aff60752f458482d20880c54e3250'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:48.685769 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-8769f698-f532-4307-be23-d7041dc93af1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f53aff60752f458482d20880c54e3250'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:48.713613 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1086/2170] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:20:48 2022] DELETE /identity/v3/users/f53aff60752f458482d20880c54e3250 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:20:48.718309 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a602042-efc0-4c8d-8288-2ea5461c6628 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:48.719117 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a602042-efc0-4c8d-8288-2ea5461c6628 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:48.719394 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a602042-efc0-4c8d-8288-2ea5461c6628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:48.745405 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-9a602042-efc0-4c8d-8288-2ea5461c6628 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:48.746863 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-9a602042-efc0-4c8d-8288-2ea5461c6628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:48.818783 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1085/2171] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:20:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:20:48.833948 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8769f698-f532-4307-be23-d7041dc93af1 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:48.836331 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-8769f698-f532-4307-be23-d7041dc93af1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:48.899781 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8769f698-f532-4307-be23-d7041dc93af1 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:48.903530 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385eb744-4dfe-46ca-9bd6-3eb842fc4d9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:48.904162 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385eb744-4dfe-46ca-9bd6-3eb842fc4d9a service neutron] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:48.904446 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385eb744-4dfe-46ca-9bd6-3eb842fc4d9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:48.904712 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385eb744-4dfe-46ca-9bd6-3eb842fc4d9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:48.914257 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385eb744-4dfe-46ca-9bd6-3eb842fc4d9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:48.915696 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385eb744-4dfe-46ca-9bd6-3eb842fc4d9a service neutron] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:48.925954 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1087/2172] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:20:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:20:49.200757 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a602042-efc0-4c8d-8288-2ea5461c6628 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:49.202310 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-9a602042-efc0-4c8d-8288-2ea5461c6628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:49.227006 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a602042-efc0-4c8d-8288-2ea5461c6628 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:49.240751 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6221a5-5e53-4a8f-9ddf-31abff815bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:49.241738 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6221a5-5e53-4a8f-9ddf-31abff815bd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:49.242089 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6221a5-5e53-4a8f-9ddf-31abff815bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:49.242432 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6221a5-5e53-4a8f-9ddf-31abff815bd8 admin admin] PATH_INFO: `/v3/projects/664d4c468c7e4ddc97894995427d449c` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:49.243783 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6221a5-5e53-4a8f-9ddf-31abff815bd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=664d4c468c7e4ddc97894995427d449c)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:49.245888 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6221a5-5e53-4a8f-9ddf-31abff815bd8 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:49.308350 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-9c6221a5-5e53-4a8f-9ddf-31abff815bd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '664d4c468c7e4ddc97894995427d449c', 'request_id': 'req-9c6221a5-5e53-4a8f-9ddf-31abff815bd8'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:49.315298 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-9c6221a5-5e53-4a8f-9ddf-31abff815bd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '664d4c468c7e4ddc97894995427d449c', 'request_id': 'req-9c6221a5-5e53-4a8f-9ddf-31abff815bd8'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:49.332350 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-9c6221a5-5e53-4a8f-9ddf-31abff815bd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '664d4c468c7e4ddc97894995427d449c', 'request_id': 'req-9c6221a5-5e53-4a8f-9ddf-31abff815bd8'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:49.343863 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-9c6221a5-5e53-4a8f-9ddf-31abff815bd8 admin admin] The token cache is being invalidate because project 664d4c468c7e4ddc97894995427d449c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:20:49.344129 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-9c6221a5-5e53-4a8f-9ddf-31abff815bd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:49.345115 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-9c6221a5-5e53-4a8f-9ddf-31abff815bd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:49.350432 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1086/2173] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:20:49 2022] DELETE /identity/v3/projects/664d4c468c7e4ddc97894995427d449c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:20:49.352071 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd564a-2985-4928-acba-796fca66b122 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:49.352445 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd564a-2985-4928-acba-796fca66b122 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:49.352781 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd564a-2985-4928-acba-796fca66b122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:49.375284 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-c8cd564a-2985-4928-acba-796fca66b122 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:49.377477 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-c8cd564a-2985-4928-acba-796fca66b122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:49.455272 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6f66f-9c1a-45e7-86aa-52482c28f540 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:49.455388 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6f66f-9c1a-45e7-86aa-52482c28f540 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:49.456869 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6f66f-9c1a-45e7-86aa-52482c28f540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:49.459482 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1088/2174] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:20:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:20:49.482672 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-61f6f66f-9c1a-45e7-86aa-52482c28f540 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:49.484679 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-61f6f66f-9c1a-45e7-86aa-52482c28f540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:49.499306 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1087/2175] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:20:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:20:49.503312 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cd564a-2985-4928-acba-796fca66b122 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:49.527458 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cd564a-2985-4928-acba-796fca66b122 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:49.545165 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3de87-1eee-438c-8d57-7cde9572d360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:49.545947 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3de87-1eee-438c-8d57-7cde9572d360 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:49.546230 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3de87-1eee-438c-8d57-7cde9572d360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:49.546503 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb3de87-1eee-438c-8d57-7cde9572d360 admin admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:49.548544 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb3de87-1eee-438c-8d57-7cde9572d360 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:20:49.552274 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb3de87-1eee-438c-8d57-7cde9572d360 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:49.553656 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb3de87-1eee-438c-8d57-7cde9572d360 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:49.584318 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1089/2176] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 17 18:20:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:20:49.585875 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6f66f-9c1a-45e7-86aa-52482c28f540 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:49.604793 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6f66f-9c1a-45e7-86aa-52482c28f540 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:49.611512 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa30528-9205-4445-9572-a1cbb4837d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:49.612341 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa30528-9205-4445-9572-a1cbb4837d9e admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:49.612629 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa30528-9205-4445-9572-a1cbb4837d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:49.612904 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa30528-9205-4445-9572-a1cbb4837d9e admin admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:49.613638 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa30528-9205-4445-9572-a1cbb4837d9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:49.616139 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa30528-9205-4445-9572-a1cbb4837d9e admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:49.684106 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1088/2177] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:20:49 2022] POST /identity/v3/projects => generated 397 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:20:49.687965 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3de87-1eee-438c-8d57-7cde9572d360 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:49.702799 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb3de87-1eee-438c-8d57-7cde9572d360 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:49.779868 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a366969-2c18-45f9-9d0c-54fa82200ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:49.780927 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a366969-2c18-45f9-9d0c-54fa82200ee2 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:49.781499 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a366969-2c18-45f9-9d0c-54fa82200ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:49.781958 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a366969-2c18-45f9-9d0c-54fa82200ee2 admin admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:49.782916 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a366969-2c18-45f9-9d0c-54fa82200ee2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:49.786066 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a366969-2c18-45f9-9d0c-54fa82200ee2 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:49.822132 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1090/2178] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:20:49 2022] POST /identity/v3/users => generated 299 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:20:49.826779 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa30528-9205-4445-9572-a1cbb4837d9e admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:49.838933 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa30528-9205-4445-9572-a1cbb4837d9e admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:49.844425 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4e113c-135e-43c0-9e00-7d877a593db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:49.845491 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e113c-135e-43c0-9e00-7d877a593db2 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:49.845966 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e113c-135e-43c0-9e00-7d877a593db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:49.846620 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e113c-135e-43c0-9e00-7d877a593db2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:49.847542 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4e113c-135e-43c0-9e00-7d877a593db2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:49.849391 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4e113c-135e-43c0-9e00-7d877a593db2 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:49.861802 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1089/2179] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:20:49.866514 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a366969-2c18-45f9-9d0c-54fa82200ee2 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:49.884603 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a366969-2c18-45f9-9d0c-54fa82200ee2 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:49.894192 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed473267-da79-4463-9b34-d61fdcc4b6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:49.895305 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed473267-da79-4463-9b34-d61fdcc4b6f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:49.895820 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed473267-da79-4463-9b34-d61fdcc4b6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:49.896314 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed473267-da79-4463-9b34-d61fdcc4b6f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:49.898406 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed473267-da79-4463-9b34-d61fdcc4b6f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:49.900573 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed473267-da79-4463-9b34-d61fdcc4b6f3 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:49.912510 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1091/2180] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:20:49.916262 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4e113c-135e-43c0-9e00-7d877a593db2 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:49.929578 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4e113c-135e-43c0-9e00-7d877a593db2 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:49.941981 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fdaa0c-3f8e-4460-a31f-65fd9cfbaf9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:49.943921 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdaa0c-3f8e-4460-a31f-65fd9cfbaf9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:49.944431 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdaa0c-3f8e-4460-a31f-65fd9cfbaf9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:49.944950 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdaa0c-3f8e-4460-a31f-65fd9cfbaf9e admin admin] PATH_INFO: `/v3/projects/0d8c9187040a475a9b20750352109b1a/users/05fee75960244f3cb1ae50bbd6e2cc07/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:49.969908 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fdaa0c-3f8e-4460-a31f-65fd9cfbaf9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d8c9187040a475a9b20750352109b1a, user_id=05fee75960244f3cb1ae50bbd6e2cc07, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:49.975095 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fdaa0c-3f8e-4460-a31f-65fd9cfbaf9e admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:50.002713 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1090/2181] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:20:49 2022] PUT /identity/v3/projects/0d8c9187040a475a9b20750352109b1a/users/05fee75960244f3cb1ae50bbd6e2cc07/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:20:50.014215 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7074bd0-f9d3-422f-91ec-aa0c0cb0ef78 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:50.014554 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7074bd0-f9d3-422f-91ec-aa0c0cb0ef78 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:50.014768 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7074bd0-f9d3-422f-91ec-aa0c0cb0ef78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:50.043900 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-f7074bd0-f9d3-422f-91ec-aa0c0cb0ef78 None None] MFA Rules not processed for user `05fee75960244f3cb1ae50bbd6e2cc07`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:50.045138 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-f7074bd0-f9d3-422f-91ec-aa0c0cb0ef78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:50.165557 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1092/2182] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:20:50 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:20:50.175170 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fdaa0c-3f8e-4460-a31f-65fd9cfbaf9e admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:50.180500 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-d7fdaa0c-3f8e-4460-a31f-65fd9cfbaf9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:50.339889 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fdaa0c-3f8e-4460-a31f-65fd9cfbaf9e admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:50.346757 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7988bf0a-8086-4c1a-a577-a95f635d1663 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:50.347601 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988bf0a-8086-4c1a-a577-a95f635d1663 service cinder] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:50.348140 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988bf0a-8086-4c1a-a577-a95f635d1663 service cinder] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:50.348520 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988bf0a-8086-4c1a-a577-a95f635d1663 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:50.364148 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7988bf0a-8086-4c1a-a577-a95f635d1663 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:50.367241 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7988bf0a-8086-4c1a-a577-a95f635d1663 service cinder] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:50.394997 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1091/2183] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:20:50 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:20:51.391952 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b53c5e-3ddb-4ce2-b0f0-50ec2236b95e None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:51.392457 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b53c5e-3ddb-4ce2-b0f0-50ec2236b95e None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:51.392549 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b53c5e-3ddb-4ce2-b0f0-50ec2236b95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:51.421295 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-b9b53c5e-3ddb-4ce2-b0f0-50ec2236b95e None None] MFA Rules not processed for user `861ad9a7c63a4d66a1806c4576cddce5`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:51.422564 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-b9b53c5e-3ddb-4ce2-b0f0-50ec2236b95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:51.492577 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1093/2184] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:20:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:20:51.497082 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7988bf0a-8086-4c1a-a577-a95f635d1663 service cinder] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:51.499231 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-7988bf0a-8086-4c1a-a577-a95f635d1663 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:51.598073 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7988bf0a-8086-4c1a-a577-a95f635d1663 service cinder] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:51.602537 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195ea39-e82a-481a-8147-dcc079817ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:51.603182 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195ea39-e82a-481a-8147-dcc079817ea6 admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:51.603460 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195ea39-e82a-481a-8147-dcc079817ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:51.603735 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195ea39-e82a-481a-8147-dcc079817ea6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:51.605058 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9195ea39-e82a-481a-8147-dcc079817ea6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:51.606989 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9195ea39-e82a-481a-8147-dcc079817ea6 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:51.636929 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1092/2185] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:20:51 2022] POST /identity/v3/projects => generated 377 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:20:51.641010 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b53c5e-3ddb-4ce2-b0f0-50ec2236b95e None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:51.652537 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b53c5e-3ddb-4ce2-b0f0-50ec2236b95e None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:51.721084 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a357809-0348-46cc-83c1-d231fb9942eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:51.721648 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a357809-0348-46cc-83c1-d231fb9942eb admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:51.722092 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a357809-0348-46cc-83c1-d231fb9942eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:51.722554 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a357809-0348-46cc-83c1-d231fb9942eb admin admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:51.723429 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a357809-0348-46cc-83c1-d231fb9942eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:51.725708 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a357809-0348-46cc-83c1-d231fb9942eb admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:51.751132 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1094/2186] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:20:51 2022] POST /identity/v3/users => generated 295 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:20:51.751832 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195ea39-e82a-481a-8147-dcc079817ea6 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:51.763094 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195ea39-e82a-481a-8147-dcc079817ea6 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:51.768579 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f131f-672b-4430-8dc8-abaf7da469ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:51.769566 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f131f-672b-4430-8dc8-abaf7da469ed admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:51.770010 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f131f-672b-4430-8dc8-abaf7da469ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:51.770445 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f131f-672b-4430-8dc8-abaf7da469ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:51.771212 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269f131f-672b-4430-8dc8-abaf7da469ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:51.772818 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269f131f-672b-4430-8dc8-abaf7da469ed admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:51.787399 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1093/2187] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:20:51.791692 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a357809-0348-46cc-83c1-d231fb9942eb admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:51.801951 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a357809-0348-46cc-83c1-d231fb9942eb admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:51.806730 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8c8ea-2f99-46b4-a1b5-145995b54b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:51.807647 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8c8ea-2f99-46b4-a1b5-145995b54b01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:51.807921 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8c8ea-2f99-46b4-a1b5-145995b54b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:51.808192 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8c8ea-2f99-46b4-a1b5-145995b54b01 admin admin] PATH_INFO: `/v3/projects/6edf841a0b4248e195da08dd36e0a2c4/users/c2b1e7ccc3d14112b928c3bd3f2c8e1c/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:51.824460 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd8c8ea-2f99-46b4-a1b5-145995b54b01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6edf841a0b4248e195da08dd36e0a2c4, user_id=c2b1e7ccc3d14112b928c3bd3f2c8e1c, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:51.827283 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd8c8ea-2f99-46b4-a1b5-145995b54b01 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:51.844188 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1095/2188] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:20:51 2022] PUT /identity/v3/projects/6edf841a0b4248e195da08dd36e0a2c4/users/c2b1e7ccc3d14112b928c3bd3f2c8e1c/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:20:51.848341 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f131f-672b-4430-8dc8-abaf7da469ed admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:51.858185 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f131f-672b-4430-8dc8-abaf7da469ed admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:51.915503 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4980af-42f6-480b-9d25-4ad51cfe637f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:51.916169 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4980af-42f6-480b-9d25-4ad51cfe637f admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:51.918247 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4980af-42f6-480b-9d25-4ad51cfe637f admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:51.918247 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4980af-42f6-480b-9d25-4ad51cfe637f admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:51.918247 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4980af-42f6-480b-9d25-4ad51cfe637f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:51.919131 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4980af-42f6-480b-9d25-4ad51cfe637f admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:51.929506 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1094/2189] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:20:51 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:20:51.933850 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8c8ea-2f99-46b4-a1b5-145995b54b01 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:51.945201 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8c8ea-2f99-46b4-a1b5-145995b54b01 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:51.950825 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea842b1-6c25-4117-8865-e5e4c587c889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:51.951701 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea842b1-6c25-4117-8865-e5e4c587c889 admin admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:51.951980 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea842b1-6c25-4117-8865-e5e4c587c889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:51.952253 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea842b1-6c25-4117-8865-e5e4c587c889 admin admin] PATH_INFO: `/v3/projects/6edf841a0b4248e195da08dd36e0a2c4/users/c2b1e7ccc3d14112b928c3bd3f2c8e1c/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:51.954328 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea842b1-6c25-4117-8865-e5e4c587c889 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6edf841a0b4248e195da08dd36e0a2c4, user_id=c2b1e7ccc3d14112b928c3bd3f2c8e1c, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:51.957103 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea842b1-6c25-4117-8865-e5e4c587c889 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:51.968496 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1096/2190] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:20:51 2022] PUT /identity/v3/projects/6edf841a0b4248e195da08dd36e0a2c4/users/c2b1e7ccc3d14112b928c3bd3f2c8e1c/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:20:56.534929 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb4c2a-e632-48e7-acca-49a6c62845f4 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:56.535461 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb4c2a-e632-48e7-acca-49a6c62845f4 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:56.535686 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb4c2a-e632-48e7-acca-49a6c62845f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:56.572697 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-0fcb4c2a-e632-48e7-acca-49a6c62845f4 None None] MFA Rules not processed for user `c2b1e7ccc3d14112b928c3bd3f2c8e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:56.574491 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-0fcb4c2a-e632-48e7-acca-49a6c62845f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:56.677050 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1095/2191] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:20:56 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:20:56.691762 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea842b1-6c25-4117-8865-e5e4c587c889 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:56.693604 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-cea842b1-6c25-4117-8865-e5e4c587c889 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:56.801800 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea842b1-6c25-4117-8865-e5e4c587c889 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:56.812344 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2df6b57-d11b-4ece-80b1-46f57f6e2f44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b430b739cb54fc7911bc89f8ea2df72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:56.813011 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df6b57-d11b-4ece-80b1-46f57f6e2f44 service nova] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:56.813294 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df6b57-d11b-4ece-80b1-46f57f6e2f44 service nova] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:56.813620 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df6b57-d11b-4ece-80b1-46f57f6e2f44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:56.875083 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2df6b57-d11b-4ece-80b1-46f57f6e2f44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:56.876959 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2df6b57-d11b-4ece-80b1-46f57f6e2f44 service nova] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:56.886868 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1097/2192] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:20:56 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:21:05.564224 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7bc2f-709c-48c3-99d2-305f0d6ed16f None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:05.564809 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7bc2f-709c-48c3-99d2-305f0d6ed16f None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:05.564809 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7bc2f-709c-48c3-99d2-305f0d6ed16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:05.586882 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-bbf7bc2f-709c-48c3-99d2-305f0d6ed16f None None] MFA Rules not processed for user `8dc55bbbc4a544909a8c80d9638c3ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:21:05.587759 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-bbf7bc2f-709c-48c3-99d2-305f0d6ed16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:21:05.649658 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1096/2193] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:21:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:21:07.148100 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2df6b57-d11b-4ece-80b1-46f57f6e2f44 service nova] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:21:07.212820 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2df6b57-d11b-4ece-80b1-46f57f6e2f44 service nova] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:21:07.217565 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d106f60a-0674-4e42-ba09-1acb67227067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:21:07.218454 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106f60a-0674-4e42-ba09-1acb67227067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:07.218730 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106f60a-0674-4e42-ba09-1acb67227067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:07.218999 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106f60a-0674-4e42-ba09-1acb67227067 admin admin] PATH_INFO: `/v3/users/05fee75960244f3cb1ae50bbd6e2cc07` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:07.220186 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d106f60a-0674-4e42-ba09-1acb67227067 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05fee75960244f3cb1ae50bbd6e2cc07)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:21:07.222152 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d106f60a-0674-4e42-ba09-1acb67227067 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:21:07.269121 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-d106f60a-0674-4e42-ba09-1acb67227067 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05fee75960244f3cb1ae50bbd6e2cc07'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:21:07.282780 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-d106f60a-0674-4e42-ba09-1acb67227067 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05fee75960244f3cb1ae50bbd6e2cc07'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:21:07.283515 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-d106f60a-0674-4e42-ba09-1acb67227067 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05fee75960244f3cb1ae50bbd6e2cc07'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:21:07.284286 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-d106f60a-0674-4e42-ba09-1acb67227067 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05fee75960244f3cb1ae50bbd6e2cc07'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:21:07.292208 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-d106f60a-0674-4e42-ba09-1acb67227067 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05fee75960244f3cb1ae50bbd6e2cc07'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:21:07.306058 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1098/2194] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:21:07 2022] DELETE /identity/v3/users/05fee75960244f3cb1ae50bbd6e2cc07 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:21:07.310884 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13725edd-e4fc-4ee9-960d-68ebdce00155 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:07.311388 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13725edd-e4fc-4ee9-960d-68ebdce00155 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:07.311586 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13725edd-e4fc-4ee9-960d-68ebdce00155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:07.329544 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-13725edd-e4fc-4ee9-960d-68ebdce00155 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:21:07.330830 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-13725edd-e4fc-4ee9-960d-68ebdce00155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:21:07.391465 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1097/2195] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:21:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:21:07.403645 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d106f60a-0674-4e42-ba09-1acb67227067 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:21:07.405283 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-d106f60a-0674-4e42-ba09-1acb67227067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:21:07.472954 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d106f60a-0674-4e42-ba09-1acb67227067 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:21:07.477082 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98071eef-d5a7-439b-9c6c-16e3e3455c3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:21:07.479344 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98071eef-d5a7-439b-9c6c-16e3e3455c3d service neutron] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:07.479344 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98071eef-d5a7-439b-9c6c-16e3e3455c3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:07.479790 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98071eef-d5a7-439b-9c6c-16e3e3455c3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:07.495390 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98071eef-d5a7-439b-9c6c-16e3e3455c3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:21:07.497265 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98071eef-d5a7-439b-9c6c-16e3e3455c3d service neutron] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:21:07.513046 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1099/2196] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:21:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:21:07.859382 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13725edd-e4fc-4ee9-960d-68ebdce00155 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:21:07.861008 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-13725edd-e4fc-4ee9-960d-68ebdce00155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:21:07.875936 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13725edd-e4fc-4ee9-960d-68ebdce00155 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:21:07.881873 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82949f5-948e-491b-bd0f-3f86a29407f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:21:07.882866 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82949f5-948e-491b-bd0f-3f86a29407f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:07.883222 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82949f5-948e-491b-bd0f-3f86a29407f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:07.883637 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82949f5-948e-491b-bd0f-3f86a29407f9 admin admin] PATH_INFO: `/v3/projects/0d8c9187040a475a9b20750352109b1a` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:07.885853 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82949f5-948e-491b-bd0f-3f86a29407f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d8c9187040a475a9b20750352109b1a)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:21:07.888309 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82949f5-948e-491b-bd0f-3f86a29407f9 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:21:07.937868 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-a82949f5-948e-491b-bd0f-3f86a29407f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d8c9187040a475a9b20750352109b1a', 'request_id': 'req-a82949f5-948e-491b-bd0f-3f86a29407f9'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:21:07.946273 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-a82949f5-948e-491b-bd0f-3f86a29407f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d8c9187040a475a9b20750352109b1a', 'request_id': 'req-a82949f5-948e-491b-bd0f-3f86a29407f9'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:21:07.954910 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-a82949f5-948e-491b-bd0f-3f86a29407f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d8c9187040a475a9b20750352109b1a', 'request_id': 'req-a82949f5-948e-491b-bd0f-3f86a29407f9'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:21:07.965879 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-a82949f5-948e-491b-bd0f-3f86a29407f9 admin admin] The token cache is being invalidate because project 0d8c9187040a475a9b20750352109b1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:21:07.966163 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-a82949f5-948e-491b-bd0f-3f86a29407f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:21:07.966778 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-a82949f5-948e-491b-bd0f-3f86a29407f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:21:07.968322 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1098/2197] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:21:07 2022] DELETE /identity/v3/projects/0d8c9187040a475a9b20750352109b1a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:21:28.759943 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032aba7-e209-469c-b81f-538f32b3518b None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:28.760506 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032aba7-e209-469c-b81f-538f32b3518b None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:28.760506 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2032aba7-e209-469c-b81f-538f32b3518b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:28.777448 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-2032aba7-e209-469c-b81f-538f32b3518b None None] MFA Rules not processed for user `861ad9a7c63a4d66a1806c4576cddce5`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:21:28.778663 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-2032aba7-e209-469c-b81f-538f32b3518b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:21:28.833018 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1100/2198] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:21:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:22:00.016574 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82949f5-948e-491b-bd0f-3f86a29407f9 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:22:00.018015 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-a82949f5-948e-491b-bd0f-3f86a29407f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:22:00.072553 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82949f5-948e-491b-bd0f-3f86a29407f9 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:22:00.076335 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396cd689-ad8b-40fb-88b3-000c4fa448d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:22:00.076954 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396cd689-ad8b-40fb-88b3-000c4fa448d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:00.077228 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396cd689-ad8b-40fb-88b3-000c4fa448d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:00.077528 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396cd689-ad8b-40fb-88b3-000c4fa448d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:00.079219 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-396cd689-ad8b-40fb-88b3-000c4fa448d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:22:00.138658 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396cd689-ad8b-40fb-88b3-000c4fa448d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:22:00.140077 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396cd689-ad8b-40fb-88b3-000c4fa448d7 service neutron] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:22:00.149323 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1099/2199] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:22:00 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:22:16.964318 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2032aba7-e209-469c-b81f-538f32b3518b None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:22:16.965895 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-2032aba7-e209-469c-b81f-538f32b3518b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:22:17.033758 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2032aba7-e209-469c-b81f-538f32b3518b None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:22:17.038481 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee826dca-bede-4711-a469-1321992dfb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:22:17.039538 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee826dca-bede-4711-a469-1321992dfb2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:17.039813 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee826dca-bede-4711-a469-1321992dfb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:17.040081 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee826dca-bede-4711-a469-1321992dfb2d admin admin] PATH_INFO: `/v3/users/8dc55bbbc4a544909a8c80d9638c3ea6` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:17.041256 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee826dca-bede-4711-a469-1321992dfb2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dc55bbbc4a544909a8c80d9638c3ea6)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:22:17.043231 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee826dca-bede-4711-a469-1321992dfb2d admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:22:17.087939 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-ee826dca-bede-4711-a469-1321992dfb2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dc55bbbc4a544909a8c80d9638c3ea6'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:22:17.099770 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-ee826dca-bede-4711-a469-1321992dfb2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dc55bbbc4a544909a8c80d9638c3ea6'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:22:17.100427 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-ee826dca-bede-4711-a469-1321992dfb2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dc55bbbc4a544909a8c80d9638c3ea6'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:22:17.101026 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-ee826dca-bede-4711-a469-1321992dfb2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dc55bbbc4a544909a8c80d9638c3ea6'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:22:17.107601 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-ee826dca-bede-4711-a469-1321992dfb2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dc55bbbc4a544909a8c80d9638c3ea6'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:22:17.119449 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1101/2200] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:22:16 2022] DELETE /identity/v3/users/8dc55bbbc4a544909a8c80d9638c3ea6 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:22:17.289141 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396cd689-ad8b-40fb-88b3-000c4fa448d7 service neutron] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:22:17.299876 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396cd689-ad8b-40fb-88b3-000c4fa448d7 service neutron] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:22:17.358381 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51464a38-ed14-444c-b6e1-54dd5880dda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:22:17.359505 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51464a38-ed14-444c-b6e1-54dd5880dda8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:17.359812 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51464a38-ed14-444c-b6e1-54dd5880dda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:17.360082 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51464a38-ed14-444c-b6e1-54dd5880dda8 admin admin] PATH_INFO: `/v3/projects/80d1667aeb814212abe473f58d0ff420` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:17.361250 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51464a38-ed14-444c-b6e1-54dd5880dda8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80d1667aeb814212abe473f58d0ff420)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:22:17.363158 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51464a38-ed14-444c-b6e1-54dd5880dda8 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:22:17.410901 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-51464a38-ed14-444c-b6e1-54dd5880dda8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80d1667aeb814212abe473f58d0ff420', 'request_id': 'req-51464a38-ed14-444c-b6e1-54dd5880dda8'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:22:17.417375 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-51464a38-ed14-444c-b6e1-54dd5880dda8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80d1667aeb814212abe473f58d0ff420', 'request_id': 'req-51464a38-ed14-444c-b6e1-54dd5880dda8'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:22:17.425175 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-51464a38-ed14-444c-b6e1-54dd5880dda8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80d1667aeb814212abe473f58d0ff420', 'request_id': 'req-51464a38-ed14-444c-b6e1-54dd5880dda8'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:22:17.435959 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-51464a38-ed14-444c-b6e1-54dd5880dda8 admin admin] The token cache is being invalidate because project 80d1667aeb814212abe473f58d0ff420 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:22:17.436294 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-51464a38-ed14-444c-b6e1-54dd5880dda8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:22:17.436935 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-51464a38-ed14-444c-b6e1-54dd5880dda8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:22:17.438510 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1100/2201] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:22:17 2022] DELETE /identity/v3/projects/80d1667aeb814212abe473f58d0ff420 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:22:17.443708 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66338b-4651-4c65-be68-f241d87f032f None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:17.444079 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66338b-4651-4c65-be68-f241d87f032f None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:17.444422 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66338b-4651-4c65-be68-f241d87f032f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:17.463158 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-1b66338b-4651-4c65-be68-f241d87f032f None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:22:17.464379 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-1b66338b-4651-4c65-be68-f241d87f032f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:22:17.520430 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1102/2202] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:22:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:22:17.527986 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b32d7a-a317-496d-b85d-6afdbb106294 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:17.528267 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b32d7a-a317-496d-b85d-6afdbb106294 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:17.528536 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b32d7a-a317-496d-b85d-6afdbb106294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:17.545987 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-45b32d7a-a317-496d-b85d-6afdbb106294 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:22:17.547097 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-45b32d7a-a317-496d-b85d-6afdbb106294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:22:17.554672 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1101/2203] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:22:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:22:17.559344 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66338b-4651-4c65-be68-f241d87f032f None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:22:17.569759 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66338b-4651-4c65-be68-f241d87f032f None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:22:17.575207 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c94685a-855c-4430-8d17-31d921a17cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:22:17.575848 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94685a-855c-4430-8d17-31d921a17cc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:17.576132 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94685a-855c-4430-8d17-31d921a17cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:17.576405 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94685a-855c-4430-8d17-31d921a17cc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:17.577126 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c94685a-855c-4430-8d17-31d921a17cc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:22:17.577433 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c94685a-855c-4430-8d17-31d921a17cc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:22:17.579072 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c94685a-855c-4430-8d17-31d921a17cc6 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:22:17.590272 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1103/2204] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 17 18:22:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:22:17.594331 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b32d7a-a317-496d-b85d-6afdbb106294 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:22:17.603402 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b32d7a-a317-496d-b85d-6afdbb106294 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:22:17.608582 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126980ef-a510-4e53-9588-22ada8f86f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:22:17.609248 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126980ef-a510-4e53-9588-22ada8f86f03 admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:17.609555 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126980ef-a510-4e53-9588-22ada8f86f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:17.609830 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126980ef-a510-4e53-9588-22ada8f86f03 admin admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:17.610507 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126980ef-a510-4e53-9588-22ada8f86f03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:22:17.612375 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126980ef-a510-4e53-9588-22ada8f86f03 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:22:17.636911 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1102/2205] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:22:17 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:22:17.640756 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c94685a-855c-4430-8d17-31d921a17cc6 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:22:17.650401 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c94685a-855c-4430-8d17-31d921a17cc6 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:22:17.728487 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af04761-e2f9-4d20-9679-d9ac33f13c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:22:17.729671 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af04761-e2f9-4d20-9679-d9ac33f13c49 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:17.729953 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af04761-e2f9-4d20-9679-d9ac33f13c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:17.730227 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af04761-e2f9-4d20-9679-d9ac33f13c49 admin admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:17.730924 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af04761-e2f9-4d20-9679-d9ac33f13c49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:22:17.732941 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af04761-e2f9-4d20-9679-d9ac33f13c49 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:22:17.752510 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1104/2206] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:22:17 2022] POST /identity/v3/users => generated 293 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:22:17.756612 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126980ef-a510-4e53-9588-22ada8f86f03 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:22:17.766732 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126980ef-a510-4e53-9588-22ada8f86f03 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:22:17.771209 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf98544-cb21-412b-aa03-6fb107afcdcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:22:17.771855 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf98544-cb21-412b-aa03-6fb107afcdcf admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:17.772120 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf98544-cb21-412b-aa03-6fb107afcdcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:17.772391 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf98544-cb21-412b-aa03-6fb107afcdcf admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:17.773100 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf98544-cb21-412b-aa03-6fb107afcdcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:22:17.774805 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf98544-cb21-412b-aa03-6fb107afcdcf admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:22:17.784888 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1103/2207] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:22:17.788994 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af04761-e2f9-4d20-9679-d9ac33f13c49 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:22:17.799311 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af04761-e2f9-4d20-9679-d9ac33f13c49 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:22:17.803830 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec4a6e-29a8-41d4-9008-85d795e1d983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:22:17.804468 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec4a6e-29a8-41d4-9008-85d795e1d983 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:17.804749 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec4a6e-29a8-41d4-9008-85d795e1d983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:17.805026 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec4a6e-29a8-41d4-9008-85d795e1d983 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:17.805787 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ec4a6e-29a8-41d4-9008-85d795e1d983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:22:17.808147 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ec4a6e-29a8-41d4-9008-85d795e1d983 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:22:17.817823 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1105/2208] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:22:17.822010 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf98544-cb21-412b-aa03-6fb107afcdcf admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:22:17.831892 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf98544-cb21-412b-aa03-6fb107afcdcf admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:22:17.836404 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d056ed-039a-4fb3-9da1-38beed79fd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:22:17.837261 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d056ed-039a-4fb3-9da1-38beed79fd02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:17.837564 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d056ed-039a-4fb3-9da1-38beed79fd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:17.837840 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d056ed-039a-4fb3-9da1-38beed79fd02 admin admin] PATH_INFO: `/v3/projects/271959139e4a4e058a5a56cbdfc8cdcb/users/5dee3ac46621470a9b5fac6574820e93/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:17.851988 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d056ed-039a-4fb3-9da1-38beed79fd02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=271959139e4a4e058a5a56cbdfc8cdcb, user_id=5dee3ac46621470a9b5fac6574820e93, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:22:17.855168 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d056ed-039a-4fb3-9da1-38beed79fd02 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:22:17.867688 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1104/2209] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:22:17 2022] PUT /identity/v3/projects/271959139e4a4e058a5a56cbdfc8cdcb/users/5dee3ac46621470a9b5fac6574820e93/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:22:17.873289 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963d43d-156c-4fe2-a46d-df2c18aff53c None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:17.873612 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963d43d-156c-4fe2-a46d-df2c18aff53c None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:17.873892 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963d43d-156c-4fe2-a46d-df2c18aff53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:17.891096 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-c963d43d-156c-4fe2-a46d-df2c18aff53c None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:22:17.892875 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-c963d43d-156c-4fe2-a46d-df2c18aff53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:22:17.950929 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1106/2210] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:22:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:22:17.960578 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d056ed-039a-4fb3-9da1-38beed79fd02 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:22:17.962345 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-d3d056ed-039a-4fb3-9da1-38beed79fd02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:22:18.024804 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d056ed-039a-4fb3-9da1-38beed79fd02 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:22:18.029138 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc39b576-4ea6-47d9-97db-9aad14970ec8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:22:18.029800 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39b576-4ea6-47d9-97db-9aad14970ec8 service neutron] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:18.030078 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39b576-4ea6-47d9-97db-9aad14970ec8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:18.030347 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39b576-4ea6-47d9-97db-9aad14970ec8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:18.039300 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc39b576-4ea6-47d9-97db-9aad14970ec8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:22:18.040798 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc39b576-4ea6-47d9-97db-9aad14970ec8 service neutron] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:22:18.052178 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1105/2211] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:22:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:22:22.317523 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead06311-0202-4e5c-95c0-503f8bdb04a8 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:22.318067 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead06311-0202-4e5c-95c0-503f8bdb04a8 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:22.318067 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead06311-0202-4e5c-95c0-503f8bdb04a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:22.346452 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-ead06311-0202-4e5c-95c0-503f8bdb04a8 None None] MFA Rules not processed for user `5dee3ac46621470a9b5fac6574820e93`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:22:22.347668 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-ead06311-0202-4e5c-95c0-503f8bdb04a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:22:22.413994 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1107/2212] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:22:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:22:22.418978 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc39b576-4ea6-47d9-97db-9aad14970ec8 service neutron] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:22:22.428811 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc39b576-4ea6-47d9-97db-9aad14970ec8 service neutron] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:22:22.434176 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f6bf2-c7bc-49d8-ae38-b1dd651f2f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:22:22.434832 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f6bf2-c7bc-49d8-ae38-b1dd651f2f51 admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:22.435109 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f6bf2-c7bc-49d8-ae38-b1dd651f2f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:22.435381 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f6bf2-c7bc-49d8-ae38-b1dd651f2f51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:22.436077 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69f6bf2-c7bc-49d8-ae38-b1dd651f2f51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:22:22.438106 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69f6bf2-c7bc-49d8-ae38-b1dd651f2f51 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:22:22.469921 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1106/2213] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:22:22 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:22:22.470979 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead06311-0202-4e5c-95c0-503f8bdb04a8 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:22:22.482733 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead06311-0202-4e5c-95c0-503f8bdb04a8 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:22:22.540454 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e41d2c-1d19-4967-86a6-33235ef290fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:22:22.541151 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e41d2c-1d19-4967-86a6-33235ef290fd admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:22.542075 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e41d2c-1d19-4967-86a6-33235ef290fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:22.542350 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e41d2c-1d19-4967-86a6-33235ef290fd admin admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:22.543072 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e41d2c-1d19-4967-86a6-33235ef290fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:22:22.544933 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e41d2c-1d19-4967-86a6-33235ef290fd admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:22:22.564079 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1108/2214] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:22:22 2022] POST /identity/v3/users => generated 298 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:22:22.568218 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f6bf2-c7bc-49d8-ae38-b1dd651f2f51 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:22:22.579588 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f6bf2-c7bc-49d8-ae38-b1dd651f2f51 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:22:22.584971 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6dbf22-2311-487d-a07c-c48659fd11f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:22:22.585680 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6dbf22-2311-487d-a07c-c48659fd11f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:22.585963 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6dbf22-2311-487d-a07c-c48659fd11f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:22.586235 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6dbf22-2311-487d-a07c-c48659fd11f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:22.586967 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6dbf22-2311-487d-a07c-c48659fd11f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:22:22.589070 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6dbf22-2311-487d-a07c-c48659fd11f9 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:22:22.600426 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1107/2215] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:22:22.605302 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e41d2c-1d19-4967-86a6-33235ef290fd admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:22:22.615329 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e41d2c-1d19-4967-86a6-33235ef290fd admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:22:22.620045 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41122b4c-2d5b-414c-a5e9-fbc268e32dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:22:22.620926 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41122b4c-2d5b-414c-a5e9-fbc268e32dff admin admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:22.621199 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41122b4c-2d5b-414c-a5e9-fbc268e32dff admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:22.621487 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41122b4c-2d5b-414c-a5e9-fbc268e32dff admin admin] PATH_INFO: `/v3/projects/298c01b6cb2c4ba08a12e93476db8a04/users/6eab80ec1143481a8338b060bb1433d9/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:22.635668 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41122b4c-2d5b-414c-a5e9-fbc268e32dff admin admin] RBAC: Authorizing `identity:create_grant(project_id=298c01b6cb2c4ba08a12e93476db8a04, user_id=6eab80ec1143481a8338b060bb1433d9, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:22:22.638322 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41122b4c-2d5b-414c-a5e9-fbc268e32dff admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:22:22.651304 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1109/2216] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:22:22 2022] PUT /identity/v3/projects/298c01b6cb2c4ba08a12e93476db8a04/users/6eab80ec1143481a8338b060bb1433d9/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:22:22.655161 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6dbf22-2311-487d-a07c-c48659fd11f9 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:22:22.664734 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6dbf22-2311-487d-a07c-c48659fd11f9 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:22:22.728473 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca87a11-1a82-4bfd-9a09-af8a55504fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:22:22.729679 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca87a11-1a82-4bfd-9a09-af8a55504fc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:22.729955 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca87a11-1a82-4bfd-9a09-af8a55504fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:22.730219 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca87a11-1a82-4bfd-9a09-af8a55504fc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:22.730921 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca87a11-1a82-4bfd-9a09-af8a55504fc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:22:22.732498 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca87a11-1a82-4bfd-9a09-af8a55504fc8 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:22:22.741835 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1108/2217] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:22:22.746063 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41122b4c-2d5b-414c-a5e9-fbc268e32dff admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:22:22.756223 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41122b4c-2d5b-414c-a5e9-fbc268e32dff admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:22:22.760816 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8b76ee-101f-45e3-8f8b-04d0ce9415ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:22:22.761731 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b76ee-101f-45e3-8f8b-04d0ce9415ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:22.762011 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b76ee-101f-45e3-8f8b-04d0ce9415ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:22.762284 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8b76ee-101f-45e3-8f8b-04d0ce9415ba admin admin] PATH_INFO: `/v3/projects/298c01b6cb2c4ba08a12e93476db8a04/users/6eab80ec1143481a8338b060bb1433d9/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:22.764227 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8b76ee-101f-45e3-8f8b-04d0ce9415ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=298c01b6cb2c4ba08a12e93476db8a04, user_id=6eab80ec1143481a8338b060bb1433d9, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:22:22.766892 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8b76ee-101f-45e3-8f8b-04d0ce9415ba admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:22:22.777436 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1110/2218] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:22:22 2022] PUT /identity/v3/projects/298c01b6cb2c4ba08a12e93476db8a04/users/6eab80ec1143481a8338b060bb1433d9/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:22:27.571971 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3330f-74fc-40e7-94ec-19e4a33a5c27 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:27.573124 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3330f-74fc-40e7-94ec-19e4a33a5c27 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:27.573303 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3330f-74fc-40e7-94ec-19e4a33a5c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:27.624798 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-50c3330f-74fc-40e7-94ec-19e4a33a5c27 None None] MFA Rules not processed for user `6eab80ec1143481a8338b060bb1433d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:22:27.638704 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-50c3330f-74fc-40e7-94ec-19e4a33a5c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:22:27.766671 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1109/2219] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:22:27 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:22:27.779622 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8b76ee-101f-45e3-8f8b-04d0ce9415ba admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:22:27.782194 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-2a8b76ee-101f-45e3-8f8b-04d0ce9415ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:22:27.877710 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8b76ee-101f-45e3-8f8b-04d0ce9415ba admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:22:27.887418 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f572c52b-9546-4946-8971-2ce91aacdf49 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce570634a66b45158d940151828f533a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:22:27.888138 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f572c52b-9546-4946-8971-2ce91aacdf49 service glance] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:27.888421 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f572c52b-9546-4946-8971-2ce91aacdf49 service glance] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:27.888881 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f572c52b-9546-4946-8971-2ce91aacdf49 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:27.956524 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f572c52b-9546-4946-8971-2ce91aacdf49 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:22:27.957798 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f572c52b-9546-4946-8971-2ce91aacdf49 service glance] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:22:27.967753 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1111/2220] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:22:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:22:28.079979 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f466c42-5361-41bb-8565-dca7ecaba018 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:28.080265 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f466c42-5361-41bb-8565-dca7ecaba018 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:28.080541 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f466c42-5361-41bb-8565-dca7ecaba018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:28.143189 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-9f466c42-5361-41bb-8565-dca7ecaba018 None None] MFA Rules not processed for user `f370e353067848b5843c5650183be347`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:22:28.144391 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-9f466c42-5361-41bb-8565-dca7ecaba018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:22:28.217638 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f572c52b-9546-4946-8971-2ce91aacdf49 service glance] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:22:28.237971 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1110/2221] 10.222.0.65 () {58 vars in 1009 bytes} [Tue May 17 18:22:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:22:28.292402 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f466c42-5361-41bb-8565-dca7ecaba018 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:22:28.294604 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-9f466c42-5361-41bb-8565-dca7ecaba018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:22:28.302615 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f572c52b-9546-4946-8971-2ce91aacdf49 service glance] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:22:28.308327 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8b067-b94f-4417-9340-43b60b57e4f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:22:28.308977 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8b067-b94f-4417-9340-43b60b57e4f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:28.309416 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8b067-b94f-4417-9340-43b60b57e4f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:28.309875 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8b067-b94f-4417-9340-43b60b57e4f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:28.312060 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-54d8b067-b94f-4417-9340-43b60b57e4f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:22:28.418280 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d8b067-b94f-4417-9340-43b60b57e4f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:22:28.419744 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d8b067-b94f-4417-9340-43b60b57e4f8 service neutron] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:22:28.433013 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1112/2222] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:22:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:22:28.442847 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f466c42-5361-41bb-8565-dca7ecaba018 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:22:28.448896 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0edfb41-4a39-45f6-99c0-977529a5a36b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1464e84a3a2d4321a98b98d398bc7be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:22:28.449914 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0edfb41-4a39-45f6-99c0-977529a5a36b service swift] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:28.450257 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0edfb41-4a39-45f6-99c0-977529a5a36b service swift] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:28.450592 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0edfb41-4a39-45f6-99c0-977529a5a36b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:28.459585 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0edfb41-4a39-45f6-99c0-977529a5a36b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:22:28.461236 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0edfb41-4a39-45f6-99c0-977529a5a36b service swift] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:22:28.471355 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1111/2223] 10.222.0.65 () {60 vars in 1384 bytes} [Tue May 17 18:22:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 17 18:22:29.653716 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8b067-b94f-4417-9340-43b60b57e4f8 service neutron] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:22:29.675167 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8b067-b94f-4417-9340-43b60b57e4f8 service neutron] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:22:29.686050 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f199b448-f450-4445-a624-9e2c37f2e130 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:22:29.686744 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199b448-f450-4445-a624-9e2c37f2e130 service neutron] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:29.687021 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199b448-f450-4445-a624-9e2c37f2e130 service neutron] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:29.687292 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199b448-f450-4445-a624-9e2c37f2e130 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:29.694848 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-f199b448-f450-4445-a624-9e2c37f2e130 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:22:29.720671 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f199b448-f450-4445-a624-9e2c37f2e130 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:22:29.725440 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f199b448-f450-4445-a624-9e2c37f2e130 service neutron] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:22:29.749872 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1113/2224] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:22:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:22:36.648556 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9555c-6a8b-4b68-870e-f403d1553643 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:36.649082 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9555c-6a8b-4b68-870e-f403d1553643 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:36.649221 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9555c-6a8b-4b68-870e-f403d1553643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:36.668766 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-eef9555c-6a8b-4b68-870e-f403d1553643 None None] MFA Rules not processed for user `13b4ec46d3cb49faba3f063dcfd644c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:22:36.670003 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-eef9555c-6a8b-4b68-870e-f403d1553643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:22:36.729953 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1112/2225] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:22:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:22:37.512669 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f199b448-f450-4445-a624-9e2c37f2e130 service neutron] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:22:37.514772 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-f199b448-f450-4445-a624-9e2c37f2e130 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:22:37.596613 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f199b448-f450-4445-a624-9e2c37f2e130 service neutron] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:22:37.610261 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba2e3a-1cf8-4471-99e8-06bbcfd49843 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ddf11ac3e14d03b1159868b3b73fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:22:37.611122 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba2e3a-1cf8-4471-99e8-06bbcfd49843 service placement] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:37.611405 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba2e3a-1cf8-4471-99e8-06bbcfd49843 service placement] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:37.611679 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba2e3a-1cf8-4471-99e8-06bbcfd49843 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:37.613749 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-5aba2e3a-1cf8-4471-99e8-06bbcfd49843 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:22:37.626566 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aba2e3a-1cf8-4471-99e8-06bbcfd49843 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:22:37.628314 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aba2e3a-1cf8-4471-99e8-06bbcfd49843 service placement] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:22:37.639488 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1114/2226] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:22:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:22:37.656163 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a0ec8-590e-4db8-85db-1003756537ee None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:37.656666 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a0ec8-590e-4db8-85db-1003756537ee None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:37.656777 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a0ec8-590e-4db8-85db-1003756537ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:37.673542 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-4d2a0ec8-590e-4db8-85db-1003756537ee None None] MFA Rules not processed for user `5dee3ac46621470a9b5fac6574820e93`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:22:37.674732 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-4d2a0ec8-590e-4db8-85db-1003756537ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:22:37.686072 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1113/2227] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:22:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:22:37.940052 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba2e3a-1cf8-4471-99e8-06bbcfd49843 service placement] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:22:37.949084 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba2e3a-1cf8-4471-99e8-06bbcfd49843 service placement] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:22:37.953041 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee6e9b3-6fbb-4005-999b-6fef58dc3ca0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:22:37.953826 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6e9b3-6fbb-4005-999b-6fef58dc3ca0 service neutron] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:37.954108 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6e9b3-6fbb-4005-999b-6fef58dc3ca0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:37.954398 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee6e9b3-6fbb-4005-999b-6fef58dc3ca0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:37.956309 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-8ee6e9b3-6fbb-4005-999b-6fef58dc3ca0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:22:37.966982 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee6e9b3-6fbb-4005-999b-6fef58dc3ca0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:22:37.968536 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee6e9b3-6fbb-4005-999b-6fef58dc3ca0 service neutron] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:22:37.977109 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1115/2228] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:22:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:22:39.660593 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28fd37-d4b6-41a7-95e9-40314f4bca93 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:39.661131 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28fd37-d4b6-41a7-95e9-40314f4bca93 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:39.661131 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28fd37-d4b6-41a7-95e9-40314f4bca93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:39.703307 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-df28fd37-d4b6-41a7-95e9-40314f4bca93 None None] MFA Rules not processed for user `f370e353067848b5843c5650183be347`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:22:39.707718 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-df28fd37-d4b6-41a7-95e9-40314f4bca93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:22:39.729380 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1114/2229] 10.222.0.65 () {58 vars in 1009 bytes} [Tue May 17 18:22:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:22:39.750226 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee6e9b3-6fbb-4005-999b-6fef58dc3ca0 service neutron] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:22:39.770192 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee6e9b3-6fbb-4005-999b-6fef58dc3ca0 service neutron] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:22:39.781222 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f976475f-50bd-41a2-a7f1-06c236c1c3cf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1464e84a3a2d4321a98b98d398bc7be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:22:39.781921 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976475f-50bd-41a2-a7f1-06c236c1c3cf service swift] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:39.782631 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976475f-50bd-41a2-a7f1-06c236c1c3cf service swift] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:39.786061 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976475f-50bd-41a2-a7f1-06c236c1c3cf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:39.796472 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f976475f-50bd-41a2-a7f1-06c236c1c3cf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:22:39.799309 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f976475f-50bd-41a2-a7f1-06c236c1c3cf service swift] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:22:39.809714 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1116/2230] 10.222.0.65 () {60 vars in 1384 bytes} [Tue May 17 18:22:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 18:22:44.687050 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28fd37-d4b6-41a7-95e9-40314f4bca93 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:22:44.688586 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-df28fd37-d4b6-41a7-95e9-40314f4bca93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:22:44.704329 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28fd37-d4b6-41a7-95e9-40314f4bca93 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:22:44.710739 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbe0658-b642-49af-b2df-91d5756ac488 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b430b739cb54fc7911bc89f8ea2df72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:22:44.711472 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe0658-b642-49af-b2df-91d5756ac488 service nova] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:44.711828 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe0658-b642-49af-b2df-91d5756ac488 service nova] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:44.712173 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe0658-b642-49af-b2df-91d5756ac488 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:44.714056 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-bcbe0658-b642-49af-b2df-91d5756ac488 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:22:44.731772 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbe0658-b642-49af-b2df-91d5756ac488 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:22:44.733441 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbe0658-b642-49af-b2df-91d5756ac488 service nova] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:22:44.744858 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1115/2231] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:22:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:22:47.129731 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f976475f-50bd-41a2-a7f1-06c236c1c3cf service swift] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:22:47.131198 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-f976475f-50bd-41a2-a7f1-06c236c1c3cf service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:22:47.146470 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f976475f-50bd-41a2-a7f1-06c236c1c3cf service swift] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:22:47.152665 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0603e5-e991-495e-9eec-28a30f4d9c29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b430b739cb54fc7911bc89f8ea2df72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:22:47.152774 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0603e5-e991-495e-9eec-28a30f4d9c29 service nova] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:47.153055 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0603e5-e991-495e-9eec-28a30f4d9c29 service nova] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:47.153324 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0603e5-e991-495e-9eec-28a30f4d9c29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:47.155164 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-fb0603e5-e991-495e-9eec-28a30f4d9c29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:22:47.232222 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0603e5-e991-495e-9eec-28a30f4d9c29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:22:47.233914 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0603e5-e991-495e-9eec-28a30f4d9c29 service nova] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:22:47.244315 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1117/2232] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:22:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:22:54.305550 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbe0658-b642-49af-b2df-91d5756ac488 service nova] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:22:54.307033 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-bcbe0658-b642-49af-b2df-91d5756ac488 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:22:54.318363 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbe0658-b642-49af-b2df-91d5756ac488 service nova] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:22:54.321962 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44c026-0cd9-4421-8e2a-25dddb42d720 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:22:54.322592 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44c026-0cd9-4421-8e2a-25dddb42d720 service neutron] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:54.322871 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44c026-0cd9-4421-8e2a-25dddb42d720 service neutron] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:54.323152 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee44c026-0cd9-4421-8e2a-25dddb42d720 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:54.325628 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-ee44c026-0cd9-4421-8e2a-25dddb42d720 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:22:54.334614 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee44c026-0cd9-4421-8e2a-25dddb42d720 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:22:54.336028 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee44c026-0cd9-4421-8e2a-25dddb42d720 service neutron] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:22:54.344408 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1116/2233] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:22:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:23:01.374591 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0603e5-e991-495e-9eec-28a30f4d9c29 service nova] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:23:01.385324 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0603e5-e991-495e-9eec-28a30f4d9c29 service nova] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:23:01.390816 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ae398-a242-466d-8dc4-917b5742400f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b430b739cb54fc7911bc89f8ea2df72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:23:01.391438 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ae398-a242-466d-8dc4-917b5742400f service nova] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:23:01.391718 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ae398-a242-466d-8dc4-917b5742400f service nova] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:23:01.391986 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ae398-a242-466d-8dc4-917b5742400f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:23:01.393754 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-fe7ae398-a242-466d-8dc4-917b5742400f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:23:01.449122 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7ae398-a242-466d-8dc4-917b5742400f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:23:01.450971 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7ae398-a242-466d-8dc4-917b5742400f service nova] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:23:01.459629 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1118/2234] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:23:01 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:23:06.116531 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44c026-0cd9-4421-8e2a-25dddb42d720 service neutron] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:23:06.129747 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee44c026-0cd9-4421-8e2a-25dddb42d720 service neutron] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:23:06.135224 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e38e54-4d91-4a46-9880-d16d05315411 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b430b739cb54fc7911bc89f8ea2df72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:23:06.135873 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e38e54-4d91-4a46-9880-d16d05315411 service nova] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:23:06.136199 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e38e54-4d91-4a46-9880-d16d05315411 service nova] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:23:06.136462 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e38e54-4d91-4a46-9880-d16d05315411 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:23:06.138466 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-32e38e54-4d91-4a46-9880-d16d05315411 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:23:06.151052 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e38e54-4d91-4a46-9880-d16d05315411 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:23:06.153668 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e38e54-4d91-4a46-9880-d16d05315411 service nova] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:23:06.164815 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1117/2235] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:23:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:23:09.616844 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d2046-9ae0-4c64-a73f-e914b22c9148 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:23:09.617475 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d2046-9ae0-4c64-a73f-e914b22c9148 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:23:09.617475 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d2046-9ae0-4c64-a73f-e914b22c9148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:23:09.635370 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-b81d2046-9ae0-4c64-a73f-e914b22c9148 None None] MFA Rules not processed for user `f370e353067848b5843c5650183be347`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:23:09.636575 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-b81d2046-9ae0-4c64-a73f-e914b22c9148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:23:09.643709 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1119/2236] 10.222.0.65 () {58 vars in 1009 bytes} [Tue May 17 18:23:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:23:09.656217 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e38e54-4d91-4a46-9880-d16d05315411 service nova] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:23:09.668961 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e38e54-4d91-4a46-9880-d16d05315411 service nova] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:23:09.673930 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729468fc-8792-47b3-a747-ed05870f054a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1464e84a3a2d4321a98b98d398bc7be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:23:09.674562 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729468fc-8792-47b3-a747-ed05870f054a service swift] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:23:09.674843 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729468fc-8792-47b3-a747-ed05870f054a service swift] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:23:09.675116 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729468fc-8792-47b3-a747-ed05870f054a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:23:09.683592 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729468fc-8792-47b3-a747-ed05870f054a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:23:09.685211 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729468fc-8792-47b3-a747-ed05870f054a service swift] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:23:09.693285 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1118/2237] 10.222.0.65 () {60 vars in 1384 bytes} [Tue May 17 18:23:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 17 18:23:18.857653 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d2046-9ae0-4c64-a73f-e914b22c9148 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:23:18.868003 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d2046-9ae0-4c64-a73f-e914b22c9148 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:23:18.871725 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e047898e-8b98-475d-8ddf-d3307d4049fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:23:18.872380 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047898e-8b98-475d-8ddf-d3307d4049fa service neutron] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:23:18.872657 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047898e-8b98-475d-8ddf-d3307d4049fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:23:18.872928 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047898e-8b98-475d-8ddf-d3307d4049fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:23:18.882838 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e047898e-8b98-475d-8ddf-d3307d4049fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:23:18.884294 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e047898e-8b98-475d-8ddf-d3307d4049fa service neutron] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:23:18.894874 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1120/2238] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:23:18 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:23:22.510376 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729468fc-8792-47b3-a747-ed05870f054a service swift] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:23:22.529112 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729468fc-8792-47b3-a747-ed05870f054a service swift] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:23:22.541841 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c00ba-235c-4953-801e-e59e5be21d15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b430b739cb54fc7911bc89f8ea2df72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:23:22.542505 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c00ba-235c-4953-801e-e59e5be21d15 service nova] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:23:22.542785 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c00ba-235c-4953-801e-e59e5be21d15 service nova] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:23:22.543210 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c00ba-235c-4953-801e-e59e5be21d15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:23:22.545062 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-618c00ba-235c-4953-801e-e59e5be21d15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:23:22.565657 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618c00ba-235c-4953-801e-e59e5be21d15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:23:22.568906 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618c00ba-235c-4953-801e-e59e5be21d15 service nova] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:23:22.595485 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1119/2239] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:23:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:23:23.640665 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e047898e-8b98-475d-8ddf-d3307d4049fa service neutron] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:23:23.657248 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e047898e-8b98-475d-8ddf-d3307d4049fa service neutron] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:23:23.665551 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1940fc3b-e2e7-4df2-81cc-167ce6951328 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b430b739cb54fc7911bc89f8ea2df72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:23:23.666208 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940fc3b-e2e7-4df2-81cc-167ce6951328 service nova] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:23:23.666488 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940fc3b-e2e7-4df2-81cc-167ce6951328 service nova] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:23:23.666757 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940fc3b-e2e7-4df2-81cc-167ce6951328 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:23:23.669135 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-1940fc3b-e2e7-4df2-81cc-167ce6951328 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:23:23.682690 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1940fc3b-e2e7-4df2-81cc-167ce6951328 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:23:23.684451 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1940fc3b-e2e7-4df2-81cc-167ce6951328 service nova] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:23:23.699180 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1121/2240] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:23:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:23:24.467748 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c00ba-235c-4953-801e-e59e5be21d15 service nova] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:23:24.477378 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c00ba-235c-4953-801e-e59e5be21d15 service nova] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:23:24.482638 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e095f9f5-78b9-4d7b-9697-2b0ced58fc86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:23:24.483511 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095f9f5-78b9-4d7b-9697-2b0ced58fc86 service neutron] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:23:24.483791 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095f9f5-78b9-4d7b-9697-2b0ced58fc86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:23:24.484059 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095f9f5-78b9-4d7b-9697-2b0ced58fc86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:23:24.485867 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-e095f9f5-78b9-4d7b-9697-2b0ced58fc86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:23:24.495960 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e095f9f5-78b9-4d7b-9697-2b0ced58fc86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:23:24.497365 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e095f9f5-78b9-4d7b-9697-2b0ced58fc86 service neutron] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:23:24.504931 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1120/2241] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:23:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:23:24.605305 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540e43a-91fc-453f-af2c-a4f7970a9973 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:23:24.605539 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540e43a-91fc-453f-af2c-a4f7970a9973 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:23:24.605797 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540e43a-91fc-453f-af2c-a4f7970a9973 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:23:24.607194 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1122/2242] 10.222.0.65 () {54 vars in 921 bytes} [Tue May 17 18:23:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:23:24.613027 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b6770-ba13-44e7-844e-8a4435c85537 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:23:24.613408 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b6770-ba13-44e7-844e-8a4435c85537 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:23:24.613791 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b6770-ba13-44e7-844e-8a4435c85537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:23:24.653115 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-a63b6770-ba13-44e7-844e-8a4435c85537 None None] MFA Rules not processed for user `5b430b739cb54fc7911bc89f8ea2df72`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:23:24.654471 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-a63b6770-ba13-44e7-844e-8a4435c85537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:23:24.663930 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1121/2243] 10.222.0.65 () {58 vars in 1018 bytes} [Tue May 17 18:23:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:23:24.677379 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f540e43a-91fc-453f-af2c-a4f7970a9973 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:23:24.688610 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f540e43a-91fc-453f-af2c-a4f7970a9973 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:23:24.692649 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ca7a73-711e-4753-b7bd-edb2c3015890 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce570634a66b45158d940151828f533a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:23:24.693273 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca7a73-711e-4753-b7bd-edb2c3015890 service glance] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:23:24.693619 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca7a73-711e-4753-b7bd-edb2c3015890 service glance] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:23:24.693891 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ca7a73-711e-4753-b7bd-edb2c3015890 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:23:24.704309 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ca7a73-711e-4753-b7bd-edb2c3015890 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:23:24.705787 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ca7a73-711e-4753-b7bd-edb2c3015890 service glance] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:23:24.717244 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1123/2244] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:23:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:23:24.784114 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4b837-e85b-478d-aa89-a144435bab22 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:23:24.784431 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4b837-e85b-478d-aa89-a144435bab22 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:23:24.784711 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4b837-e85b-478d-aa89-a144435bab22 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:23:24.786145 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1122/2245] 10.222.0.65 () {54 vars in 921 bytes} [Tue May 17 18:23:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:23:24.790897 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238670a5-0c26-4281-a3a1-192841c503c3 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:23:24.791180 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238670a5-0c26-4281-a3a1-192841c503c3 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:23:24.791479 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238670a5-0c26-4281-a3a1-192841c503c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:23:24.809784 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-238670a5-0c26-4281-a3a1-192841c503c3 None None] MFA Rules not processed for user `83430939ae474ad6bab37dfb6fc8da78`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:23:24.810966 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-238670a5-0c26-4281-a3a1-192841c503c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:23:24.817526 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1124/2246] 10.222.0.65 () {58 vars in 1018 bytes} [Tue May 17 18:23:24 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:23:24.829138 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4b837-e85b-478d-aa89-a144435bab22 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:23:24.840592 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4b837-e85b-478d-aa89-a144435bab22 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:23:24.844119 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bb2cd9-0627-4d8a-a396-137b5dadd746 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:23:24.844780 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb2cd9-0627-4d8a-a396-137b5dadd746 service neutron] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:23:24.845170 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb2cd9-0627-4d8a-a396-137b5dadd746 service neutron] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:23:24.845448 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb2cd9-0627-4d8a-a396-137b5dadd746 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:23:24.852685 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bb2cd9-0627-4d8a-a396-137b5dadd746 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:23:24.854137 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bb2cd9-0627-4d8a-a396-137b5dadd746 service neutron] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:23:24.862783 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1123/2247] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:23:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:23:24.942387 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340cf91-c189-4146-96a2-078979026b25 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:23:24.942675 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340cf91-c189-4146-96a2-078979026b25 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:23:24.942952 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340cf91-c189-4146-96a2-078979026b25 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:23:24.944381 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1125/2248] 10.222.0.65 () {54 vars in 921 bytes} [Tue May 17 18:23:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:23:24.949889 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e214be5-ee67-4416-8447-7f4a3f9efb46 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:23:24.950210 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e214be5-ee67-4416-8447-7f4a3f9efb46 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:23:24.950519 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e214be5-ee67-4416-8447-7f4a3f9efb46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:23:24.968917 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-7e214be5-ee67-4416-8447-7f4a3f9efb46 None None] MFA Rules not processed for user `5b430b739cb54fc7911bc89f8ea2df72`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:23:24.970146 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-7e214be5-ee67-4416-8447-7f4a3f9efb46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:23:24.979978 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1124/2249] 10.222.0.65 () {58 vars in 1018 bytes} [Tue May 17 18:23:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:23:24.990131 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c340cf91-c189-4146-96a2-078979026b25 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:23:25.000879 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c340cf91-c189-4146-96a2-078979026b25 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:23:25.004416 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca8f7e-6cc2-4e6f-a156-817a6b07625c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:23:25.005059 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca8f7e-6cc2-4e6f-a156-817a6b07625c service neutron] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:23:25.005336 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca8f7e-6cc2-4e6f-a156-817a6b07625c service neutron] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:23:25.005640 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca8f7e-6cc2-4e6f-a156-817a6b07625c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:23:25.015440 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca8f7e-6cc2-4e6f-a156-817a6b07625c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:23:25.016866 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca8f7e-6cc2-4e6f-a156-817a6b07625c service neutron] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:23:25.028221 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1126/2250] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:23:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:23:27.394926 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54794f0f-72cf-4858-99e8-e5ccea7e80c6 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:23:27.395415 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54794f0f-72cf-4858-99e8-e5ccea7e80c6 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:23:27.395515 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54794f0f-72cf-4858-99e8-e5ccea7e80c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:23:27.415494 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-54794f0f-72cf-4858-99e8-e5ccea7e80c6 None None] MFA Rules not processed for user `f370e353067848b5843c5650183be347`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:23:27.417205 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-54794f0f-72cf-4858-99e8-e5ccea7e80c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:23:27.426087 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1125/2251] 10.222.0.65 () {58 vars in 1009 bytes} [Tue May 17 18:23:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:23:27.438345 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca8f7e-6cc2-4e6f-a156-817a6b07625c service neutron] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:23:27.449647 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca8f7e-6cc2-4e6f-a156-817a6b07625c service neutron] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:23:27.454899 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59752bdc-1f9c-453c-a144-6011c8408c58 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1464e84a3a2d4321a98b98d398bc7be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:23:27.455525 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59752bdc-1f9c-453c-a144-6011c8408c58 service swift] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:23:27.455803 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59752bdc-1f9c-453c-a144-6011c8408c58 service swift] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:23:27.456077 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59752bdc-1f9c-453c-a144-6011c8408c58 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:23:27.464970 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59752bdc-1f9c-453c-a144-6011c8408c58 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:23:27.466553 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59752bdc-1f9c-453c-a144-6011c8408c58 service swift] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:23:27.474623 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1127/2252] 10.222.0.65 () {60 vars in 1384 bytes} [Tue May 17 18:23:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 18:23:32.231055 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54794f0f-72cf-4858-99e8-e5ccea7e80c6 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:23:32.256061 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54794f0f-72cf-4858-99e8-e5ccea7e80c6 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:23:32.262577 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0c4adf-e545-45ad-a027-3acbeb54d714 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b430b739cb54fc7911bc89f8ea2df72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:23:32.263395 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c4adf-e545-45ad-a027-3acbeb54d714 service nova] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:23:32.263749 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c4adf-e545-45ad-a027-3acbeb54d714 service nova] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:23:32.263957 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0c4adf-e545-45ad-a027-3acbeb54d714 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:23:32.265960 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-1a0c4adf-e545-45ad-a027-3acbeb54d714 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:23:32.341792 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0c4adf-e545-45ad-a027-3acbeb54d714 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:23:32.343920 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0c4adf-e545-45ad-a027-3acbeb54d714 service nova] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:23:32.353111 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1126/2253] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:23:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:23:47.545671 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb82224b-0713-4202-978c-289567003ec3 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:23:47.546252 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb82224b-0713-4202-978c-289567003ec3 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:23:47.546252 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb82224b-0713-4202-978c-289567003ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:23:47.563836 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-fb82224b-0713-4202-978c-289567003ec3 None None] MFA Rules not processed for user `5e6f035cadd24a59803eec21c7b9e2c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:23:47.565036 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-fb82224b-0713-4202-978c-289567003ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:23:47.571782 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1128/2254] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:23:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:23:56.267959 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7f78e-ddc4-4024-8de7-468cf042cca3 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:23:56.268470 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7f78e-ddc4-4024-8de7-468cf042cca3 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:23:56.268567 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7f78e-ddc4-4024-8de7-468cf042cca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:23:56.284956 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-96a7f78e-ddc4-4024-8de7-468cf042cca3 None None] MFA Rules not processed for user `f370e353067848b5843c5650183be347`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:23:56.286173 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-96a7f78e-ddc4-4024-8de7-468cf042cca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:23:56.293134 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1127/2255] 10.222.0.65 () {58 vars in 967 bytes} [Tue May 17 18:23:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:23:56.315269 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb82224b-0713-4202-978c-289567003ec3 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:23:56.327896 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb82224b-0713-4202-978c-289567003ec3 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:23:56.332889 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c81da-61e5-4dcc-bf7f-9f9248448d49 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1464e84a3a2d4321a98b98d398bc7be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:23:56.333550 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c81da-61e5-4dcc-bf7f-9f9248448d49 service swift] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:23:56.333828 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c81da-61e5-4dcc-bf7f-9f9248448d49 service swift] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:23:56.334099 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c81da-61e5-4dcc-bf7f-9f9248448d49 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:23:56.342379 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c81da-61e5-4dcc-bf7f-9f9248448d49 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:23:56.344011 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c81da-61e5-4dcc-bf7f-9f9248448d49 service swift] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:23:56.353719 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1129/2256] 10.222.0.65 () {60 vars in 1384 bytes} [Tue May 17 18:23:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 18:24:44.598013 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d2d7f-d273-47af-b6e5-5c92a309f40d None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:24:44.598502 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d2d7f-d273-47af-b6e5-5c92a309f40d None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:24:44.598688 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d2d7f-d273-47af-b6e5-5c92a309f40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:24:44.616640 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-802d2d7f-d273-47af-b6e5-5c92a309f40d None None] MFA Rules not processed for user `861ad9a7c63a4d66a1806c4576cddce5`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:24:44.617927 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-802d2d7f-d273-47af-b6e5-5c92a309f40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:24:44.671586 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1128/2257] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:24:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:25:05.133788 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9104bca-d363-4d66-9c6a-588036614c1c None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:05.134675 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9104bca-d363-4d66-9c6a-588036614c1c None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:05.135114 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9104bca-d363-4d66-9c6a-588036614c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:05.158196 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-b9104bca-d363-4d66-9c6a-588036614c1c None None] MFA Rules not processed for user `13b4ec46d3cb49faba3f063dcfd644c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:25:05.159661 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-b9104bca-d363-4d66-9c6a-588036614c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:25:05.167096 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1130/2258] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:25:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:25:16.977382 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca9b5e4-12e2-4904-9051-103caeb28b0d None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:16.977905 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca9b5e4-12e2-4904-9051-103caeb28b0d None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:16.977998 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca9b5e4-12e2-4904-9051-103caeb28b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:16.997160 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-fca9b5e4-12e2-4904-9051-103caeb28b0d None None] MFA Rules not processed for user `43620937739e45d3bb7849f98d0e6cce`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:25:16.998358 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-fca9b5e4-12e2-4904-9051-103caeb28b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:25:17.005872 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1129/2259] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:25:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:25:26.254094 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067006e5-0d25-4992-bc87-dfcf2a8da7bf None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:26.255032 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067006e5-0d25-4992-bc87-dfcf2a8da7bf None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:26.255431 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067006e5-0d25-4992-bc87-dfcf2a8da7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:26.272170 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-067006e5-0d25-4992-bc87-dfcf2a8da7bf None None] MFA Rules not processed for user `356af648841c44eeab0bd9c7f78f600a`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:25:26.273374 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-067006e5-0d25-4992-bc87-dfcf2a8da7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:25:26.280750 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1131/2260] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:25:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:25:34.348814 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca9b5e4-12e2-4904-9051-103caeb28b0d None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:25:34.358048 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca9b5e4-12e2-4904-9051-103caeb28b0d None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:25:34.361628 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b27cfc-cc7d-4a39-a739-ad932bc4c7ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:25:34.362255 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b27cfc-cc7d-4a39-a739-ad932bc4c7ec service neutron] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:34.362536 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b27cfc-cc7d-4a39-a739-ad932bc4c7ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:34.362808 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b27cfc-cc7d-4a39-a739-ad932bc4c7ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:34.364620 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-b0b27cfc-cc7d-4a39-a739-ad932bc4c7ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:25:34.425002 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b27cfc-cc7d-4a39-a739-ad932bc4c7ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:25:34.426464 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b27cfc-cc7d-4a39-a739-ad932bc4c7ec service neutron] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:25:34.436252 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1130/2261] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:25:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:25:35.990470 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067006e5-0d25-4992-bc87-dfcf2a8da7bf None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:25:35.991873 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-067006e5-0d25-4992-bc87-dfcf2a8da7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:25:36.008258 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067006e5-0d25-4992-bc87-dfcf2a8da7bf None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:25:36.013903 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b278584-228a-4fe3-bd8d-59b3049d33e5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ddf11ac3e14d03b1159868b3b73fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:25:36.014548 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b278584-228a-4fe3-bd8d-59b3049d33e5 service placement] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:36.014825 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b278584-228a-4fe3-bd8d-59b3049d33e5 service placement] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:36.015092 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b278584-228a-4fe3-bd8d-59b3049d33e5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:36.018028 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-9b278584-228a-4fe3-bd8d-59b3049d33e5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:25:36.032724 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b278584-228a-4fe3-bd8d-59b3049d33e5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:25:36.034256 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b278584-228a-4fe3-bd8d-59b3049d33e5 service placement] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:25:36.060803 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1132/2262] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:25:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:25:39.376660 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b27cfc-cc7d-4a39-a739-ad932bc4c7ec service neutron] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:25:39.378221 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-b0b27cfc-cc7d-4a39-a739-ad932bc4c7ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:25:39.390973 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b27cfc-cc7d-4a39-a739-ad932bc4c7ec service neutron] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:25:39.395774 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0f7ab6-9fec-4f7a-b484-9d89fa1d7b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:25:39.396630 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f7ab6-9fec-4f7a-b484-9d89fa1d7b8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:39.396908 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f7ab6-9fec-4f7a-b484-9d89fa1d7b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:39.397182 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0f7ab6-9fec-4f7a-b484-9d89fa1d7b8c admin admin] PATH_INFO: `/v3/users/5e6f035cadd24a59803eec21c7b9e2c5` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:39.398391 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0f7ab6-9fec-4f7a-b484-9d89fa1d7b8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e6f035cadd24a59803eec21c7b9e2c5)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:25:39.400295 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0f7ab6-9fec-4f7a-b484-9d89fa1d7b8c admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:25:39.449609 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-5d0f7ab6-9fec-4f7a-b484-9d89fa1d7b8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e6f035cadd24a59803eec21c7b9e2c5'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:25:39.456588 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-5d0f7ab6-9fec-4f7a-b484-9d89fa1d7b8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e6f035cadd24a59803eec21c7b9e2c5'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:25:39.457272 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-5d0f7ab6-9fec-4f7a-b484-9d89fa1d7b8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e6f035cadd24a59803eec21c7b9e2c5'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:25:39.466904 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-5d0f7ab6-9fec-4f7a-b484-9d89fa1d7b8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e6f035cadd24a59803eec21c7b9e2c5'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:25:39.467592 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-5d0f7ab6-9fec-4f7a-b484-9d89fa1d7b8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e6f035cadd24a59803eec21c7b9e2c5'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:25:39.485003 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1131/2263] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:25:39 2022] DELETE /identity/v3/users/5e6f035cadd24a59803eec21c7b9e2c5 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:25:39.662695 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b278584-228a-4fe3-bd8d-59b3049d33e5 service placement] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:25:39.676170 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b278584-228a-4fe3-bd8d-59b3049d33e5 service placement] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:25:39.744893 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a62e34d-a85b-4b9e-8b16-e1528076ae9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:25:39.746330 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a62e34d-a85b-4b9e-8b16-e1528076ae9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:39.746661 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a62e34d-a85b-4b9e-8b16-e1528076ae9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:39.747067 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a62e34d-a85b-4b9e-8b16-e1528076ae9a admin admin] PATH_INFO: `/v3/projects/b7d713a65f9e4071988e5df2fbf90b17` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:39.748791 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a62e34d-a85b-4b9e-8b16-e1528076ae9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7d713a65f9e4071988e5df2fbf90b17)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:25:39.750941 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a62e34d-a85b-4b9e-8b16-e1528076ae9a admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:25:39.804811 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-2a62e34d-a85b-4b9e-8b16-e1528076ae9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7d713a65f9e4071988e5df2fbf90b17', 'request_id': 'req-2a62e34d-a85b-4b9e-8b16-e1528076ae9a'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:25:39.812168 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-2a62e34d-a85b-4b9e-8b16-e1528076ae9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7d713a65f9e4071988e5df2fbf90b17', 'request_id': 'req-2a62e34d-a85b-4b9e-8b16-e1528076ae9a'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:25:39.821090 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-2a62e34d-a85b-4b9e-8b16-e1528076ae9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7d713a65f9e4071988e5df2fbf90b17', 'request_id': 'req-2a62e34d-a85b-4b9e-8b16-e1528076ae9a'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:25:39.833868 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-2a62e34d-a85b-4b9e-8b16-e1528076ae9a admin admin] The token cache is being invalidate because project b7d713a65f9e4071988e5df2fbf90b17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:25:39.834243 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-2a62e34d-a85b-4b9e-8b16-e1528076ae9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:25:39.835114 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-2a62e34d-a85b-4b9e-8b16-e1528076ae9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:25:39.836786 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1133/2264] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:25:39 2022] DELETE /identity/v3/projects/b7d713a65f9e4071988e5df2fbf90b17 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:25:39.842420 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff2768-4fd7-4d8d-806b-5c22672444fc None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:39.842785 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff2768-4fd7-4d8d-806b-5c22672444fc None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:39.843036 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff2768-4fd7-4d8d-806b-5c22672444fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:39.862337 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-7dff2768-4fd7-4d8d-806b-5c22672444fc None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:25:39.863587 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-7dff2768-4fd7-4d8d-806b-5c22672444fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:25:39.926661 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1132/2265] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:25:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:25:39.934691 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344508f-7f76-417b-8aca-03397bad15bd None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:39.934989 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344508f-7f76-417b-8aca-03397bad15bd None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:39.935239 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344508f-7f76-417b-8aca-03397bad15bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:39.954326 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-1344508f-7f76-417b-8aca-03397bad15bd None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:25:39.955577 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-1344508f-7f76-417b-8aca-03397bad15bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:25:39.963950 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1134/2266] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:25:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:25:39.968402 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff2768-4fd7-4d8d-806b-5c22672444fc None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:25:39.978919 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff2768-4fd7-4d8d-806b-5c22672444fc None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:25:39.983906 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4454a9f4-adae-44ed-ad40-2956cc76bba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:25:39.984559 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454a9f4-adae-44ed-ad40-2956cc76bba0 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:39.984833 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454a9f4-adae-44ed-ad40-2956cc76bba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:39.985101 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4454a9f4-adae-44ed-ad40-2956cc76bba0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:39.985962 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4454a9f4-adae-44ed-ad40-2956cc76bba0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:25:39.986160 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4454a9f4-adae-44ed-ad40-2956cc76bba0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:25:39.987888 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4454a9f4-adae-44ed-ad40-2956cc76bba0 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:25:40.005628 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1133/2267] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 17 18:25:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:25:40.006801 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1344508f-7f76-417b-8aca-03397bad15bd None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:25:40.017044 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1344508f-7f76-417b-8aca-03397bad15bd None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:25:40.022101 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42956b28-62a0-4a86-b8de-fcf3b6f0e716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:25:40.022758 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42956b28-62a0-4a86-b8de-fcf3b6f0e716 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:40.023030 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42956b28-62a0-4a86-b8de-fcf3b6f0e716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:40.023297 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42956b28-62a0-4a86-b8de-fcf3b6f0e716 admin admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:40.024010 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42956b28-62a0-4a86-b8de-fcf3b6f0e716 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:25:40.025990 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42956b28-62a0-4a86-b8de-fcf3b6f0e716 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:25:40.064665 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1135/2268] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:25:40 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:25:40.066535 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4454a9f4-adae-44ed-ad40-2956cc76bba0 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:25:40.077516 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4454a9f4-adae-44ed-ad40-2956cc76bba0 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:25:40.133404 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9996113d-3546-495b-85d4-c72dcd5b0647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:25:40.134100 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996113d-3546-495b-85d4-c72dcd5b0647 admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:40.134380 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996113d-3546-495b-85d4-c72dcd5b0647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:40.134656 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9996113d-3546-495b-85d4-c72dcd5b0647 admin admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:40.135341 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9996113d-3546-495b-85d4-c72dcd5b0647 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:25:40.137813 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9996113d-3546-495b-85d4-c72dcd5b0647 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:25:40.164395 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1134/2269] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:25:40 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:25:40.165678 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42956b28-62a0-4a86-b8de-fcf3b6f0e716 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:25:40.175641 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42956b28-62a0-4a86-b8de-fcf3b6f0e716 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:25:40.180169 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a55a540-a011-49a9-8ef8-bf25cdc84f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:25:40.180808 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55a540-a011-49a9-8ef8-bf25cdc84f4b admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:40.181083 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55a540-a011-49a9-8ef8-bf25cdc84f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:40.181350 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a55a540-a011-49a9-8ef8-bf25cdc84f4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:40.182095 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a55a540-a011-49a9-8ef8-bf25cdc84f4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:25:40.183725 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a55a540-a011-49a9-8ef8-bf25cdc84f4b admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:25:40.201689 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1136/2270] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:25:40.205657 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9996113d-3546-495b-85d4-c72dcd5b0647 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:25:40.215920 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9996113d-3546-495b-85d4-c72dcd5b0647 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:25:40.224530 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c7c31-d4ec-48fb-a3e0-1b46c765ff2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:25:40.225289 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c7c31-d4ec-48fb-a3e0-1b46c765ff2d admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:40.225669 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c7c31-d4ec-48fb-a3e0-1b46c765ff2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:40.226010 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c7c31-d4ec-48fb-a3e0-1b46c765ff2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:40.226748 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42c7c31-d4ec-48fb-a3e0-1b46c765ff2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:25:40.228409 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42c7c31-d4ec-48fb-a3e0-1b46c765ff2d admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:25:40.238876 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1135/2271] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:25:40.242952 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a55a540-a011-49a9-8ef8-bf25cdc84f4b admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:25:40.253361 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a55a540-a011-49a9-8ef8-bf25cdc84f4b admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:25:40.258552 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677a4449-b4e4-422f-b7b8-15ef7c5eb3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:25:40.259421 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a4449-b4e4-422f-b7b8-15ef7c5eb3c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:40.259697 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a4449-b4e4-422f-b7b8-15ef7c5eb3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:40.259967 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a4449-b4e4-422f-b7b8-15ef7c5eb3c5 admin admin] PATH_INFO: `/v3/projects/a7cad170d4974d9d848fe28ee7902cc0/users/c9bd671fcced47308f26f36e3c28282a/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:40.275210 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677a4449-b4e4-422f-b7b8-15ef7c5eb3c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7cad170d4974d9d848fe28ee7902cc0, user_id=c9bd671fcced47308f26f36e3c28282a, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:25:40.278536 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677a4449-b4e4-422f-b7b8-15ef7c5eb3c5 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:25:40.291225 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1137/2272] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:25:40 2022] PUT /identity/v3/projects/a7cad170d4974d9d848fe28ee7902cc0/users/c9bd671fcced47308f26f36e3c28282a/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:25:40.301420 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab63dc-ac75-4ac3-b787-a638988a4d5a None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:40.301743 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab63dc-ac75-4ac3-b787-a638988a4d5a None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:40.302021 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ab63dc-ac75-4ac3-b787-a638988a4d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:40.331122 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-70ab63dc-ac75-4ac3-b787-a638988a4d5a None None] MFA Rules not processed for user `c9bd671fcced47308f26f36e3c28282a`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:25:40.332342 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-70ab63dc-ac75-4ac3-b787-a638988a4d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:25:40.395480 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1136/2273] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:25:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:25:40.400108 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677a4449-b4e4-422f-b7b8-15ef7c5eb3c5 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:25:40.461602 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677a4449-b4e4-422f-b7b8-15ef7c5eb3c5 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:25:40.466162 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d71dce-eff3-4f10-9a5c-3023cfde6161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:25:40.466810 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d71dce-eff3-4f10-9a5c-3023cfde6161 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:40.467088 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d71dce-eff3-4f10-9a5c-3023cfde6161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:40.467360 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d71dce-eff3-4f10-9a5c-3023cfde6161 admin admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:40.468046 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d71dce-eff3-4f10-9a5c-3023cfde6161 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:25:40.470089 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d71dce-eff3-4f10-9a5c-3023cfde6161 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:25:40.498463 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1138/2274] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:25:40 2022] POST /identity/v3/projects => generated 379 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:25:40.499571 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ab63dc-ac75-4ac3-b787-a638988a4d5a None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:25:40.510207 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ab63dc-ac75-4ac3-b787-a638988a4d5a None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:25:40.568100 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021a053f-0f2a-47cf-b1a4-4b060ff027ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:25:40.568834 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a053f-0f2a-47cf-b1a4-4b060ff027ab admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:40.569119 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a053f-0f2a-47cf-b1a4-4b060ff027ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:40.569452 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021a053f-0f2a-47cf-b1a4-4b060ff027ab admin admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:40.570680 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021a053f-0f2a-47cf-b1a4-4b060ff027ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:25:40.572064 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021a053f-0f2a-47cf-b1a4-4b060ff027ab admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:25:40.592672 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1137/2275] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:25:40 2022] POST /identity/v3/users => generated 296 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:25:40.596643 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d71dce-eff3-4f10-9a5c-3023cfde6161 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:25:40.607005 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d71dce-eff3-4f10-9a5c-3023cfde6161 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:25:40.611975 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb0aee-0897-41b5-89b9-18b85361ebfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:25:40.612622 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb0aee-0897-41b5-89b9-18b85361ebfa admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:40.612901 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb0aee-0897-41b5-89b9-18b85361ebfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:40.613172 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb0aee-0897-41b5-89b9-18b85361ebfa admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:40.613925 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eb0aee-0897-41b5-89b9-18b85361ebfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:25:40.615542 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eb0aee-0897-41b5-89b9-18b85361ebfa admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:25:40.626602 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1139/2276] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:25:40.631180 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021a053f-0f2a-47cf-b1a4-4b060ff027ab admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:25:40.641977 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021a053f-0f2a-47cf-b1a4-4b060ff027ab admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:25:40.646474 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dca899-78c3-4e88-a758-4e97143d1e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:25:40.647342 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dca899-78c3-4e88-a758-4e97143d1e32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:40.647619 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dca899-78c3-4e88-a758-4e97143d1e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:40.647888 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dca899-78c3-4e88-a758-4e97143d1e32 admin admin] PATH_INFO: `/v3/projects/632d45e72d574f1da981a8e5a89b97ec/users/ae4a115a789b4f97ae2d698eef3b1a77/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:40.662261 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dca899-78c3-4e88-a758-4e97143d1e32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=632d45e72d574f1da981a8e5a89b97ec, user_id=ae4a115a789b4f97ae2d698eef3b1a77, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:25:40.664891 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dca899-78c3-4e88-a758-4e97143d1e32 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:25:40.680049 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1138/2277] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:25:40 2022] PUT /identity/v3/projects/632d45e72d574f1da981a8e5a89b97ec/users/ae4a115a789b4f97ae2d698eef3b1a77/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:25:40.684742 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb0aee-0897-41b5-89b9-18b85361ebfa admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:25:40.694783 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb0aee-0897-41b5-89b9-18b85361ebfa admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:25:40.751776 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd35c3-b41a-4955-9215-75e12fa80f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:25:40.752353 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd35c3-b41a-4955-9215-75e12fa80f1f admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:40.752631 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd35c3-b41a-4955-9215-75e12fa80f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:40.752906 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd35c3-b41a-4955-9215-75e12fa80f1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:40.753683 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dd35c3-b41a-4955-9215-75e12fa80f1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:25:40.755281 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dd35c3-b41a-4955-9215-75e12fa80f1f admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:25:40.765587 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1140/2278] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:25:40.769427 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dca899-78c3-4e88-a758-4e97143d1e32 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:25:40.779618 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dca899-78c3-4e88-a758-4e97143d1e32 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:25:40.786841 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f1f4d1-3368-4941-b396-705b550a3ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:25:40.787755 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1f4d1-3368-4941-b396-705b550a3ca8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:40.788047 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1f4d1-3368-4941-b396-705b550a3ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:40.788318 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1f4d1-3368-4941-b396-705b550a3ca8 admin admin] PATH_INFO: `/v3/projects/632d45e72d574f1da981a8e5a89b97ec/users/ae4a115a789b4f97ae2d698eef3b1a77/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:40.790326 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f1f4d1-3368-4941-b396-705b550a3ca8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=632d45e72d574f1da981a8e5a89b97ec, user_id=ae4a115a789b4f97ae2d698eef3b1a77, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:25:40.793827 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f1f4d1-3368-4941-b396-705b550a3ca8 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:25:40.804177 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1139/2279] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:25:40 2022] PUT /identity/v3/projects/632d45e72d574f1da981a8e5a89b97ec/users/ae4a115a789b4f97ae2d698eef3b1a77/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:25:40.816243 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c22cf52-62a8-43e1-9e78-c01b88f9184a None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:40.816622 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c22cf52-62a8-43e1-9e78-c01b88f9184a None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:40.816967 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c22cf52-62a8-43e1-9e78-c01b88f9184a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:40.845748 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-6c22cf52-62a8-43e1-9e78-c01b88f9184a None None] MFA Rules not processed for user `ae4a115a789b4f97ae2d698eef3b1a77`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:25:40.848889 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-6c22cf52-62a8-43e1-9e78-c01b88f9184a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:25:40.920312 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1141/2280] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:25:40 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:25:40.931824 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f1f4d1-3368-4941-b396-705b550a3ca8 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:25:40.934478 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-a8f1f4d1-3368-4941-b396-705b550a3ca8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:25:40.997153 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f1f4d1-3368-4941-b396-705b550a3ca8 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:25:41.001857 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c3f69-d801-4948-a8e5-eac1db253164 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:25:41.002520 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c3f69-d801-4948-a8e5-eac1db253164 service cinder] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:41.002868 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c3f69-d801-4948-a8e5-eac1db253164 service cinder] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:41.003586 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c3f69-d801-4948-a8e5-eac1db253164 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:41.012971 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783c3f69-d801-4948-a8e5-eac1db253164 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:25:41.014533 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783c3f69-d801-4948-a8e5-eac1db253164 service cinder] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:25:41.024462 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1140/2281] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:25:40 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:25:41.103909 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c22cf52-62a8-43e1-9e78-c01b88f9184a None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:25:41.115042 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c22cf52-62a8-43e1-9e78-c01b88f9184a None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:25:41.119699 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a374b4a0-c2cb-4fb4-9b7b-8847a5c6ba22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:25:41.120605 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374b4a0-c2cb-4fb4-9b7b-8847a5c6ba22 service cinder] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:41.121055 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374b4a0-c2cb-4fb4-9b7b-8847a5c6ba22 service cinder] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:41.121328 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374b4a0-c2cb-4fb4-9b7b-8847a5c6ba22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:41.189557 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a374b4a0-c2cb-4fb4-9b7b-8847a5c6ba22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:25:41.191006 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a374b4a0-c2cb-4fb4-9b7b-8847a5c6ba22 service cinder] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:25:41.201147 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1142/2282] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:25:41 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:25:51.950440 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c3f69-d801-4948-a8e5-eac1db253164 service cinder] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:25:52.010438 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c3f69-d801-4948-a8e5-eac1db253164 service cinder] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:25:52.014895 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b55334a-19db-4810-a9a1-088f0f9b386f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:25:52.015738 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55334a-19db-4810-a9a1-088f0f9b386f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:52.016008 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55334a-19db-4810-a9a1-088f0f9b386f admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:52.016273 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55334a-19db-4810-a9a1-088f0f9b386f admin admin] PATH_INFO: `/v3/users/c9bd671fcced47308f26f36e3c28282a` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:52.017432 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b55334a-19db-4810-a9a1-088f0f9b386f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9bd671fcced47308f26f36e3c28282a)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:25:52.019341 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b55334a-19db-4810-a9a1-088f0f9b386f admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:25:52.064405 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-7b55334a-19db-4810-a9a1-088f0f9b386f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9bd671fcced47308f26f36e3c28282a'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:25:52.071019 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-7b55334a-19db-4810-a9a1-088f0f9b386f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9bd671fcced47308f26f36e3c28282a'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:25:52.071668 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-7b55334a-19db-4810-a9a1-088f0f9b386f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9bd671fcced47308f26f36e3c28282a'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:25:52.078687 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-7b55334a-19db-4810-a9a1-088f0f9b386f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9bd671fcced47308f26f36e3c28282a'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:25:52.079304 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-7b55334a-19db-4810-a9a1-088f0f9b386f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9bd671fcced47308f26f36e3c28282a'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:25:52.095630 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1141/2283] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:25:51 2022] DELETE /identity/v3/users/c9bd671fcced47308f26f36e3c28282a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:25:52.100193 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d21956-9103-485a-a510-18d584f43e0b None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:52.100665 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d21956-9103-485a-a510-18d584f43e0b None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:52.100760 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d21956-9103-485a-a510-18d584f43e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:52.117851 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-b4d21956-9103-485a-a510-18d584f43e0b None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:25:52.119020 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-b4d21956-9103-485a-a510-18d584f43e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:25:52.179064 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1143/2284] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:25:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:25:52.191730 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b55334a-19db-4810-a9a1-088f0f9b386f admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:25:52.193124 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-7b55334a-19db-4810-a9a1-088f0f9b386f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:25:52.248997 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b55334a-19db-4810-a9a1-088f0f9b386f admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:25:52.253505 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b15171-3ad5-44b7-b28d-02df1fe1655b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:25:52.254193 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b15171-3ad5-44b7-b28d-02df1fe1655b service neutron] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:52.254604 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b15171-3ad5-44b7-b28d-02df1fe1655b service neutron] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:52.254812 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b15171-3ad5-44b7-b28d-02df1fe1655b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:52.263979 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b15171-3ad5-44b7-b28d-02df1fe1655b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:25:52.265432 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b15171-3ad5-44b7-b28d-02df1fe1655b service neutron] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:25:52.274610 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1142/2285] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:25:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:25:52.534440 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d21956-9103-485a-a510-18d584f43e0b None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:25:52.535868 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-b4d21956-9103-485a-a510-18d584f43e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:25:52.548987 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d21956-9103-485a-a510-18d584f43e0b None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:25:52.555142 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d075ff3-f4c3-4c9e-9dc7-1731cef9df80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:25:52.556049 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d075ff3-f4c3-4c9e-9dc7-1731cef9df80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:52.556263 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d075ff3-f4c3-4c9e-9dc7-1731cef9df80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:52.556543 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d075ff3-f4c3-4c9e-9dc7-1731cef9df80 admin admin] PATH_INFO: `/v3/projects/a7cad170d4974d9d848fe28ee7902cc0` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:52.557771 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d075ff3-f4c3-4c9e-9dc7-1731cef9df80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7cad170d4974d9d848fe28ee7902cc0)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:25:52.559683 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d075ff3-f4c3-4c9e-9dc7-1731cef9df80 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:25:52.611468 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-0d075ff3-f4c3-4c9e-9dc7-1731cef9df80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7cad170d4974d9d848fe28ee7902cc0', 'request_id': 'req-0d075ff3-f4c3-4c9e-9dc7-1731cef9df80'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:25:52.617340 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-0d075ff3-f4c3-4c9e-9dc7-1731cef9df80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7cad170d4974d9d848fe28ee7902cc0', 'request_id': 'req-0d075ff3-f4c3-4c9e-9dc7-1731cef9df80'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:25:52.624632 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-0d075ff3-f4c3-4c9e-9dc7-1731cef9df80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7cad170d4974d9d848fe28ee7902cc0', 'request_id': 'req-0d075ff3-f4c3-4c9e-9dc7-1731cef9df80'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:25:52.634660 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-0d075ff3-f4c3-4c9e-9dc7-1731cef9df80 admin admin] The token cache is being invalidate because project a7cad170d4974d9d848fe28ee7902cc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:25:52.634941 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-0d075ff3-f4c3-4c9e-9dc7-1731cef9df80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:25:52.635577 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-0d075ff3-f4c3-4c9e-9dc7-1731cef9df80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:25:52.637682 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1144/2286] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:25:52 2022] DELETE /identity/v3/projects/a7cad170d4974d9d848fe28ee7902cc0 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:25:52.641585 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b15171-3ad5-44b7-b28d-02df1fe1655b service neutron] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:25:52.651377 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b15171-3ad5-44b7-b28d-02df1fe1655b service neutron] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:25:52.704910 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1acb97e-b98c-4ca3-8031-9ee542b703b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:25:52.705832 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acb97e-b98c-4ca3-8031-9ee542b703b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:52.706110 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acb97e-b98c-4ca3-8031-9ee542b703b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:52.706383 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1acb97e-b98c-4ca3-8031-9ee542b703b7 admin admin] PATH_INFO: `/v3/users/ae4a115a789b4f97ae2d698eef3b1a77` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:52.707549 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1acb97e-b98c-4ca3-8031-9ee542b703b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae4a115a789b4f97ae2d698eef3b1a77)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:25:52.709499 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1acb97e-b98c-4ca3-8031-9ee542b703b7 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:25:52.753089 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-f1acb97e-b98c-4ca3-8031-9ee542b703b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae4a115a789b4f97ae2d698eef3b1a77'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:25:52.759655 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-f1acb97e-b98c-4ca3-8031-9ee542b703b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae4a115a789b4f97ae2d698eef3b1a77'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:25:52.760284 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-f1acb97e-b98c-4ca3-8031-9ee542b703b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae4a115a789b4f97ae2d698eef3b1a77'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:25:52.767599 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-f1acb97e-b98c-4ca3-8031-9ee542b703b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae4a115a789b4f97ae2d698eef3b1a77'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:25:52.768242 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-f1acb97e-b98c-4ca3-8031-9ee542b703b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae4a115a789b4f97ae2d698eef3b1a77'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:25:52.784915 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1143/2287] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:25:52 2022] DELETE /identity/v3/users/ae4a115a789b4f97ae2d698eef3b1a77 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:25:53.053524 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d075ff3-f4c3-4c9e-9dc7-1731cef9df80 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:25:53.055352 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-0d075ff3-f4c3-4c9e-9dc7-1731cef9df80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:25:53.072275 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d075ff3-f4c3-4c9e-9dc7-1731cef9df80 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:25:53.126765 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb97083c-49ee-421a-a90b-cdfb00dfc551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:25:53.127545 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97083c-49ee-421a-a90b-cdfb00dfc551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:53.127822 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97083c-49ee-421a-a90b-cdfb00dfc551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:53.128095 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97083c-49ee-421a-a90b-cdfb00dfc551 admin admin] PATH_INFO: `/v3/projects/632d45e72d574f1da981a8e5a89b97ec` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:53.129254 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb97083c-49ee-421a-a90b-cdfb00dfc551 admin admin] RBAC: Authorizing `identity:delete_project(project_id=632d45e72d574f1da981a8e5a89b97ec)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:25:53.131186 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb97083c-49ee-421a-a90b-cdfb00dfc551 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:25:53.173993 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-bb97083c-49ee-421a-a90b-cdfb00dfc551 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '632d45e72d574f1da981a8e5a89b97ec', 'request_id': 'req-bb97083c-49ee-421a-a90b-cdfb00dfc551'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:25:53.179755 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-bb97083c-49ee-421a-a90b-cdfb00dfc551 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '632d45e72d574f1da981a8e5a89b97ec', 'request_id': 'req-bb97083c-49ee-421a-a90b-cdfb00dfc551'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:25:53.188042 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-bb97083c-49ee-421a-a90b-cdfb00dfc551 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '632d45e72d574f1da981a8e5a89b97ec', 'request_id': 'req-bb97083c-49ee-421a-a90b-cdfb00dfc551'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:25:53.198044 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-bb97083c-49ee-421a-a90b-cdfb00dfc551 admin admin] The token cache is being invalidate because project 632d45e72d574f1da981a8e5a89b97ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:25:53.198323 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-bb97083c-49ee-421a-a90b-cdfb00dfc551 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:25:53.199503 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-bb97083c-49ee-421a-a90b-cdfb00dfc551 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:25:53.201310 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1145/2288] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:25:53 2022] DELETE /identity/v3/projects/632d45e72d574f1da981a8e5a89b97ec => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:25:53.206426 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc8a7e-24bb-456e-8b29-731282098877 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:53.206912 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc8a7e-24bb-456e-8b29-731282098877 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:53.207090 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc8a7e-24bb-456e-8b29-731282098877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:53.225884 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-50bc8a7e-24bb-456e-8b29-731282098877 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:25:53.227123 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-50bc8a7e-24bb-456e-8b29-731282098877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:25:53.291318 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1144/2289] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:25:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:25:53.299244 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f9018-ab15-4329-8afe-ae267df86797 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:53.299529 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f9018-ab15-4329-8afe-ae267df86797 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:53.299803 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f9018-ab15-4329-8afe-ae267df86797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:53.318080 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-ca8f9018-ab15-4329-8afe-ae267df86797 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:25:53.319275 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-ca8f9018-ab15-4329-8afe-ae267df86797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:25:53.328094 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1146/2290] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:25:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:25:53.332241 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc8a7e-24bb-456e-8b29-731282098877 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:25:53.341614 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc8a7e-24bb-456e-8b29-731282098877 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:25:53.346100 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3472aa7-6507-4117-a3c8-64c217e2a01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:25:53.346738 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3472aa7-6507-4117-a3c8-64c217e2a01e admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:53.347015 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3472aa7-6507-4117-a3c8-64c217e2a01e admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:53.347287 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3472aa7-6507-4117-a3c8-64c217e2a01e admin admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:53.348005 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3472aa7-6507-4117-a3c8-64c217e2a01e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:25:53.348308 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3472aa7-6507-4117-a3c8-64c217e2a01e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:25:53.349930 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3472aa7-6507-4117-a3c8-64c217e2a01e admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:25:53.361194 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1145/2291] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 17 18:25:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:25:53.365123 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f9018-ab15-4329-8afe-ae267df86797 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:25:53.374537 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f9018-ab15-4329-8afe-ae267df86797 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:25:53.379108 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98648458-7c6e-4a4b-8641-9ad63ca7a1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:25:53.379742 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98648458-7c6e-4a4b-8641-9ad63ca7a1d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:53.380022 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98648458-7c6e-4a4b-8641-9ad63ca7a1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:53.380296 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98648458-7c6e-4a4b-8641-9ad63ca7a1d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:53.380976 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98648458-7c6e-4a4b-8641-9ad63ca7a1d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:25:53.382903 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98648458-7c6e-4a4b-8641-9ad63ca7a1d5 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:25:53.407418 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1147/2292] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:25:53 2022] POST /identity/v3/projects => generated 393 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:25:53.411605 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3472aa7-6507-4117-a3c8-64c217e2a01e admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:25:53.421720 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3472aa7-6507-4117-a3c8-64c217e2a01e admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:25:53.474921 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4517dc08-f877-4090-a095-e4db5ac8594c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:25:53.475570 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4517dc08-f877-4090-a095-e4db5ac8594c admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:53.475852 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4517dc08-f877-4090-a095-e4db5ac8594c admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:53.476121 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4517dc08-f877-4090-a095-e4db5ac8594c admin admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:53.476804 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4517dc08-f877-4090-a095-e4db5ac8594c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:25:53.478717 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4517dc08-f877-4090-a095-e4db5ac8594c admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:25:53.499525 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1146/2293] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:25:53 2022] POST /identity/v3/users => generated 297 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:25:53.503542 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98648458-7c6e-4a4b-8641-9ad63ca7a1d5 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:25:53.514041 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98648458-7c6e-4a4b-8641-9ad63ca7a1d5 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:25:53.518858 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fee70b-3fdc-42a4-b570-bc4fcb0c64a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:25:53.519407 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fee70b-3fdc-42a4-b570-bc4fcb0c64a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:53.519685 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fee70b-3fdc-42a4-b570-bc4fcb0c64a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:53.519951 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fee70b-3fdc-42a4-b570-bc4fcb0c64a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:53.520671 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fee70b-3fdc-42a4-b570-bc4fcb0c64a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:25:53.522304 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fee70b-3fdc-42a4-b570-bc4fcb0c64a7 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:25:53.539108 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1148/2294] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:25:53.544029 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4517dc08-f877-4090-a095-e4db5ac8594c admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:25:53.554182 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4517dc08-f877-4090-a095-e4db5ac8594c admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:25:53.560129 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd71bad-5fe1-4097-8c98-1b19b80c94bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:25:53.561071 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd71bad-5fe1-4097-8c98-1b19b80c94bd admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:53.561411 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd71bad-5fe1-4097-8c98-1b19b80c94bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:53.561713 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd71bad-5fe1-4097-8c98-1b19b80c94bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:53.562471 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd71bad-5fe1-4097-8c98-1b19b80c94bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:25:53.564406 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd71bad-5fe1-4097-8c98-1b19b80c94bd admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:25:53.574467 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1147/2295] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:25:53.584008 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fee70b-3fdc-42a4-b570-bc4fcb0c64a7 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:25:53.593970 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fee70b-3fdc-42a4-b570-bc4fcb0c64a7 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:25:53.598510 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2adc4-d9a4-4f3d-96d9-2e06bbaec8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:25:53.599372 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2adc4-d9a4-4f3d-96d9-2e06bbaec8df admin admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:53.599643 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2adc4-d9a4-4f3d-96d9-2e06bbaec8df admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:53.599913 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2adc4-d9a4-4f3d-96d9-2e06bbaec8df admin admin] PATH_INFO: `/v3/projects/0ece46346c6c40ad94bf20f9c68c5081/users/8823c7eecf17470f9c8e50f6c85f3fb5/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:53.614170 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2adc4-d9a4-4f3d-96d9-2e06bbaec8df admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ece46346c6c40ad94bf20f9c68c5081, user_id=8823c7eecf17470f9c8e50f6c85f3fb5, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:25:53.616803 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2adc4-d9a4-4f3d-96d9-2e06bbaec8df admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:25:53.629963 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1149/2296] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:25:53 2022] PUT /identity/v3/projects/0ece46346c6c40ad94bf20f9c68c5081/users/8823c7eecf17470f9c8e50f6c85f3fb5/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:25:53.640834 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e57399-9795-4e18-a99f-77706a9413b2 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:53.641124 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e57399-9795-4e18-a99f-77706a9413b2 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:53.641401 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e57399-9795-4e18-a99f-77706a9413b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:53.666701 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-e4e57399-9795-4e18-a99f-77706a9413b2 None None] MFA Rules not processed for user `8823c7eecf17470f9c8e50f6c85f3fb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:25:53.668412 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-e4e57399-9795-4e18-a99f-77706a9413b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:25:53.728521 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1148/2297] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:25:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:25:53.733450 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2adc4-d9a4-4f3d-96d9-2e06bbaec8df admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:25:53.793196 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2adc4-d9a4-4f3d-96d9-2e06bbaec8df admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:25:53.797766 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada608e0-1bd2-4bc3-a2f8-c09e996bd8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:25:53.798403 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada608e0-1bd2-4bc3-a2f8-c09e996bd8d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:53.798678 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada608e0-1bd2-4bc3-a2f8-c09e996bd8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:53.798948 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada608e0-1bd2-4bc3-a2f8-c09e996bd8d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:53.799627 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada608e0-1bd2-4bc3-a2f8-c09e996bd8d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:25:53.801518 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada608e0-1bd2-4bc3-a2f8-c09e996bd8d5 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:25:53.825822 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1150/2298] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:25:53 2022] POST /identity/v3/projects => generated 393 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:25:53.829996 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e57399-9795-4e18-a99f-77706a9413b2 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:25:53.841688 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e57399-9795-4e18-a99f-77706a9413b2 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:25:53.905220 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c926768-aba6-4d4b-b737-20d7b7e56572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:25:53.905802 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c926768-aba6-4d4b-b737-20d7b7e56572 admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:53.906081 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c926768-aba6-4d4b-b737-20d7b7e56572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:53.906354 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c926768-aba6-4d4b-b737-20d7b7e56572 admin admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:53.907039 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c926768-aba6-4d4b-b737-20d7b7e56572 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:25:53.908943 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c926768-aba6-4d4b-b737-20d7b7e56572 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:25:53.928479 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1149/2299] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:25:53 2022] POST /identity/v3/users => generated 303 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:25:53.932486 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada608e0-1bd2-4bc3-a2f8-c09e996bd8d5 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:25:53.942726 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada608e0-1bd2-4bc3-a2f8-c09e996bd8d5 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:25:53.947372 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d96e8-9b31-4367-b8dd-b88781d0c7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:25:53.948006 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d96e8-9b31-4367-b8dd-b88781d0c7c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:53.948286 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d96e8-9b31-4367-b8dd-b88781d0c7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:53.948560 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d96e8-9b31-4367-b8dd-b88781d0c7c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:53.949272 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1d96e8-9b31-4367-b8dd-b88781d0c7c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:25:53.951200 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1d96e8-9b31-4367-b8dd-b88781d0c7c0 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:25:53.961392 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1151/2300] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:25:53.965960 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c926768-aba6-4d4b-b737-20d7b7e56572 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:25:53.975770 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c926768-aba6-4d4b-b737-20d7b7e56572 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:25:53.981028 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffd7915-a4f5-4300-96f8-e427bc84d265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:25:53.981923 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd7915-a4f5-4300-96f8-e427bc84d265 admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:53.982205 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd7915-a4f5-4300-96f8-e427bc84d265 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:53.982474 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd7915-a4f5-4300-96f8-e427bc84d265 admin admin] PATH_INFO: `/v3/projects/7d775f44eb7a4916a3b254c9087b9bb9/users/656d4ab2670d4df6a1bdc60bcf1f1abf/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:53.996482 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffd7915-a4f5-4300-96f8-e427bc84d265 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d775f44eb7a4916a3b254c9087b9bb9, user_id=656d4ab2670d4df6a1bdc60bcf1f1abf, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:25:53.999174 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffd7915-a4f5-4300-96f8-e427bc84d265 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:25:54.011399 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1150/2301] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:25:53 2022] PUT /identity/v3/projects/7d775f44eb7a4916a3b254c9087b9bb9/users/656d4ab2670d4df6a1bdc60bcf1f1abf/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:25:54.015314 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d96e8-9b31-4367-b8dd-b88781d0c7c0 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:25:54.024890 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d96e8-9b31-4367-b8dd-b88781d0c7c0 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:25:54.081265 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373a5e9d-a2b0-47ea-9a2f-804d0e865699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:25:54.081957 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a5e9d-a2b0-47ea-9a2f-804d0e865699 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:54.082241 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a5e9d-a2b0-47ea-9a2f-804d0e865699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:54.082517 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a5e9d-a2b0-47ea-9a2f-804d0e865699 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:54.083243 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373a5e9d-a2b0-47ea-9a2f-804d0e865699 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:25:54.085015 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373a5e9d-a2b0-47ea-9a2f-804d0e865699 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:25:54.095381 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1152/2302] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:25:54 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:25:54.099483 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffd7915-a4f5-4300-96f8-e427bc84d265 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:25:54.110106 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffd7915-a4f5-4300-96f8-e427bc84d265 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:25:54.114607 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24a449-07eb-4e61-a09e-b8f42b2e82c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:25:54.115463 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24a449-07eb-4e61-a09e-b8f42b2e82c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:54.115732 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24a449-07eb-4e61-a09e-b8f42b2e82c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:54.115998 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24a449-07eb-4e61-a09e-b8f42b2e82c9 admin admin] PATH_INFO: `/v3/projects/7d775f44eb7a4916a3b254c9087b9bb9/users/656d4ab2670d4df6a1bdc60bcf1f1abf/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:54.117978 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c24a449-07eb-4e61-a09e-b8f42b2e82c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d775f44eb7a4916a3b254c9087b9bb9, user_id=656d4ab2670d4df6a1bdc60bcf1f1abf, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:25:54.120573 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c24a449-07eb-4e61-a09e-b8f42b2e82c9 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:25:54.130633 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1151/2303] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:25:54 2022] PUT /identity/v3/projects/7d775f44eb7a4916a3b254c9087b9bb9/users/656d4ab2670d4df6a1bdc60bcf1f1abf/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:25:54.147937 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f40ce-e896-4532-afbd-6fe388e91ddd None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:54.148465 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f40ce-e896-4532-afbd-6fe388e91ddd None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:54.148586 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f40ce-e896-4532-afbd-6fe388e91ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:54.174600 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-176f40ce-e896-4532-afbd-6fe388e91ddd None None] MFA Rules not processed for user `656d4ab2670d4df6a1bdc60bcf1f1abf`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:25:54.175726 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-176f40ce-e896-4532-afbd-6fe388e91ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:25:54.239771 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1153/2304] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:25:54 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:25:54.250570 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24a449-07eb-4e61-a09e-b8f42b2e82c9 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:25:54.252573 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-8c24a449-07eb-4e61-a09e-b8f42b2e82c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:25:54.309012 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24a449-07eb-4e61-a09e-b8f42b2e82c9 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:25:54.312649 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85cb633-a5db-4b3c-aee5-45a0af9cecd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:25:54.313275 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85cb633-a5db-4b3c-aee5-45a0af9cecd3 service cinder] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:54.313586 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85cb633-a5db-4b3c-aee5-45a0af9cecd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:54.313863 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85cb633-a5db-4b3c-aee5-45a0af9cecd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:54.322630 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85cb633-a5db-4b3c-aee5-45a0af9cecd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:25:54.324542 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85cb633-a5db-4b3c-aee5-45a0af9cecd3 service cinder] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:25:54.334002 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1152/2305] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:25:54 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:25:54.381393 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f40ce-e896-4532-afbd-6fe388e91ddd None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:25:54.382774 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-176f40ce-e896-4532-afbd-6fe388e91ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:25:54.394721 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f40ce-e896-4532-afbd-6fe388e91ddd None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:25:54.398252 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4031fa-73cb-4e7f-8ce6-f1da36c0f12d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:25:54.398869 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4031fa-73cb-4e7f-8ce6-f1da36c0f12d service cinder] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:54.399141 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4031fa-73cb-4e7f-8ce6-f1da36c0f12d service cinder] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:54.399406 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4031fa-73cb-4e7f-8ce6-f1da36c0f12d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:54.453749 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4031fa-73cb-4e7f-8ce6-f1da36c0f12d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:25:54.455093 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4031fa-73cb-4e7f-8ce6-f1da36c0f12d service cinder] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:25:54.463619 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1154/2306] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:25:54 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:25:57.659264 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85cb633-a5db-4b3c-aee5-45a0af9cecd3 service cinder] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:25:57.719642 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85cb633-a5db-4b3c-aee5-45a0af9cecd3 service cinder] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:25:57.724254 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ccfd39-791f-4479-af6e-fac290be1f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:25:57.725113 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ccfd39-791f-4479-af6e-fac290be1f65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:57.725393 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ccfd39-791f-4479-af6e-fac290be1f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:57.725694 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ccfd39-791f-4479-af6e-fac290be1f65 admin admin] PATH_INFO: `/v3/users/8823c7eecf17470f9c8e50f6c85f3fb5` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:57.726865 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ccfd39-791f-4479-af6e-fac290be1f65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8823c7eecf17470f9c8e50f6c85f3fb5)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:25:57.728809 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ccfd39-791f-4479-af6e-fac290be1f65 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:25:57.772717 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-e2ccfd39-791f-4479-af6e-fac290be1f65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8823c7eecf17470f9c8e50f6c85f3fb5'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:25:57.779250 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-e2ccfd39-791f-4479-af6e-fac290be1f65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8823c7eecf17470f9c8e50f6c85f3fb5'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:25:57.779900 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-e2ccfd39-791f-4479-af6e-fac290be1f65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8823c7eecf17470f9c8e50f6c85f3fb5'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:25:57.786775 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-e2ccfd39-791f-4479-af6e-fac290be1f65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8823c7eecf17470f9c8e50f6c85f3fb5'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:25:57.787474 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-e2ccfd39-791f-4479-af6e-fac290be1f65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8823c7eecf17470f9c8e50f6c85f3fb5'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:25:57.803605 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1153/2307] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:25:57 2022] DELETE /identity/v3/users/8823c7eecf17470f9c8e50f6c85f3fb5 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:25:57.808620 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f44359-fdf4-4d7c-ba4e-6fb39135be50 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:57.809108 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f44359-fdf4-4d7c-ba4e-6fb39135be50 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:57.809218 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f44359-fdf4-4d7c-ba4e-6fb39135be50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:57.826416 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-66f44359-fdf4-4d7c-ba4e-6fb39135be50 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:25:57.827602 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-66f44359-fdf4-4d7c-ba4e-6fb39135be50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:25:57.883897 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1155/2308] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:25:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:25:57.894092 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ccfd39-791f-4479-af6e-fac290be1f65 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:25:57.895469 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-e2ccfd39-791f-4479-af6e-fac290be1f65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:25:57.951013 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ccfd39-791f-4479-af6e-fac290be1f65 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:25:57.954669 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a8c50-fa56-4888-a0a2-02c26e8d515a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:25:57.955296 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a8c50-fa56-4888-a0a2-02c26e8d515a service neutron] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:57.955589 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a8c50-fa56-4888-a0a2-02c26e8d515a service neutron] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:57.955848 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a8c50-fa56-4888-a0a2-02c26e8d515a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:57.964647 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a8c50-fa56-4888-a0a2-02c26e8d515a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:25:57.966100 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a8c50-fa56-4888-a0a2-02c26e8d515a service neutron] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:25:57.975331 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1154/2309] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:25:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:25:58.231211 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f44359-fdf4-4d7c-ba4e-6fb39135be50 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:25:58.232672 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-66f44359-fdf4-4d7c-ba4e-6fb39135be50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:25:58.247488 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f44359-fdf4-4d7c-ba4e-6fb39135be50 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:25:58.253324 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c95eac-4d28-456b-96fb-23d9856c3513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:25:58.254180 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c95eac-4d28-456b-96fb-23d9856c3513 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:58.255189 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c95eac-4d28-456b-96fb-23d9856c3513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:58.255645 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c95eac-4d28-456b-96fb-23d9856c3513 admin admin] PATH_INFO: `/v3/projects/0ece46346c6c40ad94bf20f9c68c5081` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:58.256938 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c95eac-4d28-456b-96fb-23d9856c3513 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ece46346c6c40ad94bf20f9c68c5081)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:25:58.258935 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c95eac-4d28-456b-96fb-23d9856c3513 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:25:58.303437 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-63c95eac-4d28-456b-96fb-23d9856c3513 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ece46346c6c40ad94bf20f9c68c5081', 'request_id': 'req-63c95eac-4d28-456b-96fb-23d9856c3513'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:25:58.309269 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-63c95eac-4d28-456b-96fb-23d9856c3513 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ece46346c6c40ad94bf20f9c68c5081', 'request_id': 'req-63c95eac-4d28-456b-96fb-23d9856c3513'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:25:58.316199 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-63c95eac-4d28-456b-96fb-23d9856c3513 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ece46346c6c40ad94bf20f9c68c5081', 'request_id': 'req-63c95eac-4d28-456b-96fb-23d9856c3513'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:25:58.326207 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-63c95eac-4d28-456b-96fb-23d9856c3513 admin admin] The token cache is being invalidate because project 0ece46346c6c40ad94bf20f9c68c5081 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:25:58.326488 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-63c95eac-4d28-456b-96fb-23d9856c3513 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:25:58.327126 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-63c95eac-4d28-456b-96fb-23d9856c3513 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:25:58.328643 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1156/2310] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:25:58 2022] DELETE /identity/v3/projects/0ece46346c6c40ad94bf20f9c68c5081 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:25:58.332647 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a8c50-fa56-4888-a0a2-02c26e8d515a service neutron] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:25:58.342521 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a8c50-fa56-4888-a0a2-02c26e8d515a service neutron] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:25:58.395502 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35818461-ab80-4707-9f3b-48196341ebb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:25:58.396361 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35818461-ab80-4707-9f3b-48196341ebb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:58.396638 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35818461-ab80-4707-9f3b-48196341ebb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:58.396908 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35818461-ab80-4707-9f3b-48196341ebb3 admin admin] PATH_INFO: `/v3/users/656d4ab2670d4df6a1bdc60bcf1f1abf` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:58.398089 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35818461-ab80-4707-9f3b-48196341ebb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=656d4ab2670d4df6a1bdc60bcf1f1abf)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:25:58.400014 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35818461-ab80-4707-9f3b-48196341ebb3 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:25:58.444863 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-35818461-ab80-4707-9f3b-48196341ebb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '656d4ab2670d4df6a1bdc60bcf1f1abf'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:25:58.451630 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-35818461-ab80-4707-9f3b-48196341ebb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '656d4ab2670d4df6a1bdc60bcf1f1abf'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:25:58.457677 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-35818461-ab80-4707-9f3b-48196341ebb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '656d4ab2670d4df6a1bdc60bcf1f1abf'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:25:58.466108 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-35818461-ab80-4707-9f3b-48196341ebb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '656d4ab2670d4df6a1bdc60bcf1f1abf'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:25:58.466794 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-35818461-ab80-4707-9f3b-48196341ebb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '656d4ab2670d4df6a1bdc60bcf1f1abf'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:25:58.483589 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1155/2311] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:25:58 2022] DELETE /identity/v3/users/656d4ab2670d4df6a1bdc60bcf1f1abf => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:25:58.739058 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c95eac-4d28-456b-96fb-23d9856c3513 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:25:58.740482 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-63c95eac-4d28-456b-96fb-23d9856c3513 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:25:58.755505 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c95eac-4d28-456b-96fb-23d9856c3513 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:25:58.812254 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66c4cd-1ce6-4bb5-894e-5cb783bd024c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:25:58.813102 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66c4cd-1ce6-4bb5-894e-5cb783bd024c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:58.813387 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66c4cd-1ce6-4bb5-894e-5cb783bd024c admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:58.813686 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66c4cd-1ce6-4bb5-894e-5cb783bd024c admin admin] PATH_INFO: `/v3/projects/7d775f44eb7a4916a3b254c9087b9bb9` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:58.814926 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b66c4cd-1ce6-4bb5-894e-5cb783bd024c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d775f44eb7a4916a3b254c9087b9bb9)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:25:58.816845 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b66c4cd-1ce6-4bb5-894e-5cb783bd024c admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:25:58.863340 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-5b66c4cd-1ce6-4bb5-894e-5cb783bd024c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d775f44eb7a4916a3b254c9087b9bb9', 'request_id': 'req-5b66c4cd-1ce6-4bb5-894e-5cb783bd024c'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:25:58.869287 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-5b66c4cd-1ce6-4bb5-894e-5cb783bd024c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d775f44eb7a4916a3b254c9087b9bb9', 'request_id': 'req-5b66c4cd-1ce6-4bb5-894e-5cb783bd024c'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:25:58.878406 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-5b66c4cd-1ce6-4bb5-894e-5cb783bd024c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d775f44eb7a4916a3b254c9087b9bb9', 'request_id': 'req-5b66c4cd-1ce6-4bb5-894e-5cb783bd024c'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:25:58.889079 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-5b66c4cd-1ce6-4bb5-894e-5cb783bd024c admin admin] The token cache is being invalidate because project 7d775f44eb7a4916a3b254c9087b9bb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:25:58.889357 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-5b66c4cd-1ce6-4bb5-894e-5cb783bd024c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:25:58.890000 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-5b66c4cd-1ce6-4bb5-894e-5cb783bd024c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:25:58.891785 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1157/2312] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:25:58 2022] DELETE /identity/v3/projects/7d775f44eb7a4916a3b254c9087b9bb9 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:25:58.896595 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101b489-9ee2-4d6e-be6e-fe6004e1e0fc None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:58.897085 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101b489-9ee2-4d6e-be6e-fe6004e1e0fc None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:58.897184 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101b489-9ee2-4d6e-be6e-fe6004e1e0fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:58.915307 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-e101b489-9ee2-4d6e-be6e-fe6004e1e0fc None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:25:58.916483 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-e101b489-9ee2-4d6e-be6e-fe6004e1e0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:25:58.973214 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1156/2313] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:25:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:25:58.981063 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f76bc0-83c3-4127-ba3a-1a84d6b83b79 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:58.981345 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f76bc0-83c3-4127-ba3a-1a84d6b83b79 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:58.981672 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f76bc0-83c3-4127-ba3a-1a84d6b83b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:58.999291 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-e0f76bc0-83c3-4127-ba3a-1a84d6b83b79 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:25:59.000462 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-e0f76bc0-83c3-4127-ba3a-1a84d6b83b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:25:59.008241 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1158/2314] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:25:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:25:59.012675 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101b489-9ee2-4d6e-be6e-fe6004e1e0fc None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:25:59.021877 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101b489-9ee2-4d6e-be6e-fe6004e1e0fc None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:25:59.026344 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586921c-52bf-41ae-a5c7-188235b18a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:25:59.027592 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586921c-52bf-41ae-a5c7-188235b18a51 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:59.027865 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586921c-52bf-41ae-a5c7-188235b18a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:59.028133 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586921c-52bf-41ae-a5c7-188235b18a51 admin admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:59.028842 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586921c-52bf-41ae-a5c7-188235b18a51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:25:59.029141 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586921c-52bf-41ae-a5c7-188235b18a51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:25:59.030756 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586921c-52bf-41ae-a5c7-188235b18a51 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:25:59.041765 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1157/2315] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 17 18:25:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:25:59.045841 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f76bc0-83c3-4127-ba3a-1a84d6b83b79 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:25:59.054664 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f76bc0-83c3-4127-ba3a-1a84d6b83b79 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:25:59.059748 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5e8b7c-a388-4248-a540-aa3393a51604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:25:59.060371 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e8b7c-a388-4248-a540-aa3393a51604 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:59.060646 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e8b7c-a388-4248-a540-aa3393a51604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:59.060921 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e8b7c-a388-4248-a540-aa3393a51604 admin admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:59.061644 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5e8b7c-a388-4248-a540-aa3393a51604 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:25:59.063549 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5e8b7c-a388-4248-a540-aa3393a51604 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:25:59.088492 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1159/2316] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:25:59 2022] POST /identity/v3/projects => generated 379 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:25:59.092407 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586921c-52bf-41ae-a5c7-188235b18a51 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:25:59.102289 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586921c-52bf-41ae-a5c7-188235b18a51 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:25:59.156635 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41172f67-1f93-494b-8b4b-2e265a2f3766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:25:59.157282 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41172f67-1f93-494b-8b4b-2e265a2f3766 admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:59.157590 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41172f67-1f93-494b-8b4b-2e265a2f3766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:59.157861 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41172f67-1f93-494b-8b4b-2e265a2f3766 admin admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:59.158950 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41172f67-1f93-494b-8b4b-2e265a2f3766 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:25:59.160874 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41172f67-1f93-494b-8b4b-2e265a2f3766 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:25:59.180320 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1158/2317] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:25:59 2022] POST /identity/v3/users => generated 290 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:25:59.184807 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5e8b7c-a388-4248-a540-aa3393a51604 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:25:59.195279 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5e8b7c-a388-4248-a540-aa3393a51604 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:25:59.200680 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e18cf-3132-44db-94c9-a6c5f35abb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:25:59.201322 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e18cf-3132-44db-94c9-a6c5f35abb11 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:59.201639 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e18cf-3132-44db-94c9-a6c5f35abb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:59.201913 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e18cf-3132-44db-94c9-a6c5f35abb11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:59.202636 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e18cf-3132-44db-94c9-a6c5f35abb11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:25:59.204225 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e18cf-3132-44db-94c9-a6c5f35abb11 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:25:59.214158 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1160/2318] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:25:59.217842 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41172f67-1f93-494b-8b4b-2e265a2f3766 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:25:59.227411 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41172f67-1f93-494b-8b4b-2e265a2f3766 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:25:59.232040 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751abf17-bb3e-4317-a29d-79bd8a0e720e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:25:59.232677 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751abf17-bb3e-4317-a29d-79bd8a0e720e admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:59.232954 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751abf17-bb3e-4317-a29d-79bd8a0e720e admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:59.233224 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751abf17-bb3e-4317-a29d-79bd8a0e720e admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:59.233972 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751abf17-bb3e-4317-a29d-79bd8a0e720e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:25:59.235564 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751abf17-bb3e-4317-a29d-79bd8a0e720e admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:25:59.245142 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1159/2319] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:25:59.249307 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e18cf-3132-44db-94c9-a6c5f35abb11 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:25:59.259332 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e18cf-3132-44db-94c9-a6c5f35abb11 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:25:59.264488 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8adf4-58f7-4678-bdd5-3d20e26408ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:25:59.265339 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8adf4-58f7-4678-bdd5-3d20e26408ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:59.265649 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8adf4-58f7-4678-bdd5-3d20e26408ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:59.265924 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8adf4-58f7-4678-bdd5-3d20e26408ce admin admin] PATH_INFO: `/v3/projects/2116e35881234374b418aab0305d65fc/users/a419eaf73f7644aa871063006466d05e/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:59.279811 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af8adf4-58f7-4678-bdd5-3d20e26408ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=2116e35881234374b418aab0305d65fc, user_id=a419eaf73f7644aa871063006466d05e, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:25:59.282524 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af8adf4-58f7-4678-bdd5-3d20e26408ce admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:25:59.294775 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1161/2320] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:25:59 2022] PUT /identity/v3/projects/2116e35881234374b418aab0305d65fc/users/a419eaf73f7644aa871063006466d05e/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:25:59.305793 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f53c0-cd91-4df1-afb4-7d69ed640e9b None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:59.306084 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f53c0-cd91-4df1-afb4-7d69ed640e9b None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:59.306359 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f53c0-cd91-4df1-afb4-7d69ed640e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:59.333866 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-333f53c0-cd91-4df1-afb4-7d69ed640e9b None None] MFA Rules not processed for user `a419eaf73f7644aa871063006466d05e`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:25:59.335058 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-333f53c0-cd91-4df1-afb4-7d69ed640e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:25:59.396115 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1160/2321] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:25:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:25:59.400655 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8adf4-58f7-4678-bdd5-3d20e26408ce admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:25:59.459795 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8adf4-58f7-4678-bdd5-3d20e26408ce admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:25:59.464307 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9d6d38-18d8-4f40-9169-b15449d1d85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:25:59.464943 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d6d38-18d8-4f40-9169-b15449d1d85d admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:59.465219 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d6d38-18d8-4f40-9169-b15449d1d85d admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:59.465506 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d6d38-18d8-4f40-9169-b15449d1d85d admin admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:59.466185 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9d6d38-18d8-4f40-9169-b15449d1d85d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:25:59.468050 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9d6d38-18d8-4f40-9169-b15449d1d85d admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:25:59.492049 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1162/2322] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:25:59 2022] POST /identity/v3/projects => generated 379 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:25:59.496762 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f53c0-cd91-4df1-afb4-7d69ed640e9b None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:25:59.507917 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f53c0-cd91-4df1-afb4-7d69ed640e9b None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:25:59.561938 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4435cbff-83fc-48b3-9b3a-8c35be20878f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:25:59.562658 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4435cbff-83fc-48b3-9b3a-8c35be20878f admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:59.562931 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4435cbff-83fc-48b3-9b3a-8c35be20878f admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:59.563202 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4435cbff-83fc-48b3-9b3a-8c35be20878f admin admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:59.563889 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4435cbff-83fc-48b3-9b3a-8c35be20878f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:25:59.565823 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4435cbff-83fc-48b3-9b3a-8c35be20878f admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:25:59.585479 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1161/2323] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:25:59 2022] POST /identity/v3/users => generated 296 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:25:59.590027 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9d6d38-18d8-4f40-9169-b15449d1d85d admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:25:59.599872 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9d6d38-18d8-4f40-9169-b15449d1d85d admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:25:59.604391 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189dfb32-50ba-4b6f-a50f-bd5372a2b534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:25:59.605026 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189dfb32-50ba-4b6f-a50f-bd5372a2b534 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:59.605302 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189dfb32-50ba-4b6f-a50f-bd5372a2b534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:59.605606 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189dfb32-50ba-4b6f-a50f-bd5372a2b534 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:59.606316 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189dfb32-50ba-4b6f-a50f-bd5372a2b534 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:25:59.607889 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189dfb32-50ba-4b6f-a50f-bd5372a2b534 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:25:59.617901 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1163/2324] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:25:59.621773 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4435cbff-83fc-48b3-9b3a-8c35be20878f admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:25:59.631382 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4435cbff-83fc-48b3-9b3a-8c35be20878f admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:25:59.635928 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4411f5-25f9-456b-b740-befcba096a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:25:59.637284 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4411f5-25f9-456b-b740-befcba096a1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:59.637596 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4411f5-25f9-456b-b740-befcba096a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:59.637871 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4411f5-25f9-456b-b740-befcba096a1b admin admin] PATH_INFO: `/v3/projects/caf42189a83c4d9a80cc945b462c51fc/users/2b065db6e2694f2c8412c62b91d822fd/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:59.654037 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4411f5-25f9-456b-b740-befcba096a1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=caf42189a83c4d9a80cc945b462c51fc, user_id=2b065db6e2694f2c8412c62b91d822fd, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:25:59.656836 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4411f5-25f9-456b-b740-befcba096a1b admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:25:59.670261 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1162/2325] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:25:59 2022] PUT /identity/v3/projects/caf42189a83c4d9a80cc945b462c51fc/users/2b065db6e2694f2c8412c62b91d822fd/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:25:59.674174 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189dfb32-50ba-4b6f-a50f-bd5372a2b534 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:25:59.683706 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189dfb32-50ba-4b6f-a50f-bd5372a2b534 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:25:59.738349 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f0c5e-5890-4235-83f8-3f531db81a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:25:59.739003 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f0c5e-5890-4235-83f8-3f531db81a36 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:59.739280 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f0c5e-5890-4235-83f8-3f531db81a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:59.739552 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f0c5e-5890-4235-83f8-3f531db81a36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:59.740301 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f0c5e-5890-4235-83f8-3f531db81a36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:25:59.742008 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f0c5e-5890-4235-83f8-3f531db81a36 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:25:59.751466 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1164/2326] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:25:59 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:25:59.755686 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4411f5-25f9-456b-b740-befcba096a1b admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:25:59.767466 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4411f5-25f9-456b-b740-befcba096a1b admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:25:59.772045 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a3757b-3e37-4142-92a6-42223cc5a600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:25:59.772908 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3757b-3e37-4142-92a6-42223cc5a600 admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:59.773189 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3757b-3e37-4142-92a6-42223cc5a600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:59.773482 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3757b-3e37-4142-92a6-42223cc5a600 admin admin] PATH_INFO: `/v3/projects/caf42189a83c4d9a80cc945b462c51fc/users/2b065db6e2694f2c8412c62b91d822fd/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:59.775486 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a3757b-3e37-4142-92a6-42223cc5a600 admin admin] RBAC: Authorizing `identity:create_grant(project_id=caf42189a83c4d9a80cc945b462c51fc, user_id=2b065db6e2694f2c8412c62b91d822fd, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:25:59.778739 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a3757b-3e37-4142-92a6-42223cc5a600 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:25:59.788484 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1163/2327] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:25:59 2022] PUT /identity/v3/projects/caf42189a83c4d9a80cc945b462c51fc/users/2b065db6e2694f2c8412c62b91d822fd/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:25:59.798466 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f175a3-21fd-4f12-9f8a-dec0330a9f80 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:59.798753 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f175a3-21fd-4f12-9f8a-dec0330a9f80 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:59.799028 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f175a3-21fd-4f12-9f8a-dec0330a9f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:59.826831 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-d5f175a3-21fd-4f12-9f8a-dec0330a9f80 None None] MFA Rules not processed for user `2b065db6e2694f2c8412c62b91d822fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:25:59.828031 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-d5f175a3-21fd-4f12-9f8a-dec0330a9f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:25:59.895134 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1165/2328] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:25:59 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:25:59.906417 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a3757b-3e37-4142-92a6-42223cc5a600 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:25:59.908160 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-56a3757b-3e37-4142-92a6-42223cc5a600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:25:59.962962 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a3757b-3e37-4142-92a6-42223cc5a600 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:25:59.966630 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ffa3c8-9f98-4ca2-ba1b-7bb3dfce489e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:25:59.967257 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ffa3c8-9f98-4ca2-ba1b-7bb3dfce489e service cinder] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:59.967538 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ffa3c8-9f98-4ca2-ba1b-7bb3dfce489e service cinder] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:59.967821 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ffa3c8-9f98-4ca2-ba1b-7bb3dfce489e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:59.976532 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ffa3c8-9f98-4ca2-ba1b-7bb3dfce489e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:25:59.977999 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ffa3c8-9f98-4ca2-ba1b-7bb3dfce489e service cinder] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:25:59.987139 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1164/2329] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:25:59 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:26:00.055770 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f175a3-21fd-4f12-9f8a-dec0330a9f80 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:26:00.065909 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f175a3-21fd-4f12-9f8a-dec0330a9f80 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:26:00.069571 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293419c-9622-4c72-af86-16b1ed386b83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:26:00.070199 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293419c-9622-4c72-af86-16b1ed386b83 service cinder] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:26:00.070476 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293419c-9622-4c72-af86-16b1ed386b83 service cinder] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:26:00.070745 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293419c-9622-4c72-af86-16b1ed386b83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:26:00.124970 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c293419c-9622-4c72-af86-16b1ed386b83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:26:00.126414 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c293419c-9622-4c72-af86-16b1ed386b83 service cinder] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:26:00.134927 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1166/2330] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:26:00 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:26:00.380524 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ffa3c8-9f98-4ca2-ba1b-7bb3dfce489e service cinder] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:26:00.439984 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ffa3c8-9f98-4ca2-ba1b-7bb3dfce489e service cinder] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:26:00.444340 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff3da7-2837-4bb3-86ba-051c75416314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:26:00.445186 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff3da7-2837-4bb3-86ba-051c75416314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:26:00.445479 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff3da7-2837-4bb3-86ba-051c75416314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:26:00.445763 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ff3da7-2837-4bb3-86ba-051c75416314 admin admin] PATH_INFO: `/v3/users/a419eaf73f7644aa871063006466d05e` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:26:00.446939 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ff3da7-2837-4bb3-86ba-051c75416314 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a419eaf73f7644aa871063006466d05e)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:26:00.448879 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ff3da7-2837-4bb3-86ba-051c75416314 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:26:00.492436 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-00ff3da7-2837-4bb3-86ba-051c75416314 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a419eaf73f7644aa871063006466d05e'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:00.499517 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-00ff3da7-2837-4bb3-86ba-051c75416314 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a419eaf73f7644aa871063006466d05e'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:00.500157 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-00ff3da7-2837-4bb3-86ba-051c75416314 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a419eaf73f7644aa871063006466d05e'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:00.507379 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-00ff3da7-2837-4bb3-86ba-051c75416314 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a419eaf73f7644aa871063006466d05e'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:00.507989 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-00ff3da7-2837-4bb3-86ba-051c75416314 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a419eaf73f7644aa871063006466d05e'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:00.524737 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1165/2331] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:26:00 2022] DELETE /identity/v3/users/a419eaf73f7644aa871063006466d05e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:26:00.529713 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d53ba-deed-472d-88ba-c271fbf04373 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:26:00.530084 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d53ba-deed-472d-88ba-c271fbf04373 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:26:00.530425 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d53ba-deed-472d-88ba-c271fbf04373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:26:00.547307 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-323d53ba-deed-472d-88ba-c271fbf04373 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:26:00.548488 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-323d53ba-deed-472d-88ba-c271fbf04373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:26:00.604141 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1167/2332] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:26:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:26:00.614180 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff3da7-2837-4bb3-86ba-051c75416314 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:26:00.615660 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-00ff3da7-2837-4bb3-86ba-051c75416314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:26:00.672291 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ff3da7-2837-4bb3-86ba-051c75416314 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:26:00.676148 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7730f7c4-8d19-49d7-b78e-b170f6e4713f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:26:00.676776 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730f7c4-8d19-49d7-b78e-b170f6e4713f service neutron] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:26:00.677050 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730f7c4-8d19-49d7-b78e-b170f6e4713f service neutron] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:26:00.677319 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730f7c4-8d19-49d7-b78e-b170f6e4713f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:26:00.686433 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7730f7c4-8d19-49d7-b78e-b170f6e4713f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:26:00.687856 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7730f7c4-8d19-49d7-b78e-b170f6e4713f service neutron] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:26:00.697265 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1166/2333] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:26:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:26:00.953346 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d53ba-deed-472d-88ba-c271fbf04373 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:26:00.955518 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-323d53ba-deed-472d-88ba-c271fbf04373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:26:00.970286 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d53ba-deed-472d-88ba-c271fbf04373 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:26:00.975616 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be949a12-77de-4b83-b80b-1e5e780d81eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:26:00.976735 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be949a12-77de-4b83-b80b-1e5e780d81eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:26:00.977268 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be949a12-77de-4b83-b80b-1e5e780d81eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:26:00.978116 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be949a12-77de-4b83-b80b-1e5e780d81eb admin admin] PATH_INFO: `/v3/projects/2116e35881234374b418aab0305d65fc` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:26:00.979455 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be949a12-77de-4b83-b80b-1e5e780d81eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=2116e35881234374b418aab0305d65fc)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:26:00.981369 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be949a12-77de-4b83-b80b-1e5e780d81eb admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:26:01.025365 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-be949a12-77de-4b83-b80b-1e5e780d81eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2116e35881234374b418aab0305d65fc', 'request_id': 'req-be949a12-77de-4b83-b80b-1e5e780d81eb'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:01.031795 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-be949a12-77de-4b83-b80b-1e5e780d81eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2116e35881234374b418aab0305d65fc', 'request_id': 'req-be949a12-77de-4b83-b80b-1e5e780d81eb'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:01.038818 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-be949a12-77de-4b83-b80b-1e5e780d81eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2116e35881234374b418aab0305d65fc', 'request_id': 'req-be949a12-77de-4b83-b80b-1e5e780d81eb'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:01.049055 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-be949a12-77de-4b83-b80b-1e5e780d81eb admin admin] The token cache is being invalidate because project 2116e35881234374b418aab0305d65fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:26:01.049337 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-be949a12-77de-4b83-b80b-1e5e780d81eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:01.049982 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-be949a12-77de-4b83-b80b-1e5e780d81eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:01.051491 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1168/2334] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:26:00 2022] DELETE /identity/v3/projects/2116e35881234374b418aab0305d65fc => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:26:01.055631 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7730f7c4-8d19-49d7-b78e-b170f6e4713f service neutron] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:26:01.064959 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7730f7c4-8d19-49d7-b78e-b170f6e4713f service neutron] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:26:01.118533 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631a74c-024b-4968-9481-60a70d396d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:26:01.119386 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631a74c-024b-4968-9481-60a70d396d3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:26:01.119662 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631a74c-024b-4968-9481-60a70d396d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:26:01.119934 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631a74c-024b-4968-9481-60a70d396d3d admin admin] PATH_INFO: `/v3/users/2b065db6e2694f2c8412c62b91d822fd` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:26:01.121111 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b631a74c-024b-4968-9481-60a70d396d3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b065db6e2694f2c8412c62b91d822fd)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:26:01.123039 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b631a74c-024b-4968-9481-60a70d396d3d admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:26:01.169140 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-b631a74c-024b-4968-9481-60a70d396d3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b065db6e2694f2c8412c62b91d822fd'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:01.175865 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-b631a74c-024b-4968-9481-60a70d396d3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b065db6e2694f2c8412c62b91d822fd'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:01.176514 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-b631a74c-024b-4968-9481-60a70d396d3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b065db6e2694f2c8412c62b91d822fd'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:01.183610 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-b631a74c-024b-4968-9481-60a70d396d3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b065db6e2694f2c8412c62b91d822fd'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:01.184360 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-b631a74c-024b-4968-9481-60a70d396d3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b065db6e2694f2c8412c62b91d822fd'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:01.202132 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1167/2335] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:26:01 2022] DELETE /identity/v3/users/2b065db6e2694f2c8412c62b91d822fd => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:26:01.463254 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be949a12-77de-4b83-b80b-1e5e780d81eb admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:26:01.463254 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-be949a12-77de-4b83-b80b-1e5e780d81eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:26:01.473431 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be949a12-77de-4b83-b80b-1e5e780d81eb admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:26:01.539884 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c502b27f-9e3f-4ffb-b6b0-7e52c3f53e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:26:01.540762 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502b27f-9e3f-4ffb-b6b0-7e52c3f53e17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:26:01.541033 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502b27f-9e3f-4ffb-b6b0-7e52c3f53e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:26:01.541301 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502b27f-9e3f-4ffb-b6b0-7e52c3f53e17 admin admin] PATH_INFO: `/v3/projects/caf42189a83c4d9a80cc945b462c51fc` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:26:01.542519 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c502b27f-9e3f-4ffb-b6b0-7e52c3f53e17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=caf42189a83c4d9a80cc945b462c51fc)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:26:01.544459 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c502b27f-9e3f-4ffb-b6b0-7e52c3f53e17 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:26:01.589081 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-c502b27f-9e3f-4ffb-b6b0-7e52c3f53e17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caf42189a83c4d9a80cc945b462c51fc', 'request_id': 'req-c502b27f-9e3f-4ffb-b6b0-7e52c3f53e17'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:01.595400 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-c502b27f-9e3f-4ffb-b6b0-7e52c3f53e17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caf42189a83c4d9a80cc945b462c51fc', 'request_id': 'req-c502b27f-9e3f-4ffb-b6b0-7e52c3f53e17'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:01.602219 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-c502b27f-9e3f-4ffb-b6b0-7e52c3f53e17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caf42189a83c4d9a80cc945b462c51fc', 'request_id': 'req-c502b27f-9e3f-4ffb-b6b0-7e52c3f53e17'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:01.612090 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-c502b27f-9e3f-4ffb-b6b0-7e52c3f53e17 admin admin] The token cache is being invalidate because project caf42189a83c4d9a80cc945b462c51fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:26:01.612367 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-c502b27f-9e3f-4ffb-b6b0-7e52c3f53e17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:01.612966 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-c502b27f-9e3f-4ffb-b6b0-7e52c3f53e17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:01.614513 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1169/2336] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:26:01 2022] DELETE /identity/v3/projects/caf42189a83c4d9a80cc945b462c51fc => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:26:01.619362 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412b907-3f5b-4b2b-b18f-161348e0b9b9 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:26:01.619640 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412b907-3f5b-4b2b-b18f-161348e0b9b9 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:26:01.619909 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7412b907-3f5b-4b2b-b18f-161348e0b9b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:26:01.638350 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-7412b907-3f5b-4b2b-b18f-161348e0b9b9 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:26:01.639521 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-7412b907-3f5b-4b2b-b18f-161348e0b9b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:26:01.698422 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1168/2337] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:26:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:26:01.706658 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb972a52-f94a-45f9-b4f9-3d7755c0062d None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:26:01.706884 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb972a52-f94a-45f9-b4f9-3d7755c0062d None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:26:01.707157 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb972a52-f94a-45f9-b4f9-3d7755c0062d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:26:01.725048 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-eb972a52-f94a-45f9-b4f9-3d7755c0062d None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:26:01.726259 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-eb972a52-f94a-45f9-b4f9-3d7755c0062d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:26:01.734464 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1170/2338] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:26:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:26:01.738567 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7412b907-3f5b-4b2b-b18f-161348e0b9b9 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:26:01.748700 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7412b907-3f5b-4b2b-b18f-161348e0b9b9 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:26:01.753247 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb83c6c-f22e-4219-9455-8d36e3569f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:26:01.753920 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb83c6c-f22e-4219-9455-8d36e3569f98 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:26:01.754202 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb83c6c-f22e-4219-9455-8d36e3569f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:26:01.754477 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb83c6c-f22e-4219-9455-8d36e3569f98 admin admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:26:01.755192 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb83c6c-f22e-4219-9455-8d36e3569f98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:26:01.755495 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb83c6c-f22e-4219-9455-8d36e3569f98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:26:01.757075 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb83c6c-f22e-4219-9455-8d36e3569f98 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:26:01.768267 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1169/2339] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 17 18:26:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:26:01.772372 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb972a52-f94a-45f9-b4f9-3d7755c0062d None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:26:01.781268 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb972a52-f94a-45f9-b4f9-3d7755c0062d None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:26:01.785892 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e585e9e5-9462-4a43-b9cc-38cde180d731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:26:01.786518 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585e9e5-9462-4a43-b9cc-38cde180d731 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:26:01.786799 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585e9e5-9462-4a43-b9cc-38cde180d731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:26:01.787065 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585e9e5-9462-4a43-b9cc-38cde180d731 admin admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:26:01.787745 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e585e9e5-9462-4a43-b9cc-38cde180d731 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:26:01.789652 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e585e9e5-9462-4a43-b9cc-38cde180d731 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:26:01.817005 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1171/2340] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:26:01 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:26:01.821313 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb83c6c-f22e-4219-9455-8d36e3569f98 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:26:01.831384 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb83c6c-f22e-4219-9455-8d36e3569f98 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:26:01.886372 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f0324e-b415-4ffc-93c3-59e4b77d3553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:26:01.887024 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0324e-b415-4ffc-93c3-59e4b77d3553 admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:26:01.887300 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0324e-b415-4ffc-93c3-59e4b77d3553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:26:01.887597 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0324e-b415-4ffc-93c3-59e4b77d3553 admin admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:26:01.888265 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f0324e-b415-4ffc-93c3-59e4b77d3553 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:26:01.890218 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f0324e-b415-4ffc-93c3-59e4b77d3553 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:26:01.908363 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1170/2341] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:26:01 2022] POST /identity/v3/users => generated 287 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:26:01.912532 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e585e9e5-9462-4a43-b9cc-38cde180d731 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:26:01.923248 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e585e9e5-9462-4a43-b9cc-38cde180d731 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:26:01.927843 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb8b5d9-c97c-431b-b5be-f6e472ca5f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:26:01.928497 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8b5d9-c97c-431b-b5be-f6e472ca5f75 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:26:01.928779 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8b5d9-c97c-431b-b5be-f6e472ca5f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:26:01.929053 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8b5d9-c97c-431b-b5be-f6e472ca5f75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:26:01.929842 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb8b5d9-c97c-431b-b5be-f6e472ca5f75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:26:01.931473 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb8b5d9-c97c-431b-b5be-f6e472ca5f75 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:26:01.942389 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1172/2342] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:26:01.946212 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f0324e-b415-4ffc-93c3-59e4b77d3553 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:26:01.956496 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f0324e-b415-4ffc-93c3-59e4b77d3553 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:26:01.961199 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b941cf-10a8-4701-afa7-e9e819f22dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:26:01.961822 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b941cf-10a8-4701-afa7-e9e819f22dfd admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:26:01.962100 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b941cf-10a8-4701-afa7-e9e819f22dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:26:01.962374 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b941cf-10a8-4701-afa7-e9e819f22dfd admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:26:01.963086 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b941cf-10a8-4701-afa7-e9e819f22dfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:26:01.964729 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b941cf-10a8-4701-afa7-e9e819f22dfd admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:26:01.974390 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1171/2343] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:26:01.978397 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb8b5d9-c97c-431b-b5be-f6e472ca5f75 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:26:01.988512 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb8b5d9-c97c-431b-b5be-f6e472ca5f75 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:26:01.993024 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2361c498-fc57-44c9-80c3-54e16add1e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:26:01.993898 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2361c498-fc57-44c9-80c3-54e16add1e16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:26:01.994169 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2361c498-fc57-44c9-80c3-54e16add1e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:26:01.994433 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2361c498-fc57-44c9-80c3-54e16add1e16 admin admin] PATH_INFO: `/v3/projects/d2aeb1823d654f0e9892cf2ab0c34544/users/188ed8094a25420ba2db6ce53d34023a/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:26:02.008656 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2361c498-fc57-44c9-80c3-54e16add1e16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2aeb1823d654f0e9892cf2ab0c34544, user_id=188ed8094a25420ba2db6ce53d34023a, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:26:02.011312 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2361c498-fc57-44c9-80c3-54e16add1e16 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:26:02.023826 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1173/2344] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:26:01 2022] PUT /identity/v3/projects/d2aeb1823d654f0e9892cf2ab0c34544/users/188ed8094a25420ba2db6ce53d34023a/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:26:02.029277 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d21ef-9685-4279-9bd5-48dfd1cc7336 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:26:02.029600 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d21ef-9685-4279-9bd5-48dfd1cc7336 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:26:02.029877 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d21ef-9685-4279-9bd5-48dfd1cc7336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:26:02.047457 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-2e6d21ef-9685-4279-9bd5-48dfd1cc7336 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:26:02.048629 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-2e6d21ef-9685-4279-9bd5-48dfd1cc7336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:26:02.104219 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1172/2345] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:26:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:26:02.114151 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2361c498-fc57-44c9-80c3-54e16add1e16 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:26:02.115838 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-2361c498-fc57-44c9-80c3-54e16add1e16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:26:02.170223 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2361c498-fc57-44c9-80c3-54e16add1e16 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:26:02.173837 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08337e3-866d-483a-86ef-74e1214766e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:26:02.174463 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08337e3-866d-483a-86ef-74e1214766e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:26:02.174742 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08337e3-866d-483a-86ef-74e1214766e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:26:02.175015 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08337e3-866d-483a-86ef-74e1214766e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:26:02.183675 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08337e3-866d-483a-86ef-74e1214766e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:26:02.185117 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08337e3-866d-483a-86ef-74e1214766e5 service neutron] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:26:02.194205 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1174/2346] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:26:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:26:02.990180 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c558d9d-e4dd-4885-a7df-a60aacc67507 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:26:02.990463 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c558d9d-e4dd-4885-a7df-a60aacc67507 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:26:02.990754 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c558d9d-e4dd-4885-a7df-a60aacc67507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:26:03.017180 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-1c558d9d-e4dd-4885-a7df-a60aacc67507 None None] MFA Rules not processed for user `188ed8094a25420ba2db6ce53d34023a`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:26:03.018497 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-1c558d9d-e4dd-4885-a7df-a60aacc67507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:26:03.084523 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1173/2347] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:26:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:26:03.089497 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08337e3-866d-483a-86ef-74e1214766e5 service neutron] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:26:03.099347 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08337e3-866d-483a-86ef-74e1214766e5 service neutron] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:26:03.103955 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb6917b-763f-4698-9091-db8d94b36012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:26:03.104592 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb6917b-763f-4698-9091-db8d94b36012 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:26:03.104868 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb6917b-763f-4698-9091-db8d94b36012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:26:03.105137 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb6917b-763f-4698-9091-db8d94b36012 admin admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:26:03.105889 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb6917b-763f-4698-9091-db8d94b36012 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:26:03.107773 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb6917b-763f-4698-9091-db8d94b36012 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:26:03.132070 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1175/2348] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:26:03 2022] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:26:03.136016 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c558d9d-e4dd-4885-a7df-a60aacc67507 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:26:03.147732 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c558d9d-e4dd-4885-a7df-a60aacc67507 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:26:03.203777 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b6ee6-058d-4f55-8150-7c09ae423d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:26:03.204750 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b6ee6-058d-4f55-8150-7c09ae423d37 admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:26:03.205029 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b6ee6-058d-4f55-8150-7c09ae423d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:26:03.205296 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b6ee6-058d-4f55-8150-7c09ae423d37 admin admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:26:03.206003 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b6ee6-058d-4f55-8150-7c09ae423d37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:26:03.207897 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b6ee6-058d-4f55-8150-7c09ae423d37 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:26:03.228373 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1174/2349] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:26:03 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:26:03.232544 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb6917b-763f-4698-9091-db8d94b36012 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:26:03.242519 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb6917b-763f-4698-9091-db8d94b36012 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:26:03.247042 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e7d20-770c-4709-84b0-3a4bc2d28afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:26:03.247683 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e7d20-770c-4709-84b0-3a4bc2d28afc admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:26:03.247963 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e7d20-770c-4709-84b0-3a4bc2d28afc admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:26:03.248237 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e7d20-770c-4709-84b0-3a4bc2d28afc admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:26:03.248950 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249e7d20-770c-4709-84b0-3a4bc2d28afc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:26:03.250566 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249e7d20-770c-4709-84b0-3a4bc2d28afc admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:26:03.261601 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1176/2350] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:26:03.266205 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b6ee6-058d-4f55-8150-7c09ae423d37 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:26:03.275687 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b6ee6-058d-4f55-8150-7c09ae423d37 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:26:03.280779 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d6cd4-a812-4af8-8d05-11a6139c6175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:26:03.281662 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d6cd4-a812-4af8-8d05-11a6139c6175 admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:26:03.281934 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d6cd4-a812-4af8-8d05-11a6139c6175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:26:03.282196 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d6cd4-a812-4af8-8d05-11a6139c6175 admin admin] PATH_INFO: `/v3/projects/755e65d1eee147ac93425c1537d5f3cb/users/043cd7465fa74de7bb551f0ae0ee84f6/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:26:03.296667 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375d6cd4-a812-4af8-8d05-11a6139c6175 admin admin] RBAC: Authorizing `identity:create_grant(project_id=755e65d1eee147ac93425c1537d5f3cb, user_id=043cd7465fa74de7bb551f0ae0ee84f6, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:26:03.299333 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375d6cd4-a812-4af8-8d05-11a6139c6175 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:26:03.311671 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1175/2351] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:26:03 2022] PUT /identity/v3/projects/755e65d1eee147ac93425c1537d5f3cb/users/043cd7465fa74de7bb551f0ae0ee84f6/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:26:03.315550 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e7d20-770c-4709-84b0-3a4bc2d28afc admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:26:03.325937 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e7d20-770c-4709-84b0-3a4bc2d28afc admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:26:03.381519 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2895e5b7-f9a6-48a6-9b02-88adc5ac1f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:26:03.382173 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895e5b7-f9a6-48a6-9b02-88adc5ac1f83 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:26:03.382450 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895e5b7-f9a6-48a6-9b02-88adc5ac1f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:26:03.382721 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2895e5b7-f9a6-48a6-9b02-88adc5ac1f83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:26:03.383426 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2895e5b7-f9a6-48a6-9b02-88adc5ac1f83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:26:03.385005 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2895e5b7-f9a6-48a6-9b02-88adc5ac1f83 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:26:03.394352 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1177/2352] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:26:03.398370 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d6cd4-a812-4af8-8d05-11a6139c6175 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:26:03.408382 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d6cd4-a812-4af8-8d05-11a6139c6175 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:26:03.412848 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eab2cb-b92a-42f6-9a08-81c5b48c2e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:26:03.413738 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eab2cb-b92a-42f6-9a08-81c5b48c2e73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:26:03.414013 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eab2cb-b92a-42f6-9a08-81c5b48c2e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:26:03.414312 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eab2cb-b92a-42f6-9a08-81c5b48c2e73 admin admin] PATH_INFO: `/v3/projects/755e65d1eee147ac93425c1537d5f3cb/users/043cd7465fa74de7bb551f0ae0ee84f6/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:26:03.416237 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eab2cb-b92a-42f6-9a08-81c5b48c2e73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=755e65d1eee147ac93425c1537d5f3cb, user_id=043cd7465fa74de7bb551f0ae0ee84f6, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:26:03.419418 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eab2cb-b92a-42f6-9a08-81c5b48c2e73 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:26:03.429095 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1176/2353] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:26:03 2022] PUT /identity/v3/projects/755e65d1eee147ac93425c1537d5f3cb/users/043cd7465fa74de7bb551f0ae0ee84f6/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:26:04.020246 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf958fd-2c95-45c5-8e68-714f2cb2bb32 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:26:04.020535 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf958fd-2c95-45c5-8e68-714f2cb2bb32 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:26:04.020862 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf958fd-2c95-45c5-8e68-714f2cb2bb32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:26:04.046835 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-adf958fd-2c95-45c5-8e68-714f2cb2bb32 None None] MFA Rules not processed for user `043cd7465fa74de7bb551f0ae0ee84f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:26:04.048082 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-adf958fd-2c95-45c5-8e68-714f2cb2bb32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:26:04.115472 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1178/2354] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:26:04 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:26:04.126453 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eab2cb-b92a-42f6-9a08-81c5b48c2e73 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:26:04.128102 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-92eab2cb-b92a-42f6-9a08-81c5b48c2e73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:26:04.185230 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eab2cb-b92a-42f6-9a08-81c5b48c2e73 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:26:04.188941 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a428dfc-88b5-4cfa-a9ec-ff80686511cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:26:04.189629 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a428dfc-88b5-4cfa-a9ec-ff80686511cc service cinder] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:26:04.189910 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a428dfc-88b5-4cfa-a9ec-ff80686511cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:26:04.190185 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a428dfc-88b5-4cfa-a9ec-ff80686511cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:26:04.253558 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a428dfc-88b5-4cfa-a9ec-ff80686511cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:26:04.254930 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a428dfc-88b5-4cfa-a9ec-ff80686511cc service cinder] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:26:04.263992 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1177/2355] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:26:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:26:05.592644 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf958fd-2c95-45c5-8e68-714f2cb2bb32 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:26:05.594099 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-adf958fd-2c95-45c5-8e68-714f2cb2bb32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:26:05.605698 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf958fd-2c95-45c5-8e68-714f2cb2bb32 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:26:05.609267 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666c034-37b9-4583-acb4-d49b28b90895 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:26:05.609974 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666c034-37b9-4583-acb4-d49b28b90895 service cinder] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:26:05.610255 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666c034-37b9-4583-acb4-d49b28b90895 service cinder] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:26:05.610526 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666c034-37b9-4583-acb4-d49b28b90895 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:26:05.619429 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9666c034-37b9-4583-acb4-d49b28b90895 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:26:05.620847 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9666c034-37b9-4583-acb4-d49b28b90895 service cinder] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:26:05.630161 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1179/2356] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:26:05 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:26:18.302240 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a428dfc-88b5-4cfa-a9ec-ff80686511cc service cinder] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:26:18.366637 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a428dfc-88b5-4cfa-a9ec-ff80686511cc service cinder] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:26:18.371407 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb5412-0f83-4eb9-8bee-b30986e9ba18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:26:18.372284 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb5412-0f83-4eb9-8bee-b30986e9ba18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:26:18.372559 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb5412-0f83-4eb9-8bee-b30986e9ba18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:26:18.372827 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb5412-0f83-4eb9-8bee-b30986e9ba18 admin admin] PATH_INFO: `/v3/users/188ed8094a25420ba2db6ce53d34023a` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:26:18.374017 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fb5412-0f83-4eb9-8bee-b30986e9ba18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=188ed8094a25420ba2db6ce53d34023a)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:26:18.375970 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fb5412-0f83-4eb9-8bee-b30986e9ba18 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:26:18.419180 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-c7fb5412-0f83-4eb9-8bee-b30986e9ba18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '188ed8094a25420ba2db6ce53d34023a'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:18.426121 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-c7fb5412-0f83-4eb9-8bee-b30986e9ba18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '188ed8094a25420ba2db6ce53d34023a'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:18.426787 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-c7fb5412-0f83-4eb9-8bee-b30986e9ba18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '188ed8094a25420ba2db6ce53d34023a'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:18.434808 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-c7fb5412-0f83-4eb9-8bee-b30986e9ba18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '188ed8094a25420ba2db6ce53d34023a'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:18.435497 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-c7fb5412-0f83-4eb9-8bee-b30986e9ba18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '188ed8094a25420ba2db6ce53d34023a'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:18.452000 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1178/2357] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:26:18 2022] DELETE /identity/v3/users/188ed8094a25420ba2db6ce53d34023a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:26:18.615003 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666c034-37b9-4583-acb4-d49b28b90895 service cinder] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:26:18.628119 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666c034-37b9-4583-acb4-d49b28b90895 service cinder] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:26:18.681768 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d44076-3313-45d6-b4b5-56800e61cd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:26:18.682615 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d44076-3313-45d6-b4b5-56800e61cd44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:26:18.682895 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d44076-3313-45d6-b4b5-56800e61cd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:26:18.683166 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d44076-3313-45d6-b4b5-56800e61cd44 admin admin] PATH_INFO: `/v3/projects/d2aeb1823d654f0e9892cf2ab0c34544` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:26:18.684630 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d44076-3313-45d6-b4b5-56800e61cd44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2aeb1823d654f0e9892cf2ab0c34544)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:26:18.686618 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d44076-3313-45d6-b4b5-56800e61cd44 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:26:18.730790 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-19d44076-3313-45d6-b4b5-56800e61cd44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2aeb1823d654f0e9892cf2ab0c34544', 'request_id': 'req-19d44076-3313-45d6-b4b5-56800e61cd44'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:18.736532 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-19d44076-3313-45d6-b4b5-56800e61cd44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2aeb1823d654f0e9892cf2ab0c34544', 'request_id': 'req-19d44076-3313-45d6-b4b5-56800e61cd44'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:18.743422 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-19d44076-3313-45d6-b4b5-56800e61cd44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2aeb1823d654f0e9892cf2ab0c34544', 'request_id': 'req-19d44076-3313-45d6-b4b5-56800e61cd44'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:18.753204 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-19d44076-3313-45d6-b4b5-56800e61cd44 admin admin] The token cache is being invalidate because project d2aeb1823d654f0e9892cf2ab0c34544 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:26:18.753505 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-19d44076-3313-45d6-b4b5-56800e61cd44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:18.754112 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-19d44076-3313-45d6-b4b5-56800e61cd44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:18.755651 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1180/2358] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:26:18 2022] DELETE /identity/v3/projects/d2aeb1823d654f0e9892cf2ab0c34544 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:26:18.759613 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb5412-0f83-4eb9-8bee-b30986e9ba18 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:26:18.760980 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-c7fb5412-0f83-4eb9-8bee-b30986e9ba18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:26:18.774094 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb5412-0f83-4eb9-8bee-b30986e9ba18 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:26:18.829044 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ef496-b427-4567-a2b5-3c156f961de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:26:18.829866 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ef496-b427-4567-a2b5-3c156f961de3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:26:18.830142 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ef496-b427-4567-a2b5-3c156f961de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:26:18.830414 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ef496-b427-4567-a2b5-3c156f961de3 admin admin] PATH_INFO: `/v3/users/043cd7465fa74de7bb551f0ae0ee84f6` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:26:18.831598 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5ef496-b427-4567-a2b5-3c156f961de3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=043cd7465fa74de7bb551f0ae0ee84f6)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:26:18.833546 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5ef496-b427-4567-a2b5-3c156f961de3 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:26:18.877411 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-dd5ef496-b427-4567-a2b5-3c156f961de3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '043cd7465fa74de7bb551f0ae0ee84f6'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:18.884166 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-dd5ef496-b427-4567-a2b5-3c156f961de3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '043cd7465fa74de7bb551f0ae0ee84f6'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:18.884819 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-dd5ef496-b427-4567-a2b5-3c156f961de3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '043cd7465fa74de7bb551f0ae0ee84f6'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:18.892367 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-dd5ef496-b427-4567-a2b5-3c156f961de3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '043cd7465fa74de7bb551f0ae0ee84f6'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:18.892973 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-dd5ef496-b427-4567-a2b5-3c156f961de3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '043cd7465fa74de7bb551f0ae0ee84f6'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:18.909694 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1179/2359] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:26:18 2022] DELETE /identity/v3/users/043cd7465fa74de7bb551f0ae0ee84f6 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:26:19.072766 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d44076-3313-45d6-b4b5-56800e61cd44 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:26:19.074249 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-19d44076-3313-45d6-b4b5-56800e61cd44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:26:19.087595 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d44076-3313-45d6-b4b5-56800e61cd44 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:26:19.142615 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107056aa-71c9-402c-9dcf-bbc9cd1f55d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:26:19.143487 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107056aa-71c9-402c-9dcf-bbc9cd1f55d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:26:19.143766 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107056aa-71c9-402c-9dcf-bbc9cd1f55d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:26:19.144037 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107056aa-71c9-402c-9dcf-bbc9cd1f55d0 admin admin] PATH_INFO: `/v3/projects/755e65d1eee147ac93425c1537d5f3cb` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:26:19.145206 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107056aa-71c9-402c-9dcf-bbc9cd1f55d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=755e65d1eee147ac93425c1537d5f3cb)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:26:19.147170 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107056aa-71c9-402c-9dcf-bbc9cd1f55d0 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:26:19.190944 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-107056aa-71c9-402c-9dcf-bbc9cd1f55d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '755e65d1eee147ac93425c1537d5f3cb', 'request_id': 'req-107056aa-71c9-402c-9dcf-bbc9cd1f55d0'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:19.196727 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-107056aa-71c9-402c-9dcf-bbc9cd1f55d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '755e65d1eee147ac93425c1537d5f3cb', 'request_id': 'req-107056aa-71c9-402c-9dcf-bbc9cd1f55d0'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:19.204695 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-107056aa-71c9-402c-9dcf-bbc9cd1f55d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '755e65d1eee147ac93425c1537d5f3cb', 'request_id': 'req-107056aa-71c9-402c-9dcf-bbc9cd1f55d0'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:19.215378 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-107056aa-71c9-402c-9dcf-bbc9cd1f55d0 admin admin] The token cache is being invalidate because project 755e65d1eee147ac93425c1537d5f3cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:26:19.215860 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-107056aa-71c9-402c-9dcf-bbc9cd1f55d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:19.216486 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-107056aa-71c9-402c-9dcf-bbc9cd1f55d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:19.218018 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1181/2360] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:26:19 2022] DELETE /identity/v3/projects/755e65d1eee147ac93425c1537d5f3cb => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:26:19.223759 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52248a9c-6a16-498a-af57-bb6ac4e2d6d5 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:26:19.224043 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52248a9c-6a16-498a-af57-bb6ac4e2d6d5 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:26:19.224311 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52248a9c-6a16-498a-af57-bb6ac4e2d6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:26:19.241726 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-52248a9c-6a16-498a-af57-bb6ac4e2d6d5 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:26:19.242935 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-52248a9c-6a16-498a-af57-bb6ac4e2d6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:26:19.301831 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1180/2361] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:26:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:26:19.310939 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56c5b3-a8e8-47ba-b558-8e68d2056eef None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:26:19.311218 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56c5b3-a8e8-47ba-b558-8e68d2056eef None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:26:19.311514 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56c5b3-a8e8-47ba-b558-8e68d2056eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:26:19.329312 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-6b56c5b3-a8e8-47ba-b558-8e68d2056eef None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:26:19.330583 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-6b56c5b3-a8e8-47ba-b558-8e68d2056eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:26:19.338250 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1182/2362] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:26:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:26:19.342616 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52248a9c-6a16-498a-af57-bb6ac4e2d6d5 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:26:19.351915 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52248a9c-6a16-498a-af57-bb6ac4e2d6d5 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:26:19.356839 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1dfff8-e2ea-49b8-b9d7-f85f917ed1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:26:19.357501 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1dfff8-e2ea-49b8-b9d7-f85f917ed1c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:26:19.357780 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1dfff8-e2ea-49b8-b9d7-f85f917ed1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:26:19.358051 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1dfff8-e2ea-49b8-b9d7-f85f917ed1c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:26:19.358759 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1dfff8-e2ea-49b8-b9d7-f85f917ed1c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:26:19.359060 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1dfff8-e2ea-49b8-b9d7-f85f917ed1c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:26:19.360678 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1dfff8-e2ea-49b8-b9d7-f85f917ed1c3 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:26:19.371994 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1181/2363] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 17 18:26:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:26:19.376730 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56c5b3-a8e8-47ba-b558-8e68d2056eef None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:26:19.385551 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56c5b3-a8e8-47ba-b558-8e68d2056eef None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:26:19.390344 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c7d57-d3ab-4b61-b751-5478df10268c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:26:19.390995 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c7d57-d3ab-4b61-b751-5478df10268c admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:26:19.391271 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c7d57-d3ab-4b61-b751-5478df10268c admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:26:19.391540 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c7d57-d3ab-4b61-b751-5478df10268c admin admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:26:19.392218 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60c7d57-d3ab-4b61-b751-5478df10268c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:26:19.394134 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60c7d57-d3ab-4b61-b751-5478df10268c admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:26:19.417683 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1183/2364] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:26:19 2022] POST /identity/v3/projects => generated 373 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:26:19.422151 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1dfff8-e2ea-49b8-b9d7-f85f917ed1c3 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:26:19.431740 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1dfff8-e2ea-49b8-b9d7-f85f917ed1c3 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:26:19.493023 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d13057-7033-4f54-83c7-e94bbc35f4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:26:19.493713 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d13057-7033-4f54-83c7-e94bbc35f4da admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:26:19.494020 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d13057-7033-4f54-83c7-e94bbc35f4da admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:26:19.494306 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d13057-7033-4f54-83c7-e94bbc35f4da admin admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:26:19.494980 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d13057-7033-4f54-83c7-e94bbc35f4da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:26:19.497506 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d13057-7033-4f54-83c7-e94bbc35f4da admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:26:19.516402 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1182/2365] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:26:19 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:26:19.520963 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c7d57-d3ab-4b61-b751-5478df10268c admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:26:19.531335 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c7d57-d3ab-4b61-b751-5478df10268c admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:26:19.535881 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce6819-ad4a-4e3f-8e61-735664f8f1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:26:19.536528 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce6819-ad4a-4e3f-8e61-735664f8f1ab admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:26:19.536810 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce6819-ad4a-4e3f-8e61-735664f8f1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:26:19.537083 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce6819-ad4a-4e3f-8e61-735664f8f1ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:26:19.537839 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ce6819-ad4a-4e3f-8e61-735664f8f1ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:26:19.539428 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ce6819-ad4a-4e3f-8e61-735664f8f1ab admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:26:19.550172 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1184/2366] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:26:19.553970 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d13057-7033-4f54-83c7-e94bbc35f4da admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:26:19.564251 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d13057-7033-4f54-83c7-e94bbc35f4da admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:26:19.568802 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11921cce-af6a-4616-9391-93e99b51fb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:26:19.569438 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11921cce-af6a-4616-9391-93e99b51fb5d admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:26:19.569748 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11921cce-af6a-4616-9391-93e99b51fb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:26:19.570017 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11921cce-af6a-4616-9391-93e99b51fb5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:26:19.570726 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11921cce-af6a-4616-9391-93e99b51fb5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:26:19.572330 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11921cce-af6a-4616-9391-93e99b51fb5d admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:26:19.582498 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1183/2367] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:26:19.586439 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce6819-ad4a-4e3f-8e61-735664f8f1ab admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:26:19.596246 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce6819-ad4a-4e3f-8e61-735664f8f1ab admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:26:19.600730 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5044ee-411d-4a97-9235-c5e8c6acf4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:26:19.601619 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5044ee-411d-4a97-9235-c5e8c6acf4e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:26:19.601893 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5044ee-411d-4a97-9235-c5e8c6acf4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:26:19.602161 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5044ee-411d-4a97-9235-c5e8c6acf4e2 admin admin] PATH_INFO: `/v3/projects/7c88151132894c38874f6c453c9177f6/users/edb9684cd47f46538fc4faf85bdf29fa/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:26:19.616562 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5044ee-411d-4a97-9235-c5e8c6acf4e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c88151132894c38874f6c453c9177f6, user_id=edb9684cd47f46538fc4faf85bdf29fa, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:26:19.619226 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5044ee-411d-4a97-9235-c5e8c6acf4e2 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:26:19.632247 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1185/2368] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:26:19 2022] PUT /identity/v3/projects/7c88151132894c38874f6c453c9177f6/users/edb9684cd47f46538fc4faf85bdf29fa/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:26:19.637284 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aad953-e9f2-4e24-934f-8c3b14df50fe None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:26:19.637605 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aad953-e9f2-4e24-934f-8c3b14df50fe None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:26:19.637909 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aad953-e9f2-4e24-934f-8c3b14df50fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:26:19.655512 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-93aad953-e9f2-4e24-934f-8c3b14df50fe None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:26:19.656708 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-93aad953-e9f2-4e24-934f-8c3b14df50fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:26:19.713558 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1184/2369] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:26:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:26:19.723594 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5044ee-411d-4a97-9235-c5e8c6acf4e2 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:26:19.725269 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-1d5044ee-411d-4a97-9235-c5e8c6acf4e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:26:19.791703 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5044ee-411d-4a97-9235-c5e8c6acf4e2 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:26:19.796741 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c10505-37a8-489c-a13f-27d2e5acff69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:26:19.797566 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c10505-37a8-489c-a13f-27d2e5acff69 service neutron] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:26:19.797892 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c10505-37a8-489c-a13f-27d2e5acff69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:26:19.798358 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c10505-37a8-489c-a13f-27d2e5acff69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:26:19.808301 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c10505-37a8-489c-a13f-27d2e5acff69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:26:19.809797 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c10505-37a8-489c-a13f-27d2e5acff69 service neutron] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:26:19.820141 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1186/2370] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:26:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:26:20.398630 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d3f0ab-0d15-4cd1-bcca-c5dd561930b7 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:26:20.399117 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d3f0ab-0d15-4cd1-bcca-c5dd561930b7 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:26:20.399351 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d3f0ab-0d15-4cd1-bcca-c5dd561930b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:26:20.424639 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-d9d3f0ab-0d15-4cd1-bcca-c5dd561930b7 None None] MFA Rules not processed for user `edb9684cd47f46538fc4faf85bdf29fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:26:20.425863 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-d9d3f0ab-0d15-4cd1-bcca-c5dd561930b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:26:20.489137 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1185/2371] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:26:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:26:20.500719 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c10505-37a8-489c-a13f-27d2e5acff69 service neutron] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:26:20.502226 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-69c10505-37a8-489c-a13f-27d2e5acff69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:26:20.561695 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c10505-37a8-489c-a13f-27d2e5acff69 service neutron] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:26:20.565434 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ea221-f5dc-4126-b4a3-8de7d6f1877f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:26:20.566095 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ea221-f5dc-4126-b4a3-8de7d6f1877f service cinder] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:26:20.566370 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ea221-f5dc-4126-b4a3-8de7d6f1877f service cinder] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:26:20.566637 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ea221-f5dc-4126-b4a3-8de7d6f1877f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:26:20.575001 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ea221-f5dc-4126-b4a3-8de7d6f1877f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:26:20.577331 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ea221-f5dc-4126-b4a3-8de7d6f1877f service cinder] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:26:20.585912 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1187/2372] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:26:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:26:21.912075 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb35db4-3adc-46e0-8555-1ccd90ab7974 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:26:21.912583 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb35db4-3adc-46e0-8555-1ccd90ab7974 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:26:21.912690 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb35db4-3adc-46e0-8555-1ccd90ab7974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:26:21.929528 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-5eb35db4-3adc-46e0-8555-1ccd90ab7974 None None] MFA Rules not processed for user `edb9684cd47f46538fc4faf85bdf29fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:26:21.930704 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-5eb35db4-3adc-46e0-8555-1ccd90ab7974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:26:21.937804 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1186/2373] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:26:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:26:35.422499 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953574a9-2a9c-4e40-a813-a69a53e2736f None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:26:35.422989 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953574a9-2a9c-4e40-a813-a69a53e2736f None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:26:35.423472 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953574a9-2a9c-4e40-a813-a69a53e2736f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:26:35.440400 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-953574a9-2a9c-4e40-a813-a69a53e2736f None None] MFA Rules not processed for user `f370e353067848b5843c5650183be347`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:26:35.441659 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-953574a9-2a9c-4e40-a813-a69a53e2736f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:26:35.497251 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1188/2374] 10.222.0.65 () {58 vars in 967 bytes} [Tue May 17 18:26:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:26:35.544894 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb35db4-3adc-46e0-8555-1ccd90ab7974 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:26:35.546397 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-5eb35db4-3adc-46e0-8555-1ccd90ab7974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:26:35.620096 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb35db4-3adc-46e0-8555-1ccd90ab7974 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:26:35.625001 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c34308-3f73-4ff7-9852-f52cdc0ce4bf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1464e84a3a2d4321a98b98d398bc7be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:26:35.625667 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c34308-3f73-4ff7-9852-f52cdc0ce4bf service swift] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:26:35.626100 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c34308-3f73-4ff7-9852-f52cdc0ce4bf service swift] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:26:35.626377 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c34308-3f73-4ff7-9852-f52cdc0ce4bf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:26:35.636967 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c34308-3f73-4ff7-9852-f52cdc0ce4bf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:26:35.638640 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c34308-3f73-4ff7-9852-f52cdc0ce4bf service swift] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:26:35.646637 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1187/2375] 10.222.0.65 () {60 vars in 1384 bytes} [Tue May 17 18:26:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 18:26:39.584960 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08709ce-d3da-4961-9b62-2682a18cf5c2 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:26:39.585518 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08709ce-d3da-4961-9b62-2682a18cf5c2 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:26:39.585620 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08709ce-d3da-4961-9b62-2682a18cf5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:26:39.603895 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-f08709ce-d3da-4961-9b62-2682a18cf5c2 None None] MFA Rules not processed for user `edb9684cd47f46538fc4faf85bdf29fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:26:39.605111 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-f08709ce-d3da-4961-9b62-2682a18cf5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:26:39.612860 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1189/2376] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:26:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:26:43.445987 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c34308-3f73-4ff7-9852-f52cdc0ce4bf service swift] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:26:43.447510 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-d7c34308-3f73-4ff7-9852-f52cdc0ce4bf service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:26:43.462621 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c34308-3f73-4ff7-9852-f52cdc0ce4bf service swift] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:26:43.467272 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82449512-2ac3-4a85-84b3-7221e7447e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:26:43.468135 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82449512-2ac3-4a85-84b3-7221e7447e6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:26:43.468416 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82449512-2ac3-4a85-84b3-7221e7447e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:26:43.468693 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82449512-2ac3-4a85-84b3-7221e7447e6c admin admin] PATH_INFO: `/v3/users/5dee3ac46621470a9b5fac6574820e93` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:26:43.469951 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82449512-2ac3-4a85-84b3-7221e7447e6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dee3ac46621470a9b5fac6574820e93)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:26:43.471940 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82449512-2ac3-4a85-84b3-7221e7447e6c admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:26:43.518461 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-82449512-2ac3-4a85-84b3-7221e7447e6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dee3ac46621470a9b5fac6574820e93'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:43.525030 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-82449512-2ac3-4a85-84b3-7221e7447e6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dee3ac46621470a9b5fac6574820e93'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:43.525704 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-82449512-2ac3-4a85-84b3-7221e7447e6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dee3ac46621470a9b5fac6574820e93'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:43.532837 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-82449512-2ac3-4a85-84b3-7221e7447e6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dee3ac46621470a9b5fac6574820e93'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:43.533479 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-82449512-2ac3-4a85-84b3-7221e7447e6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dee3ac46621470a9b5fac6574820e93'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:43.551255 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1188/2377] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:26:43 2022] DELETE /identity/v3/users/5dee3ac46621470a9b5fac6574820e93 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:26:43.714930 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08709ce-d3da-4961-9b62-2682a18cf5c2 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:26:43.726107 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08709ce-d3da-4961-9b62-2682a18cf5c2 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:26:43.788896 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a30afb0-33fe-4d6a-a943-b76352c336a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:26:43.790333 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30afb0-33fe-4d6a-a943-b76352c336a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:26:43.790770 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30afb0-33fe-4d6a-a943-b76352c336a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:26:43.791222 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30afb0-33fe-4d6a-a943-b76352c336a1 admin admin] PATH_INFO: `/v3/projects/271959139e4a4e058a5a56cbdfc8cdcb` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:26:43.792916 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a30afb0-33fe-4d6a-a943-b76352c336a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=271959139e4a4e058a5a56cbdfc8cdcb)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:26:43.795661 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a30afb0-33fe-4d6a-a943-b76352c336a1 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:26:43.852737 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-0a30afb0-33fe-4d6a-a943-b76352c336a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '271959139e4a4e058a5a56cbdfc8cdcb', 'request_id': 'req-0a30afb0-33fe-4d6a-a943-b76352c336a1'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:43.859665 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-0a30afb0-33fe-4d6a-a943-b76352c336a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '271959139e4a4e058a5a56cbdfc8cdcb', 'request_id': 'req-0a30afb0-33fe-4d6a-a943-b76352c336a1'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:43.869274 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-0a30afb0-33fe-4d6a-a943-b76352c336a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '271959139e4a4e058a5a56cbdfc8cdcb', 'request_id': 'req-0a30afb0-33fe-4d6a-a943-b76352c336a1'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:43.890231 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-0a30afb0-33fe-4d6a-a943-b76352c336a1 admin admin] The token cache is being invalidate because project 271959139e4a4e058a5a56cbdfc8cdcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:26:43.890592 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-0a30afb0-33fe-4d6a-a943-b76352c336a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:43.891289 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-0a30afb0-33fe-4d6a-a943-b76352c336a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:43.892911 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1190/2378] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:26:43 2022] DELETE /identity/v3/projects/271959139e4a4e058a5a56cbdfc8cdcb => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:26:43.896930 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82449512-2ac3-4a85-84b3-7221e7447e6c admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:26:43.898444 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-82449512-2ac3-4a85-84b3-7221e7447e6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:26:43.912119 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82449512-2ac3-4a85-84b3-7221e7447e6c admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:26:43.968728 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c7748-3d96-4838-a6af-5fe46a24bea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:26:43.969622 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c7748-3d96-4838-a6af-5fe46a24bea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:26:43.969901 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c7748-3d96-4838-a6af-5fe46a24bea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:26:43.970173 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c7748-3d96-4838-a6af-5fe46a24bea0 admin admin] PATH_INFO: `/v3/users/6eab80ec1143481a8338b060bb1433d9` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:26:43.971327 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400c7748-3d96-4838-a6af-5fe46a24bea0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6eab80ec1143481a8338b060bb1433d9)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:26:43.973227 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400c7748-3d96-4838-a6af-5fe46a24bea0 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:26:44.018329 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-400c7748-3d96-4838-a6af-5fe46a24bea0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6eab80ec1143481a8338b060bb1433d9'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:44.024799 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-400c7748-3d96-4838-a6af-5fe46a24bea0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6eab80ec1143481a8338b060bb1433d9'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:44.025469 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-400c7748-3d96-4838-a6af-5fe46a24bea0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6eab80ec1143481a8338b060bb1433d9'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:44.033233 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-400c7748-3d96-4838-a6af-5fe46a24bea0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6eab80ec1143481a8338b060bb1433d9'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:44.033852 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-400c7748-3d96-4838-a6af-5fe46a24bea0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6eab80ec1143481a8338b060bb1433d9'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:44.050084 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1189/2379] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:26:43 2022] DELETE /identity/v3/users/6eab80ec1143481a8338b060bb1433d9 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:26:44.230655 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a30afb0-33fe-4d6a-a943-b76352c336a1 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:26:44.232093 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-0a30afb0-33fe-4d6a-a943-b76352c336a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:26:44.244529 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a30afb0-33fe-4d6a-a943-b76352c336a1 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:26:44.304676 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab8931-0aff-4e64-990d-a10eb558a552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:26:44.305562 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab8931-0aff-4e64-990d-a10eb558a552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:26:44.305843 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab8931-0aff-4e64-990d-a10eb558a552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:26:44.306121 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ab8931-0aff-4e64-990d-a10eb558a552 admin admin] PATH_INFO: `/v3/projects/298c01b6cb2c4ba08a12e93476db8a04` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:26:44.307314 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ab8931-0aff-4e64-990d-a10eb558a552 admin admin] RBAC: Authorizing `identity:delete_project(project_id=298c01b6cb2c4ba08a12e93476db8a04)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:26:44.309225 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ab8931-0aff-4e64-990d-a10eb558a552 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:26:44.356796 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-a0ab8931-0aff-4e64-990d-a10eb558a552 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '298c01b6cb2c4ba08a12e93476db8a04', 'request_id': 'req-a0ab8931-0aff-4e64-990d-a10eb558a552'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:44.362724 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-a0ab8931-0aff-4e64-990d-a10eb558a552 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '298c01b6cb2c4ba08a12e93476db8a04', 'request_id': 'req-a0ab8931-0aff-4e64-990d-a10eb558a552'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:44.369653 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-a0ab8931-0aff-4e64-990d-a10eb558a552 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '298c01b6cb2c4ba08a12e93476db8a04', 'request_id': 'req-a0ab8931-0aff-4e64-990d-a10eb558a552'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:44.379897 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-a0ab8931-0aff-4e64-990d-a10eb558a552 admin admin] The token cache is being invalidate because project 298c01b6cb2c4ba08a12e93476db8a04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:26:44.380182 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-a0ab8931-0aff-4e64-990d-a10eb558a552 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:44.380804 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-a0ab8931-0aff-4e64-990d-a10eb558a552 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:44.382351 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1191/2380] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:26:44 2022] DELETE /identity/v3/projects/298c01b6cb2c4ba08a12e93476db8a04 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:27:01.387418 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6144b72-23dd-4daa-a7f6-99447f46abb4 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:27:01.387922 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6144b72-23dd-4daa-a7f6-99447f46abb4 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:27:01.388024 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6144b72-23dd-4daa-a7f6-99447f46abb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:27:01.405706 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-b6144b72-23dd-4daa-a7f6-99447f46abb4 None None] MFA Rules not processed for user `f370e353067848b5843c5650183be347`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:27:01.407523 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-b6144b72-23dd-4daa-a7f6-99447f46abb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:27:01.459309 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1190/2381] 10.222.0.65 () {58 vars in 1009 bytes} [Tue May 17 18:27:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:27:01.471897 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab8931-0aff-4e64-990d-a10eb558a552 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:27:01.473262 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-a0ab8931-0aff-4e64-990d-a10eb558a552 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:27:01.541351 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ab8931-0aff-4e64-990d-a10eb558a552 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:27:01.546431 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b77ba5-5af2-48e0-9022-7910f50c38c4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1464e84a3a2d4321a98b98d398bc7be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:27:01.547067 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b77ba5-5af2-48e0-9022-7910f50c38c4 service swift] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:27:01.547349 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b77ba5-5af2-48e0-9022-7910f50c38c4 service swift] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:27:01.547624 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b77ba5-5af2-48e0-9022-7910f50c38c4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:27:01.555846 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b77ba5-5af2-48e0-9022-7910f50c38c4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:27:01.557765 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b77ba5-5af2-48e0-9022-7910f50c38c4 service swift] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:27:01.566349 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1192/2382] 10.222.0.65 () {60 vars in 1384 bytes} [Tue May 17 18:27:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 18:27:05.347383 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6144b72-23dd-4daa-a7f6-99447f46abb4 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:27:05.348845 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-b6144b72-23dd-4daa-a7f6-99447f46abb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:27:05.412161 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6144b72-23dd-4daa-a7f6-99447f46abb4 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:27:05.416387 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c9d08e-5efa-4883-9974-a82e545050c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:27:05.417055 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c9d08e-5efa-4883-9974-a82e545050c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:27:05.417315 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c9d08e-5efa-4883-9974-a82e545050c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:27:05.417640 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c9d08e-5efa-4883-9974-a82e545050c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:27:05.419400 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-83c9d08e-5efa-4883-9974-a82e545050c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:27:05.508559 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c9d08e-5efa-4883-9974-a82e545050c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:27:05.510856 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c9d08e-5efa-4883-9974-a82e545050c6 service cinder] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:27:05.523801 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1191/2383] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:27:05 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:27:14.065204 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed97e6-c896-4539-b773-d70a67f94729 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:27:14.065779 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed97e6-c896-4539-b773-d70a67f94729 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:27:14.065924 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed97e6-c896-4539-b773-d70a67f94729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:27:14.085950 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-96ed97e6-c896-4539-b773-d70a67f94729 None None] MFA Rules not processed for user `13b4ec46d3cb49faba3f063dcfd644c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:27:14.087515 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-96ed97e6-c896-4539-b773-d70a67f94729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:27:14.149147 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1193/2384] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:27:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:27:19.046448 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7a962-4b6d-40e7-8580-b248d65e9d92 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:27:19.048319 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7a962-4b6d-40e7-8580-b248d65e9d92 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:27:19.048841 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde7a962-4b6d-40e7-8580-b248d65e9d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:27:19.078022 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-fde7a962-4b6d-40e7-8580-b248d65e9d92 None None] MFA Rules not processed for user `861ad9a7c63a4d66a1806c4576cddce5`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:27:19.080802 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-fde7a962-4b6d-40e7-8580-b248d65e9d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:27:19.094854 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1192/2385] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:27:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:27:21.858028 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ddb634-4a26-4830-a27a-16978636cee3 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:27:21.858556 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ddb634-4a26-4830-a27a-16978636cee3 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:27:21.858719 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ddb634-4a26-4830-a27a-16978636cee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:27:21.878514 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-37ddb634-4a26-4830-a27a-16978636cee3 None None] MFA Rules not processed for user `f370e353067848b5843c5650183be347`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:27:21.879712 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-37ddb634-4a26-4830-a27a-16978636cee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:27:21.894057 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1194/2386] 10.222.0.65 () {58 vars in 967 bytes} [Tue May 17 18:27:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:27:21.904061 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde7a962-4b6d-40e7-8580-b248d65e9d92 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:27:21.916427 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde7a962-4b6d-40e7-8580-b248d65e9d92 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:27:21.927712 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745100aa-614b-4bce-a282-bd88010587ec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1464e84a3a2d4321a98b98d398bc7be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:27:21.928515 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745100aa-614b-4bce-a282-bd88010587ec service swift] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:27:21.928873 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745100aa-614b-4bce-a282-bd88010587ec service swift] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:27:21.929214 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745100aa-614b-4bce-a282-bd88010587ec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:27:21.940516 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745100aa-614b-4bce-a282-bd88010587ec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:27:21.942384 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745100aa-614b-4bce-a282-bd88010587ec service swift] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:27:21.951903 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1193/2387] 10.222.0.65 () {60 vars in 1384 bytes} [Tue May 17 18:27:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 18:27:24.346630 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ddb634-4a26-4830-a27a-16978636cee3 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:27:24.348025 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-37ddb634-4a26-4830-a27a-16978636cee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:27:24.420161 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ddb634-4a26-4830-a27a-16978636cee3 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:27:24.426050 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66e3bc9-c830-4c86-b2a9-3c7831fcfd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:27:24.426809 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e3bc9-c830-4c86-b2a9-3c7831fcfd6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:27:24.427083 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e3bc9-c830-4c86-b2a9-3c7831fcfd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:27:24.427353 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e3bc9-c830-4c86-b2a9-3c7831fcfd6e admin admin] PATH_INFO: `/v3/users/edb9684cd47f46538fc4faf85bdf29fa` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:27:24.428567 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66e3bc9-c830-4c86-b2a9-3c7831fcfd6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=edb9684cd47f46538fc4faf85bdf29fa)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:27:24.430540 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66e3bc9-c830-4c86-b2a9-3c7831fcfd6e admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:27:24.481198 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-a66e3bc9-c830-4c86-b2a9-3c7831fcfd6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edb9684cd47f46538fc4faf85bdf29fa'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:27:24.493405 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-a66e3bc9-c830-4c86-b2a9-3c7831fcfd6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edb9684cd47f46538fc4faf85bdf29fa'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:27:24.494123 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-a66e3bc9-c830-4c86-b2a9-3c7831fcfd6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edb9684cd47f46538fc4faf85bdf29fa'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:27:24.494727 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-a66e3bc9-c830-4c86-b2a9-3c7831fcfd6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edb9684cd47f46538fc4faf85bdf29fa'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:27:24.502005 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-a66e3bc9-c830-4c86-b2a9-3c7831fcfd6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edb9684cd47f46538fc4faf85bdf29fa'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:27:24.515691 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1195/2388] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:27:24 2022] DELETE /identity/v3/users/edb9684cd47f46538fc4faf85bdf29fa => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:27:24.761955 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745100aa-614b-4bce-a282-bd88010587ec service swift] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:27:24.773708 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745100aa-614b-4bce-a282-bd88010587ec service swift] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:27:24.832443 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f3556-e247-4593-b2a7-1e32a320f3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:27:24.833974 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f3556-e247-4593-b2a7-1e32a320f3fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:27:24.834246 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f3556-e247-4593-b2a7-1e32a320f3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:27:24.834679 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f3556-e247-4593-b2a7-1e32a320f3fb admin admin] PATH_INFO: `/v3/projects/7c88151132894c38874f6c453c9177f6` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:27:24.835890 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270f3556-e247-4593-b2a7-1e32a320f3fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c88151132894c38874f6c453c9177f6)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:27:24.837831 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270f3556-e247-4593-b2a7-1e32a320f3fb admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:27:24.894739 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-270f3556-e247-4593-b2a7-1e32a320f3fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c88151132894c38874f6c453c9177f6', 'request_id': 'req-270f3556-e247-4593-b2a7-1e32a320f3fb'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:27:24.900807 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-270f3556-e247-4593-b2a7-1e32a320f3fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c88151132894c38874f6c453c9177f6', 'request_id': 'req-270f3556-e247-4593-b2a7-1e32a320f3fb'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:27:24.909198 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-270f3556-e247-4593-b2a7-1e32a320f3fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c88151132894c38874f6c453c9177f6', 'request_id': 'req-270f3556-e247-4593-b2a7-1e32a320f3fb'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:27:24.919433 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-270f3556-e247-4593-b2a7-1e32a320f3fb admin admin] The token cache is being invalidate because project 7c88151132894c38874f6c453c9177f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:27:24.919738 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-270f3556-e247-4593-b2a7-1e32a320f3fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:27:24.920361 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-270f3556-e247-4593-b2a7-1e32a320f3fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:27:24.922647 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1194/2389] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:27:24 2022] DELETE /identity/v3/projects/7c88151132894c38874f6c453c9177f6 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:27:24.927464 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f51a9d-ea3e-4c5c-a04d-03dcdf0df8f1 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:27:24.927736 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f51a9d-ea3e-4c5c-a04d-03dcdf0df8f1 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:27:24.928013 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f51a9d-ea3e-4c5c-a04d-03dcdf0df8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:27:24.946619 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-10f51a9d-ea3e-4c5c-a04d-03dcdf0df8f1 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:27:24.947816 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-10f51a9d-ea3e-4c5c-a04d-03dcdf0df8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:27:25.007304 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1196/2390] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:27:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:27:25.015199 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019020da-85bd-4db3-a8c8-e9d05f034bf6 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:27:25.015502 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019020da-85bd-4db3-a8c8-e9d05f034bf6 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:27:25.015805 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019020da-85bd-4db3-a8c8-e9d05f034bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:27:25.033873 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-019020da-85bd-4db3-a8c8-e9d05f034bf6 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:27:25.035058 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-019020da-85bd-4db3-a8c8-e9d05f034bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:27:25.042881 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1195/2391] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:27:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:27:25.047532 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f51a9d-ea3e-4c5c-a04d-03dcdf0df8f1 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:27:25.056841 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f51a9d-ea3e-4c5c-a04d-03dcdf0df8f1 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:27:25.061256 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d3fea5-cd6c-4ac8-b37c-0db5f29a6689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:27:25.061919 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3fea5-cd6c-4ac8-b37c-0db5f29a6689 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:27:25.062203 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3fea5-cd6c-4ac8-b37c-0db5f29a6689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:27:25.062459 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3fea5-cd6c-4ac8-b37c-0db5f29a6689 admin admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:27:25.063168 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d3fea5-cd6c-4ac8-b37c-0db5f29a6689 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:27:25.063466 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d3fea5-cd6c-4ac8-b37c-0db5f29a6689 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:27:25.065059 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d3fea5-cd6c-4ac8-b37c-0db5f29a6689 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:27:25.076246 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1197/2392] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 17 18:27:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:27:25.080304 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019020da-85bd-4db3-a8c8-e9d05f034bf6 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:27:25.089191 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019020da-85bd-4db3-a8c8-e9d05f034bf6 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:27:25.094211 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa3658-1a42-462f-8ea3-39df3d35ebb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:27:25.094831 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa3658-1a42-462f-8ea3-39df3d35ebb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:27:25.095106 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa3658-1a42-462f-8ea3-39df3d35ebb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:27:25.095375 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa3658-1a42-462f-8ea3-39df3d35ebb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:27:25.096045 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaa3658-1a42-462f-8ea3-39df3d35ebb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:27:25.097956 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaa3658-1a42-462f-8ea3-39df3d35ebb3 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:27:25.122308 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1196/2393] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:27:25 2022] POST /identity/v3/projects => generated 369 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:27:25.126066 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d3fea5-cd6c-4ac8-b37c-0db5f29a6689 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:27:25.135556 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d3fea5-cd6c-4ac8-b37c-0db5f29a6689 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:27:25.191621 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0a6c5b-6321-4cc1-9fec-7ee38b3cab42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:27:25.192281 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a6c5b-6321-4cc1-9fec-7ee38b3cab42 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:27:25.192564 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a6c5b-6321-4cc1-9fec-7ee38b3cab42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:27:25.192836 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a6c5b-6321-4cc1-9fec-7ee38b3cab42 admin admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:27:25.193549 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0a6c5b-6321-4cc1-9fec-7ee38b3cab42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:27:25.195453 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0a6c5b-6321-4cc1-9fec-7ee38b3cab42 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:27:25.216030 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1198/2394] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:27:25 2022] POST /identity/v3/users => generated 285 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:27:25.220733 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa3658-1a42-462f-8ea3-39df3d35ebb3 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:27:25.230909 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa3658-1a42-462f-8ea3-39df3d35ebb3 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:27:25.235504 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c47f8-3906-42c2-a48f-b55a575708a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:27:25.236150 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c47f8-3906-42c2-a48f-b55a575708a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:27:25.236430 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c47f8-3906-42c2-a48f-b55a575708a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:27:25.236704 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c47f8-3906-42c2-a48f-b55a575708a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:27:25.237444 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8c47f8-3906-42c2-a48f-b55a575708a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:27:25.239268 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8c47f8-3906-42c2-a48f-b55a575708a7 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:27:25.249956 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1197/2395] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:27:25.254187 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0a6c5b-6321-4cc1-9fec-7ee38b3cab42 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:27:25.265948 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0a6c5b-6321-4cc1-9fec-7ee38b3cab42 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:27:25.270595 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc815cdb-5aa8-407d-8875-0c517ac3c2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:27:25.271243 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc815cdb-5aa8-407d-8875-0c517ac3c2c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:27:25.271523 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc815cdb-5aa8-407d-8875-0c517ac3c2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:27:25.271795 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc815cdb-5aa8-407d-8875-0c517ac3c2c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:27:25.272516 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc815cdb-5aa8-407d-8875-0c517ac3c2c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:27:25.274137 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc815cdb-5aa8-407d-8875-0c517ac3c2c0 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:27:25.284640 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1199/2396] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:27:25.288797 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c47f8-3906-42c2-a48f-b55a575708a7 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:27:25.299222 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8c47f8-3906-42c2-a48f-b55a575708a7 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:27:25.304464 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8267345-23b9-4949-b390-10f04d31da63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:27:25.305438 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8267345-23b9-4949-b390-10f04d31da63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:27:25.305821 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8267345-23b9-4949-b390-10f04d31da63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:27:25.306157 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8267345-23b9-4949-b390-10f04d31da63 admin admin] PATH_INFO: `/v3/projects/028cf941f881466ba25dd5209677486d/users/1467ae14ba4740c3803e655dc64729ed/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:27:25.323083 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8267345-23b9-4949-b390-10f04d31da63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=028cf941f881466ba25dd5209677486d, user_id=1467ae14ba4740c3803e655dc64729ed, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:27:25.326254 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8267345-23b9-4949-b390-10f04d31da63 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:27:25.340216 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1198/2397] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:27:25 2022] PUT /identity/v3/projects/028cf941f881466ba25dd5209677486d/users/1467ae14ba4740c3803e655dc64729ed/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:27:25.404384 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08efc2-a423-4116-94ae-1aa9bfd644ee None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:27:25.404958 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08efc2-a423-4116-94ae-1aa9bfd644ee None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:27:25.405143 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08efc2-a423-4116-94ae-1aa9bfd644ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:27:25.444834 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-1b08efc2-a423-4116-94ae-1aa9bfd644ee None None] MFA Rules not processed for user `1467ae14ba4740c3803e655dc64729ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:27:25.446220 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-1b08efc2-a423-4116-94ae-1aa9bfd644ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:27:25.512666 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1200/2398] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:27:25 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:27:25.524826 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8267345-23b9-4949-b390-10f04d31da63 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:27:25.526607 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-b8267345-23b9-4949-b390-10f04d31da63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:27:25.586610 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8267345-23b9-4949-b390-10f04d31da63 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:27:25.590424 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f058e0-23a4-4461-a41d-1b7c55a9cec9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce570634a66b45158d940151828f533a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:27:25.591168 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f058e0-23a4-4461-a41d-1b7c55a9cec9 service glance] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:27:25.591516 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f058e0-23a4-4461-a41d-1b7c55a9cec9 service glance] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:27:25.591920 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f058e0-23a4-4461-a41d-1b7c55a9cec9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:27:25.601212 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f058e0-23a4-4461-a41d-1b7c55a9cec9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:27:25.602734 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f058e0-23a4-4461-a41d-1b7c55a9cec9 service glance] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:27:25.612254 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1199/2399] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:27:25 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:27:28.170891 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08efc2-a423-4116-94ae-1aa9bfd644ee None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:27:28.172852 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-1b08efc2-a423-4116-94ae-1aa9bfd644ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:27:28.228585 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08efc2-a423-4116-94ae-1aa9bfd644ee None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:27:28.232174 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698dde55-02c5-482e-a1a4-ab10ae4018d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:27:28.232802 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698dde55-02c5-482e-a1a4-ab10ae4018d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:27:28.233077 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698dde55-02c5-482e-a1a4-ab10ae4018d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:27:28.233346 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698dde55-02c5-482e-a1a4-ab10ae4018d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:27:28.235118 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-698dde55-02c5-482e-a1a4-ab10ae4018d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:27:28.306687 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698dde55-02c5-482e-a1a4-ab10ae4018d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:27:28.308117 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698dde55-02c5-482e-a1a4-ab10ae4018d9 service neutron] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:27:28.319909 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1201/2400] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:27:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:27:29.567733 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f058e0-23a4-4461-a41d-1b7c55a9cec9 service glance] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:27:29.577606 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f058e0-23a4-4461-a41d-1b7c55a9cec9 service glance] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:27:29.581181 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6945b9b-8445-43e9-844c-ae23c38390d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:27:29.581838 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6945b9b-8445-43e9-844c-ae23c38390d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:27:29.582116 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6945b9b-8445-43e9-844c-ae23c38390d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:27:29.582391 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6945b9b-8445-43e9-844c-ae23c38390d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:27:29.584148 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-c6945b9b-8445-43e9-844c-ae23c38390d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:27:29.597831 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6945b9b-8445-43e9-844c-ae23c38390d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:27:29.599242 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6945b9b-8445-43e9-844c-ae23c38390d7 service neutron] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:27:29.610905 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1200/2401] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:27:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:27:40.100041 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0a3b7-8370-4132-9132-672f4deb8143 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:27:40.100558 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0a3b7-8370-4132-9132-672f4deb8143 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:27:40.100650 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0a3b7-8370-4132-9132-672f4deb8143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:27:40.118993 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-d8c0a3b7-8370-4132-9132-672f4deb8143 None None] MFA Rules not processed for user `f370e353067848b5843c5650183be347`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:27:40.120182 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-d8c0a3b7-8370-4132-9132-672f4deb8143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:27:40.192448 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1202/2402] 10.222.0.65 () {58 vars in 1009 bytes} [Tue May 17 18:27:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:27:40.222525 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6945b9b-8445-43e9-844c-ae23c38390d7 service neutron] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:27:40.223959 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-c6945b9b-8445-43e9-844c-ae23c38390d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:27:40.295331 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6945b9b-8445-43e9-844c-ae23c38390d7 service neutron] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:27:40.301040 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f05ec-a0da-4712-9396-c50c8d0cfd29 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1464e84a3a2d4321a98b98d398bc7be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:27:40.301742 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f05ec-a0da-4712-9396-c50c8d0cfd29 service swift] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:27:40.302010 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f05ec-a0da-4712-9396-c50c8d0cfd29 service swift] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:27:40.302280 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f05ec-a0da-4712-9396-c50c8d0cfd29 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:27:40.310243 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4f05ec-a0da-4712-9396-c50c8d0cfd29 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:27:40.311871 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4f05ec-a0da-4712-9396-c50c8d0cfd29 service swift] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:27:40.321191 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1201/2403] 10.222.0.65 () {60 vars in 1384 bytes} [Tue May 17 18:27:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 18:27:45.335187 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c0a3b7-8370-4132-9132-672f4deb8143 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:27:45.344285 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c0a3b7-8370-4132-9132-672f4deb8143 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:27:45.347797 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e6c4d-a546-496d-8362-47dc310304eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:27:45.348417 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e6c4d-a546-496d-8362-47dc310304eb service neutron] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:27:45.348693 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e6c4d-a546-496d-8362-47dc310304eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:27:45.348961 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e6c4d-a546-496d-8362-47dc310304eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:27:45.350823 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-497e6c4d-a546-496d-8362-47dc310304eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:27:45.415938 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497e6c4d-a546-496d-8362-47dc310304eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:27:45.417410 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497e6c4d-a546-496d-8362-47dc310304eb service neutron] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:27:45.427352 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1203/2404] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:27:45 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:27:48.117770 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f05ec-a0da-4712-9396-c50c8d0cfd29 service swift] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:27:48.127815 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-2e4f05ec-a0da-4712-9396-c50c8d0cfd29 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:27:48.152153 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f05ec-a0da-4712-9396-c50c8d0cfd29 service swift] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:27:48.162390 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2411d9-a7b5-4fdf-a327-a94d9f21c60a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b430b739cb54fc7911bc89f8ea2df72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:27:48.163118 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2411d9-a7b5-4fdf-a327-a94d9f21c60a service nova] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:27:48.164043 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2411d9-a7b5-4fdf-a327-a94d9f21c60a service nova] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:27:48.164419 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2411d9-a7b5-4fdf-a327-a94d9f21c60a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:27:48.167438 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-3d2411d9-a7b5-4fdf-a327-a94d9f21c60a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:27:48.289980 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2411d9-a7b5-4fdf-a327-a94d9f21c60a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:27:48.291830 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2411d9-a7b5-4fdf-a327-a94d9f21c60a service nova] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:27:48.315924 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1202/2405] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:27:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:27:59.134067 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e6c4d-a546-496d-8362-47dc310304eb service neutron] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:27:59.135556 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-497e6c4d-a546-496d-8362-47dc310304eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:27:59.146689 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e6c4d-a546-496d-8362-47dc310304eb service neutron] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:27:59.150276 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f7e582-a77a-494d-bb9b-1d0d3134b139 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:27:59.150901 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7e582-a77a-494d-bb9b-1d0d3134b139 service neutron] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:27:59.151179 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7e582-a77a-494d-bb9b-1d0d3134b139 service neutron] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:27:59.151452 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f7e582-a77a-494d-bb9b-1d0d3134b139 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:27:59.153148 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-76f7e582-a77a-494d-bb9b-1d0d3134b139 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:27:59.163133 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f7e582-a77a-494d-bb9b-1d0d3134b139 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:27:59.164552 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f7e582-a77a-494d-bb9b-1d0d3134b139 service neutron] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:27:59.172332 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1204/2406] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:27:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:27:59.889416 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2411d9-a7b5-4fdf-a327-a94d9f21c60a service nova] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:27:59.899044 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2411d9-a7b5-4fdf-a327-a94d9f21c60a service nova] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:27:59.902639 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc50943-e837-4f78-91a1-934938309fc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:27:59.903270 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc50943-e837-4f78-91a1-934938309fc5 service neutron] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:27:59.903549 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc50943-e837-4f78-91a1-934938309fc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:27:59.903844 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc50943-e837-4f78-91a1-934938309fc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:27:59.905608 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-3dc50943-e837-4f78-91a1-934938309fc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:27:59.969527 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc50943-e837-4f78-91a1-934938309fc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:27:59.970954 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc50943-e837-4f78-91a1-934938309fc5 service neutron] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:27:59.980965 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1203/2407] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:27:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:28:02.844732 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd837be-06cc-4b6b-98a4-2205c9e18ff2 None None] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:02.845258 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd837be-06cc-4b6b-98a4-2205c9e18ff2 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:02.845258 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd837be-06cc-4b6b-98a4-2205c9e18ff2 None None] PATH_INFO: `/` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:02.846723 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1205/2408] 10.222.0.65 () {54 vars in 921 bytes} [Tue May 17 18:28:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:28:02.853968 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd417d-832c-47a2-87da-98f402e1fba1 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:02.854567 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd417d-832c-47a2-87da-98f402e1fba1 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:02.854945 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd417d-832c-47a2-87da-98f402e1fba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:02.879467 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-01dd417d-832c-47a2-87da-98f402e1fba1 None None] MFA Rules not processed for user `5b430b739cb54fc7911bc89f8ea2df72`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:28:02.881027 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-01dd417d-832c-47a2-87da-98f402e1fba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:28:02.892491 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1204/2409] 10.222.0.65 () {58 vars in 1018 bytes} [Tue May 17 18:28:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:28:02.907389 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd837be-06cc-4b6b-98a4-2205c9e18ff2 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:28:02.922870 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd837be-06cc-4b6b-98a4-2205c9e18ff2 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:28:02.928660 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6016d618-7760-4569-9809-664015110c33 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce570634a66b45158d940151828f533a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:28:02.929576 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016d618-7760-4569-9809-664015110c33 service glance] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:02.930027 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016d618-7760-4569-9809-664015110c33 service glance] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:02.930449 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016d618-7760-4569-9809-664015110c33 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:02.948548 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6016d618-7760-4569-9809-664015110c33 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:28:02.950995 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6016d618-7760-4569-9809-664015110c33 service glance] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:28:02.964175 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1206/2410] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:28:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:28:03.038383 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb46de1-a2d9-432e-818a-61dcc59deaee None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:03.038662 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb46de1-a2d9-432e-818a-61dcc59deaee None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:03.039277 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb46de1-a2d9-432e-818a-61dcc59deaee None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:03.040876 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1205/2411] 10.222.0.65 () {54 vars in 921 bytes} [Tue May 17 18:28:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:28:03.048314 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c79fb-0613-4efa-bd40-c528ba0a594a None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:03.048598 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c79fb-0613-4efa-bd40-c528ba0a594a None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:03.048871 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9c79fb-0613-4efa-bd40-c528ba0a594a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:03.105802 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-ae9c79fb-0613-4efa-bd40-c528ba0a594a None None] MFA Rules not processed for user `83430939ae474ad6bab37dfb6fc8da78`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:28:03.107358 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-ae9c79fb-0613-4efa-bd40-c528ba0a594a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:28:03.115832 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1207/2412] 10.222.0.65 () {58 vars in 1018 bytes} [Tue May 17 18:28:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:28:03.129721 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb46de1-a2d9-432e-818a-61dcc59deaee None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:28:03.142929 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb46de1-a2d9-432e-818a-61dcc59deaee None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:28:03.148076 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf3acae-0de7-4880-a19a-9ed9d88365b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:28:03.148939 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3acae-0de7-4880-a19a-9ed9d88365b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:03.149385 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3acae-0de7-4880-a19a-9ed9d88365b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:03.150242 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3acae-0de7-4880-a19a-9ed9d88365b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:03.163663 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf3acae-0de7-4880-a19a-9ed9d88365b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:28:03.165433 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf3acae-0de7-4880-a19a-9ed9d88365b2 service neutron] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:28:03.177428 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1206/2413] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:28:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:28:03.249096 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9c79fb-0613-4efa-bd40-c528ba0a594a None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:28:03.264933 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9c79fb-0613-4efa-bd40-c528ba0a594a None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:28:03.271907 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121895bb-b8ac-4080-91e8-3760547f19e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:28:03.273054 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121895bb-b8ac-4080-91e8-3760547f19e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:03.273512 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66efa38c-efa0-4157-9b76-4b1ef7b01999 None None] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:03.273771 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66efa38c-efa0-4157-9b76-4b1ef7b01999 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:03.273957 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121895bb-b8ac-4080-91e8-3760547f19e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:03.274072 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66efa38c-efa0-4157-9b76-4b1ef7b01999 None None] PATH_INFO: `/` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:03.274517 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121895bb-b8ac-4080-91e8-3760547f19e9 admin admin] PATH_INFO: `/v3/users/1467ae14ba4740c3803e655dc64729ed` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:03.275439 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1207/2414] 10.222.0.65 () {54 vars in 921 bytes} [Tue May 17 18:28:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 18:28:03.276109 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121895bb-b8ac-4080-91e8-3760547f19e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1467ae14ba4740c3803e655dc64729ed)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:28:03.278412 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121895bb-b8ac-4080-91e8-3760547f19e9 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:28:03.281911 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528a052-1760-4925-a103-310fc9368202 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:03.282545 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528a052-1760-4925-a103-310fc9368202 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:03.283081 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528a052-1760-4925-a103-310fc9368202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:03.307307 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-9528a052-1760-4925-a103-310fc9368202 None None] MFA Rules not processed for user `5b430b739cb54fc7911bc89f8ea2df72`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:28:03.308869 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-9528a052-1760-4925-a103-310fc9368202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:28:03.325865 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1208/2415] 10.222.0.65 () {58 vars in 1018 bytes} [Tue May 17 18:28:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:28:03.327206 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9528a052-1760-4925-a103-310fc9368202 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:28:03.329018 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-9528a052-1760-4925-a103-310fc9368202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:28:03.339940 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-121895bb-b8ac-4080-91e8-3760547f19e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1467ae14ba4740c3803e655dc64729ed'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:28:03.345222 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9528a052-1760-4925-a103-310fc9368202 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:28:03.350052 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a48ee-9080-4b6c-8ae6-89a25700ff66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:28:03.350909 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a48ee-9080-4b6c-8ae6-89a25700ff66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:03.351187 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a48ee-9080-4b6c-8ae6-89a25700ff66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:03.351460 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a48ee-9080-4b6c-8ae6-89a25700ff66 admin admin] PATH_INFO: `/v3/users/356af648841c44eeab0bd9c7f78f600a` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:03.351729 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-121895bb-b8ac-4080-91e8-3760547f19e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1467ae14ba4740c3803e655dc64729ed'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:28:03.352423 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-121895bb-b8ac-4080-91e8-3760547f19e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1467ae14ba4740c3803e655dc64729ed'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:28:03.353219 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-121895bb-b8ac-4080-91e8-3760547f19e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1467ae14ba4740c3803e655dc64729ed'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:28:03.359768 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-121895bb-b8ac-4080-91e8-3760547f19e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1467ae14ba4740c3803e655dc64729ed'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:28:03.365687 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803a48ee-9080-4b6c-8ae6-89a25700ff66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=356af648841c44eeab0bd9c7f78f600a)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:28:03.367877 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803a48ee-9080-4b6c-8ae6-89a25700ff66 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:28:03.373046 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1208/2416] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:28:03 2022] DELETE /identity/v3/users/1467ae14ba4740c3803e655dc64729ed => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:28:03.376099 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121895bb-b8ac-4080-91e8-3760547f19e9 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:28:03.376099 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-121895bb-b8ac-4080-91e8-3760547f19e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:28:03.426674 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-803a48ee-9080-4b6c-8ae6-89a25700ff66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '356af648841c44eeab0bd9c7f78f600a'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:28:03.434049 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-803a48ee-9080-4b6c-8ae6-89a25700ff66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '356af648841c44eeab0bd9c7f78f600a'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:28:03.434867 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-803a48ee-9080-4b6c-8ae6-89a25700ff66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '356af648841c44eeab0bd9c7f78f600a'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:28:03.442568 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121895bb-b8ac-4080-91e8-3760547f19e9 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:28:03.444166 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-803a48ee-9080-4b6c-8ae6-89a25700ff66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '356af648841c44eeab0bd9c7f78f600a'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:28:03.444925 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-803a48ee-9080-4b6c-8ae6-89a25700ff66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '356af648841c44eeab0bd9c7f78f600a'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:28:03.446651 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d669bf-b645-45ff-97f7-b7d7a0a7a6e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:28:03.447295 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d669bf-b645-45ff-97f7-b7d7a0a7a6e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:03.447773 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d669bf-b645-45ff-97f7-b7d7a0a7a6e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:03.448050 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d669bf-b645-45ff-97f7-b7d7a0a7a6e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:03.449880 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-c2d669bf-b645-45ff-97f7-b7d7a0a7a6e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:28:03.469541 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1209/2417] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:28:03 2022] DELETE /identity/v3/users/356af648841c44eeab0bd9c7f78f600a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:28:03.474000 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b7c8b-38a1-4524-b88d-fae65b8fe8d0 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:03.474360 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b7c8b-38a1-4524-b88d-fae65b8fe8d0 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:03.474708 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b7c8b-38a1-4524-b88d-fae65b8fe8d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:03.497108 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-4d8b7c8b-38a1-4524-b88d-fae65b8fe8d0 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:28:03.498740 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-4d8b7c8b-38a1-4524-b88d-fae65b8fe8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:28:03.546816 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d669bf-b645-45ff-97f7-b7d7a0a7a6e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:28:03.550440 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d669bf-b645-45ff-97f7-b7d7a0a7a6e4 service neutron] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:28:03.570682 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1209/2418] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:28:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:28:03.572255 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1210/2419] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:28:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:28:03.582560 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d669bf-b645-45ff-97f7-b7d7a0a7a6e4 service neutron] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:28:03.584037 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-c2d669bf-b645-45ff-97f7-b7d7a0a7a6e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:28:03.594522 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d669bf-b645-45ff-97f7-b7d7a0a7a6e4 service neutron] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:28:03.642047 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2abd53f-afd5-422d-87cf-af776bc27581 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:28:03.642684 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2abd53f-afd5-422d-87cf-af776bc27581 service neutron] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:03.642959 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2abd53f-afd5-422d-87cf-af776bc27581 service neutron] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:03.643278 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2abd53f-afd5-422d-87cf-af776bc27581 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:03.653806 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2abd53f-afd5-422d-87cf-af776bc27581 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:28:03.655295 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2abd53f-afd5-422d-87cf-af776bc27581 service neutron] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:28:03.659431 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b7c8b-38a1-4524-b88d-fae65b8fe8d0 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:28:03.661737 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-4d8b7c8b-38a1-4524-b88d-fae65b8fe8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:28:03.666510 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1210/2420] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:28:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:28:03.734846 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2abd53f-afd5-422d-87cf-af776bc27581 service neutron] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:28:03.736324 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-a2abd53f-afd5-422d-87cf-af776bc27581 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:28:03.751724 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2abd53f-afd5-422d-87cf-af776bc27581 service neutron] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:28:03.757044 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bcf086-147d-4249-9e63-9afc0ea7fd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:28:03.757947 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bcf086-147d-4249-9e63-9afc0ea7fd5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:03.758360 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bcf086-147d-4249-9e63-9afc0ea7fd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:03.758637 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bcf086-147d-4249-9e63-9afc0ea7fd5d admin admin] PATH_INFO: `/v3/projects/cd7eb45f1cd74f84943f4b991986973d` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:03.770167 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b7c8b-38a1-4524-b88d-fae65b8fe8d0 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:28:03.771924 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bcf086-147d-4249-9e63-9afc0ea7fd5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd7eb45f1cd74f84943f4b991986973d)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:28:03.773897 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bcf086-147d-4249-9e63-9afc0ea7fd5d admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:28:03.776714 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28abcb-d55a-4354-bdad-117f985d6d57 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ddf11ac3e14d03b1159868b3b73fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:28:03.777651 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28abcb-d55a-4354-bdad-117f985d6d57 service placement] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:03.777651 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28abcb-d55a-4354-bdad-117f985d6d57 service placement] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:03.777941 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28abcb-d55a-4354-bdad-117f985d6d57 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:03.780704 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-1b28abcb-d55a-4354-bdad-117f985d6d57 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:28:03.797223 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b28abcb-d55a-4354-bdad-117f985d6d57 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:28:03.800477 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b28abcb-d55a-4354-bdad-117f985d6d57 service placement] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:28:03.827655 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1211/2421] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:28:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:28:03.857854 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-13bcf086-147d-4249-9e63-9afc0ea7fd5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd7eb45f1cd74f84943f4b991986973d', 'request_id': 'req-13bcf086-147d-4249-9e63-9afc0ea7fd5d'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:28:03.870703 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-13bcf086-147d-4249-9e63-9afc0ea7fd5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd7eb45f1cd74f84943f4b991986973d', 'request_id': 'req-13bcf086-147d-4249-9e63-9afc0ea7fd5d'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:28:03.889288 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-13bcf086-147d-4249-9e63-9afc0ea7fd5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd7eb45f1cd74f84943f4b991986973d', 'request_id': 'req-13bcf086-147d-4249-9e63-9afc0ea7fd5d'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:28:03.903013 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-13bcf086-147d-4249-9e63-9afc0ea7fd5d admin admin] The token cache is being invalidate because project cd7eb45f1cd74f84943f4b991986973d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:28:03.903529 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-13bcf086-147d-4249-9e63-9afc0ea7fd5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:28:03.904846 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-13bcf086-147d-4249-9e63-9afc0ea7fd5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:28:03.907442 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1211/2422] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:28:03 2022] DELETE /identity/v3/projects/cd7eb45f1cd74f84943f4b991986973d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:28:03.912397 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8a036-a975-45f4-b92f-74aafb3d312f None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:03.913317 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8a036-a975-45f4-b92f-74aafb3d312f None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:03.913778 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8a036-a975-45f4-b92f-74aafb3d312f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:03.938538 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-83d8a036-a975-45f4-b92f-74aafb3d312f None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:28:03.942678 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-83d8a036-a975-45f4-b92f-74aafb3d312f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:28:04.014000 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1212/2423] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:28:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:28:04.023626 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb6d4f-2b7d-4b15-b1da-f7fbf645f76f None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:04.023967 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d8a036-a975-45f4-b92f-74aafb3d312f None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:28:04.024118 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb6d4f-2b7d-4b15-b1da-f7fbf645f76f None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:04.024751 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feb6d4f-2b7d-4b15-b1da-f7fbf645f76f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:04.026096 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-83d8a036-a975-45f4-b92f-74aafb3d312f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:28:04.045924 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d8a036-a975-45f4-b92f-74aafb3d312f None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:28:04.052701 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5442ecd-6368-4529-851b-8b298131a38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:28:04.053835 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5442ecd-6368-4529-851b-8b298131a38f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:04.054017 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5442ecd-6368-4529-851b-8b298131a38f admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:04.054289 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5442ecd-6368-4529-851b-8b298131a38f admin admin] PATH_INFO: `/v3/projects/028cf941f881466ba25dd5209677486d` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:04.055699 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5442ecd-6368-4529-851b-8b298131a38f admin admin] RBAC: Authorizing `identity:delete_project(project_id=028cf941f881466ba25dd5209677486d)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:28:04.058394 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5442ecd-6368-4529-851b-8b298131a38f admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:28:04.067006 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-1feb6d4f-2b7d-4b15-b1da-f7fbf645f76f None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:28:04.068477 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-1feb6d4f-2b7d-4b15-b1da-f7fbf645f76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:28:04.082536 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1212/2424] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:28:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:28:04.086640 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb6d4f-2b7d-4b15-b1da-f7fbf645f76f None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:28:04.096754 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feb6d4f-2b7d-4b15-b1da-f7fbf645f76f None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:28:04.103257 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b913f48-a682-4d4e-b106-c97cd9d1e5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:28:04.104189 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b913f48-a682-4d4e-b106-c97cd9d1e5ab admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:04.105115 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b913f48-a682-4d4e-b106-c97cd9d1e5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:04.105649 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b913f48-a682-4d4e-b106-c97cd9d1e5ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:04.106535 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b913f48-a682-4d4e-b106-c97cd9d1e5ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:28:04.107538 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b913f48-a682-4d4e-b106-c97cd9d1e5ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:28:04.109731 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b913f48-a682-4d4e-b106-c97cd9d1e5ab admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:28:04.127151 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1213/2425] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 17 18:28:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:28:04.132040 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b913f48-a682-4d4e-b106-c97cd9d1e5ab admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:28:04.144126 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b913f48-a682-4d4e-b106-c97cd9d1e5ab admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:28:04.144611 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-e5442ecd-6368-4529-851b-8b298131a38f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '028cf941f881466ba25dd5209677486d', 'request_id': 'req-e5442ecd-6368-4529-851b-8b298131a38f'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:28:04.164150 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-e5442ecd-6368-4529-851b-8b298131a38f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '028cf941f881466ba25dd5209677486d', 'request_id': 'req-e5442ecd-6368-4529-851b-8b298131a38f'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:28:04.173024 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-e5442ecd-6368-4529-851b-8b298131a38f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '028cf941f881466ba25dd5209677486d', 'request_id': 'req-e5442ecd-6368-4529-851b-8b298131a38f'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:28:04.185505 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-e5442ecd-6368-4529-851b-8b298131a38f admin admin] The token cache is being invalidate because project 028cf941f881466ba25dd5209677486d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:28:04.185861 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-e5442ecd-6368-4529-851b-8b298131a38f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:28:04.186461 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-e5442ecd-6368-4529-851b-8b298131a38f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:28:04.189542 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1213/2426] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:28:04 2022] DELETE /identity/v3/projects/028cf941f881466ba25dd5209677486d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:28:04.240934 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d9ae1-118b-4ffc-b956-a4a70e696c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:28:04.241656 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d9ae1-118b-4ffc-b956-a4a70e696c1a admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:04.241937 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d9ae1-118b-4ffc-b956-a4a70e696c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:04.242211 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d9ae1-118b-4ffc-b956-a4a70e696c1a admin admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:04.242917 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d9ae1-118b-4ffc-b956-a4a70e696c1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:28:04.244899 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d9ae1-118b-4ffc-b956-a4a70e696c1a admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:28:04.284886 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1214/2427] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:28:04 2022] POST /identity/v3/projects => generated 357 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:28:04.286729 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5442ecd-6368-4529-851b-8b298131a38f admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:28:04.289023 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-e5442ecd-6368-4529-851b-8b298131a38f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:28:04.307865 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5442ecd-6368-4529-851b-8b298131a38f admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:28:04.386329 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b709bb8-bda0-4ff0-bda4-4ff1a9f0283e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:28:04.387371 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b709bb8-bda0-4ff0-bda4-4ff1a9f0283e admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:04.387936 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b709bb8-bda0-4ff0-bda4-4ff1a9f0283e admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:04.388604 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b709bb8-bda0-4ff0-bda4-4ff1a9f0283e admin admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:04.389548 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b709bb8-bda0-4ff0-bda4-4ff1a9f0283e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:28:04.393354 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b709bb8-bda0-4ff0-bda4-4ff1a9f0283e admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:28:04.420831 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1214/2428] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:28:04 2022] POST /identity/v3/users => generated 279 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:28:04.425752 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d9ae1-118b-4ffc-b956-a4a70e696c1a admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:28:04.442392 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d9ae1-118b-4ffc-b956-a4a70e696c1a admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:28:04.447552 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3837d67-be24-4bb3-ac44-3f8f56abb122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:28:04.448244 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3837d67-be24-4bb3-ac44-3f8f56abb122 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:04.448525 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3837d67-be24-4bb3-ac44-3f8f56abb122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:04.448797 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3837d67-be24-4bb3-ac44-3f8f56abb122 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:04.449575 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3837d67-be24-4bb3-ac44-3f8f56abb122 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:28:04.451489 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3837d67-be24-4bb3-ac44-3f8f56abb122 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:28:04.464864 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1215/2429] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:28:04.468759 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b709bb8-bda0-4ff0-bda4-4ff1a9f0283e admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:28:04.480298 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b709bb8-bda0-4ff0-bda4-4ff1a9f0283e admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:28:04.485210 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4285c8-c1b8-4b6a-8f11-9452fbca604d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:28:04.486170 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4285c8-c1b8-4b6a-8f11-9452fbca604d admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:04.486291 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4285c8-c1b8-4b6a-8f11-9452fbca604d admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:04.486489 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4285c8-c1b8-4b6a-8f11-9452fbca604d admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:04.488327 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4285c8-c1b8-4b6a-8f11-9452fbca604d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:28:04.489587 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4285c8-c1b8-4b6a-8f11-9452fbca604d admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:28:04.500623 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1215/2430] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:28:04.504756 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3837d67-be24-4bb3-ac44-3f8f56abb122 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:28:04.514429 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3837d67-be24-4bb3-ac44-3f8f56abb122 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:28:04.523415 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca8055-c674-483a-b153-441e5ddaee28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:28:04.524288 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca8055-c674-483a-b153-441e5ddaee28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:04.524563 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca8055-c674-483a-b153-441e5ddaee28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:04.524833 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca8055-c674-483a-b153-441e5ddaee28 admin admin] PATH_INFO: `/v3/projects/0e1dca09ab514f02b20b1078fe5a6192/users/371a3881e670452785233a01f91ff604/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:04.539728 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ca8055-c674-483a-b153-441e5ddaee28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e1dca09ab514f02b20b1078fe5a6192, user_id=371a3881e670452785233a01f91ff604, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:28:04.542547 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ca8055-c674-483a-b153-441e5ddaee28 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:28:04.556417 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1216/2431] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:28:04 2022] PUT /identity/v3/projects/0e1dca09ab514f02b20b1078fe5a6192/users/371a3881e670452785233a01f91ff604/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:28:04.567093 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5acb01-9f6a-4aeb-a5a0-3fc59afe0fa0 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:04.567377 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5acb01-9f6a-4aeb-a5a0-3fc59afe0fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:04.567650 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5acb01-9f6a-4aeb-a5a0-3fc59afe0fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:04.593609 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-ec5acb01-9f6a-4aeb-a5a0-3fc59afe0fa0 None None] MFA Rules not processed for user `371a3881e670452785233a01f91ff604`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:28:04.594821 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-ec5acb01-9f6a-4aeb-a5a0-3fc59afe0fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:28:04.656811 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1216/2432] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:28:04 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:28:04.661906 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca8055-c674-483a-b153-441e5ddaee28 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:28:04.722904 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca8055-c674-483a-b153-441e5ddaee28 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:28:04.727646 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7990daf0-7702-4b89-8251-e6ad31aa5d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:28:04.728293 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990daf0-7702-4b89-8251-e6ad31aa5d11 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:04.728570 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990daf0-7702-4b89-8251-e6ad31aa5d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:04.728842 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990daf0-7702-4b89-8251-e6ad31aa5d11 admin admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:04.729568 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7990daf0-7702-4b89-8251-e6ad31aa5d11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:28:04.731473 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7990daf0-7702-4b89-8251-e6ad31aa5d11 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:28:04.758939 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1217/2433] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:28:04 2022] POST /identity/v3/projects => generated 353 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:28:04.767734 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5acb01-9f6a-4aeb-a5a0-3fc59afe0fa0 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:28:04.778782 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5acb01-9f6a-4aeb-a5a0-3fc59afe0fa0 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:28:04.838121 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a6fd8-2b2b-4b8d-ab3f-9f654d9aef8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:28:04.838791 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a6fd8-2b2b-4b8d-ab3f-9f654d9aef8e admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:04.839072 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a6fd8-2b2b-4b8d-ab3f-9f654d9aef8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:04.839349 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8a6fd8-2b2b-4b8d-ab3f-9f654d9aef8e admin admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:04.840050 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8a6fd8-2b2b-4b8d-ab3f-9f654d9aef8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:28:04.842041 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8a6fd8-2b2b-4b8d-ab3f-9f654d9aef8e admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:28:04.863351 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1217/2434] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:28:04 2022] POST /identity/v3/users => generated 283 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:28:04.867370 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7990daf0-7702-4b89-8251-e6ad31aa5d11 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:28:04.877409 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7990daf0-7702-4b89-8251-e6ad31aa5d11 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:28:04.882031 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08358c15-8087-4faa-b08e-2fb513ed226c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:28:04.882675 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08358c15-8087-4faa-b08e-2fb513ed226c admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:04.882957 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08358c15-8087-4faa-b08e-2fb513ed226c admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:04.883230 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08358c15-8087-4faa-b08e-2fb513ed226c admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:04.883943 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08358c15-8087-4faa-b08e-2fb513ed226c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:28:04.885578 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08358c15-8087-4faa-b08e-2fb513ed226c admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:28:04.896427 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1218/2435] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:28:04.900721 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a6fd8-2b2b-4b8d-ab3f-9f654d9aef8e admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:28:04.911543 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8a6fd8-2b2b-4b8d-ab3f-9f654d9aef8e admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:28:04.916037 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e89ee-9db9-4cf1-aded-8d532d86bc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:28:04.917366 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e89ee-9db9-4cf1-aded-8d532d86bc0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:04.917366 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e89ee-9db9-4cf1-aded-8d532d86bc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:04.917627 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e89ee-9db9-4cf1-aded-8d532d86bc0a admin admin] PATH_INFO: `/v3/projects/1b8c188daef041319a8d77500c2c37d3/users/31108a6fccbf4deda9ec1d153b171316/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:04.932439 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35e89ee-9db9-4cf1-aded-8d532d86bc0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b8c188daef041319a8d77500c2c37d3, user_id=31108a6fccbf4deda9ec1d153b171316, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:28:04.935134 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35e89ee-9db9-4cf1-aded-8d532d86bc0a admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:28:04.947878 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1218/2436] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:28:04 2022] PUT /identity/v3/projects/1b8c188daef041319a8d77500c2c37d3/users/31108a6fccbf4deda9ec1d153b171316/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:28:04.952289 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08358c15-8087-4faa-b08e-2fb513ed226c admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:28:04.963299 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08358c15-8087-4faa-b08e-2fb513ed226c admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:28:05.018880 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c84aef-5ec4-41be-bff4-969a55279a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:28:05.019545 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c84aef-5ec4-41be-bff4-969a55279a56 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:05.019852 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c84aef-5ec4-41be-bff4-969a55279a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:05.020132 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c84aef-5ec4-41be-bff4-969a55279a56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:05.020852 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c84aef-5ec4-41be-bff4-969a55279a56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:28:05.022586 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c84aef-5ec4-41be-bff4-969a55279a56 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:28:05.032250 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1219/2437] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:28:05.036984 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e89ee-9db9-4cf1-aded-8d532d86bc0a admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:28:05.047063 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e89ee-9db9-4cf1-aded-8d532d86bc0a admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:28:05.051934 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300beef3-f439-4f28-8a0a-2c3306565e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:28:05.052818 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300beef3-f439-4f28-8a0a-2c3306565e99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:05.053099 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300beef3-f439-4f28-8a0a-2c3306565e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:05.053376 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300beef3-f439-4f28-8a0a-2c3306565e99 admin admin] PATH_INFO: `/v3/projects/1b8c188daef041319a8d77500c2c37d3/users/31108a6fccbf4deda9ec1d153b171316/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:05.055363 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300beef3-f439-4f28-8a0a-2c3306565e99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b8c188daef041319a8d77500c2c37d3, user_id=31108a6fccbf4deda9ec1d153b171316, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:28:05.058128 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300beef3-f439-4f28-8a0a-2c3306565e99 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:28:05.068519 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1219/2438] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:28:05 2022] PUT /identity/v3/projects/1b8c188daef041319a8d77500c2c37d3/users/31108a6fccbf4deda9ec1d153b171316/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:28:05.079337 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a5dce-b0c7-4f68-ac6b-08616a15661c None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:05.079623 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a5dce-b0c7-4f68-ac6b-08616a15661c None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:05.079897 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467a5dce-b0c7-4f68-ac6b-08616a15661c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:05.108801 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-467a5dce-b0c7-4f68-ac6b-08616a15661c None None] MFA Rules not processed for user `31108a6fccbf4deda9ec1d153b171316`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:28:05.110043 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-467a5dce-b0c7-4f68-ac6b-08616a15661c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:28:05.178090 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1220/2439] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:28:05 2022] POST /identity/v3/auth/tokens => generated 3287 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:28:05.189448 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300beef3-f439-4f28-8a0a-2c3306565e99 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:28:05.191698 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-300beef3-f439-4f28-8a0a-2c3306565e99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:28:05.245681 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300beef3-f439-4f28-8a0a-2c3306565e99 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:28:05.249453 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b0d2b-a2dd-4784-b4cd-8ade57b3a3da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:28:05.250127 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b0d2b-a2dd-4784-b4cd-8ade57b3a3da service cinder] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:05.250406 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b0d2b-a2dd-4784-b4cd-8ade57b3a3da service cinder] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:05.250764 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b0d2b-a2dd-4784-b4cd-8ade57b3a3da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:05.260344 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7b0d2b-a2dd-4784-b4cd-8ade57b3a3da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:28:05.262057 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7b0d2b-a2dd-4784-b4cd-8ade57b3a3da service cinder] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:28:05.273386 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1220/2440] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:28:05 2022] GET /identity/v3/auth/tokens => generated 3287 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:28:05.345605 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a5dce-b0c7-4f68-ac6b-08616a15661c None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:28:05.355165 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467a5dce-b0c7-4f68-ac6b-08616a15661c None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:28:05.358874 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b78d4c-5e67-4fb1-b9fd-ec85b667c862 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:28:05.359502 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b78d4c-5e67-4fb1-b9fd-ec85b667c862 service cinder] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:05.359799 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b78d4c-5e67-4fb1-b9fd-ec85b667c862 service cinder] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:05.360069 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b78d4c-5e67-4fb1-b9fd-ec85b667c862 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:05.416934 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b78d4c-5e67-4fb1-b9fd-ec85b667c862 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:28:05.418423 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b78d4c-5e67-4fb1-b9fd-ec85b667c862 service cinder] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:28:05.427289 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1221/2441] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:28:05 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:28:05.445102 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d8ac4-317f-401b-ad71-67ed89b7884c None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:05.445385 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d8ac4-317f-401b-ad71-67ed89b7884c None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:05.445692 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d8ac4-317f-401b-ad71-67ed89b7884c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:05.464340 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-ee4d8ac4-317f-401b-ad71-67ed89b7884c None None] MFA Rules not processed for user `f370e353067848b5843c5650183be347`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:28:05.465579 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-ee4d8ac4-317f-401b-ad71-67ed89b7884c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:28:05.531153 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1221/2442] 10.222.0.65 () {58 vars in 1009 bytes} [Tue May 17 18:28:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:28:05.546101 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b78d4c-5e67-4fb1-b9fd-ec85b667c862 service cinder] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:28:05.547915 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-44b78d4c-5e67-4fb1-b9fd-ec85b667c862 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:28:05.633771 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b78d4c-5e67-4fb1-b9fd-ec85b667c862 service cinder] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:28:05.640319 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a02acd-1cca-4cc6-8b99-ffdeb00164cc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1464e84a3a2d4321a98b98d398bc7be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:28:05.641064 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a02acd-1cca-4cc6-8b99-ffdeb00164cc service swift] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:05.641347 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a02acd-1cca-4cc6-8b99-ffdeb00164cc service swift] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:05.641648 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a02acd-1cca-4cc6-8b99-ffdeb00164cc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:05.650848 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a02acd-1cca-4cc6-8b99-ffdeb00164cc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:28:05.652406 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a02acd-1cca-4cc6-8b99-ffdeb00164cc service swift] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:28:05.660308 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1222/2443] 10.222.0.65 () {60 vars in 1384 bytes} [Tue May 17 18:28:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 18:28:20.366579 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d8ac4-317f-401b-ad71-67ed89b7884c None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:28:20.433674 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d8ac4-317f-401b-ad71-67ed89b7884c None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:28:20.438556 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a851ac-516e-4163-a594-ae068bbf8c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:28:20.439435 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a851ac-516e-4163-a594-ae068bbf8c5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:20.440300 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a851ac-516e-4163-a594-ae068bbf8c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:20.440573 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a851ac-516e-4163-a594-ae068bbf8c5d admin admin] PATH_INFO: `/v3/users/371a3881e670452785233a01f91ff604` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:20.441814 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a851ac-516e-4163-a594-ae068bbf8c5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=371a3881e670452785233a01f91ff604)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:28:20.444294 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a851ac-516e-4163-a594-ae068bbf8c5d admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:28:20.490189 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-09a851ac-516e-4163-a594-ae068bbf8c5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '371a3881e670452785233a01f91ff604'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:28:20.496764 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-09a851ac-516e-4163-a594-ae068bbf8c5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '371a3881e670452785233a01f91ff604'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:28:20.497414 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-09a851ac-516e-4163-a594-ae068bbf8c5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '371a3881e670452785233a01f91ff604'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:28:20.504527 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-09a851ac-516e-4163-a594-ae068bbf8c5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '371a3881e670452785233a01f91ff604'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:28:20.505138 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-09a851ac-516e-4163-a594-ae068bbf8c5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '371a3881e670452785233a01f91ff604'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:28:20.522048 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1222/2444] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:28:20 2022] DELETE /identity/v3/users/371a3881e670452785233a01f91ff604 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:28:20.526547 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408502ae-b979-4763-b0c7-4faf6684e575 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:20.527033 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408502ae-b979-4763-b0c7-4faf6684e575 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:20.527149 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408502ae-b979-4763-b0c7-4faf6684e575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:20.543385 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-408502ae-b979-4763-b0c7-4faf6684e575 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:28:20.544566 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-408502ae-b979-4763-b0c7-4faf6684e575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:28:20.600481 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1223/2445] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:28:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:28:20.609998 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a851ac-516e-4163-a594-ae068bbf8c5d admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:28:20.611383 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-09a851ac-516e-4163-a594-ae068bbf8c5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:28:20.666636 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a851ac-516e-4163-a594-ae068bbf8c5d admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:28:20.670342 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4353c85-0508-447e-9c03-61282cfb148f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:28:20.671224 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4353c85-0508-447e-9c03-61282cfb148f service neutron] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:20.671224 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4353c85-0508-447e-9c03-61282cfb148f service neutron] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:20.671565 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4353c85-0508-447e-9c03-61282cfb148f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:20.681771 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4353c85-0508-447e-9c03-61282cfb148f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:28:20.683213 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4353c85-0508-447e-9c03-61282cfb148f service neutron] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:28:20.693013 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1223/2446] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:28:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:28:20.975266 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408502ae-b979-4763-b0c7-4faf6684e575 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:28:20.976768 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-408502ae-b979-4763-b0c7-4faf6684e575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:28:20.996142 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408502ae-b979-4763-b0c7-4faf6684e575 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:28:21.008818 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea76da-5608-4711-abff-6b818cef80bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:28:21.009734 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea76da-5608-4711-abff-6b818cef80bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:21.010013 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea76da-5608-4711-abff-6b818cef80bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:21.010285 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea76da-5608-4711-abff-6b818cef80bb admin admin] PATH_INFO: `/v3/projects/0e1dca09ab514f02b20b1078fe5a6192` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:21.011480 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea76da-5608-4711-abff-6b818cef80bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e1dca09ab514f02b20b1078fe5a6192)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:28:21.013395 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bea76da-5608-4711-abff-6b818cef80bb admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:28:21.062301 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-5bea76da-5608-4711-abff-6b818cef80bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e1dca09ab514f02b20b1078fe5a6192', 'request_id': 'req-5bea76da-5608-4711-abff-6b818cef80bb'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:28:21.068455 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-5bea76da-5608-4711-abff-6b818cef80bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e1dca09ab514f02b20b1078fe5a6192', 'request_id': 'req-5bea76da-5608-4711-abff-6b818cef80bb'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:28:21.075912 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-5bea76da-5608-4711-abff-6b818cef80bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e1dca09ab514f02b20b1078fe5a6192', 'request_id': 'req-5bea76da-5608-4711-abff-6b818cef80bb'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:28:21.086906 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-5bea76da-5608-4711-abff-6b818cef80bb admin admin] The token cache is being invalidate because project 0e1dca09ab514f02b20b1078fe5a6192 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:28:21.087191 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-5bea76da-5608-4711-abff-6b818cef80bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:28:21.087806 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-5bea76da-5608-4711-abff-6b818cef80bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:28:21.089354 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1224/2447] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:28:20 2022] DELETE /identity/v3/projects/0e1dca09ab514f02b20b1078fe5a6192 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:28:21.093429 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4353c85-0508-447e-9c03-61282cfb148f service neutron] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:28:21.103657 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4353c85-0508-447e-9c03-61282cfb148f service neutron] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:28:21.159684 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ed526-fa5d-47de-acec-945587d1981d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:28:21.160543 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ed526-fa5d-47de-acec-945587d1981d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:21.160819 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ed526-fa5d-47de-acec-945587d1981d admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:21.161089 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ed526-fa5d-47de-acec-945587d1981d admin admin] PATH_INFO: `/v3/users/31108a6fccbf4deda9ec1d153b171316` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:21.162288 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ed526-fa5d-47de-acec-945587d1981d admin admin] RBAC: Authorizing `identity:delete_user(user_id=31108a6fccbf4deda9ec1d153b171316)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:28:21.164181 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ed526-fa5d-47de-acec-945587d1981d admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:28:21.207962 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-e58ed526-fa5d-47de-acec-945587d1981d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31108a6fccbf4deda9ec1d153b171316'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:28:21.216637 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-e58ed526-fa5d-47de-acec-945587d1981d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31108a6fccbf4deda9ec1d153b171316'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:28:21.219103 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-e58ed526-fa5d-47de-acec-945587d1981d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31108a6fccbf4deda9ec1d153b171316'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:28:21.271357 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-e58ed526-fa5d-47de-acec-945587d1981d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31108a6fccbf4deda9ec1d153b171316'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:28:21.271970 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-e58ed526-fa5d-47de-acec-945587d1981d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31108a6fccbf4deda9ec1d153b171316'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:28:21.290701 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1224/2448] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:28:21 2022] DELETE /identity/v3/users/31108a6fccbf4deda9ec1d153b171316 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:28:21.559123 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea76da-5608-4711-abff-6b818cef80bb admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:28:21.560651 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-5bea76da-5608-4711-abff-6b818cef80bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:28:21.575938 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea76da-5608-4711-abff-6b818cef80bb admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:28:21.632560 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c47c9f-8497-4201-8b56-0adf35aa161f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:28:21.633406 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c47c9f-8497-4201-8b56-0adf35aa161f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:21.633706 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c47c9f-8497-4201-8b56-0adf35aa161f admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:21.633972 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c47c9f-8497-4201-8b56-0adf35aa161f admin admin] PATH_INFO: `/v3/projects/1b8c188daef041319a8d77500c2c37d3` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:21.635133 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c47c9f-8497-4201-8b56-0adf35aa161f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b8c188daef041319a8d77500c2c37d3)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:28:21.637018 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c47c9f-8497-4201-8b56-0adf35aa161f admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:28:21.680317 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-d1c47c9f-8497-4201-8b56-0adf35aa161f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b8c188daef041319a8d77500c2c37d3', 'request_id': 'req-d1c47c9f-8497-4201-8b56-0adf35aa161f'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:28:21.686112 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-d1c47c9f-8497-4201-8b56-0adf35aa161f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b8c188daef041319a8d77500c2c37d3', 'request_id': 'req-d1c47c9f-8497-4201-8b56-0adf35aa161f'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:28:21.694403 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-d1c47c9f-8497-4201-8b56-0adf35aa161f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b8c188daef041319a8d77500c2c37d3', 'request_id': 'req-d1c47c9f-8497-4201-8b56-0adf35aa161f'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:28:21.704528 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-d1c47c9f-8497-4201-8b56-0adf35aa161f admin admin] The token cache is being invalidate because project 1b8c188daef041319a8d77500c2c37d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:28:21.704808 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-d1c47c9f-8497-4201-8b56-0adf35aa161f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:28:21.706070 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-d1c47c9f-8497-4201-8b56-0adf35aa161f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:28:21.707588 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1225/2449] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:28:21 2022] DELETE /identity/v3/projects/1b8c188daef041319a8d77500c2c37d3 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:28:21.712532 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83bc434-7ee9-4a98-9f05-cf0434434534 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:21.713010 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83bc434-7ee9-4a98-9f05-cf0434434534 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:21.713108 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83bc434-7ee9-4a98-9f05-cf0434434534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:21.731129 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-c83bc434-7ee9-4a98-9f05-cf0434434534 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:28:21.732325 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-c83bc434-7ee9-4a98-9f05-cf0434434534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:28:21.788571 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1225/2450] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:28:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:28:21.796480 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec773a4-116a-422a-b8ba-1eeaeeb3b999 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:21.796772 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec773a4-116a-422a-b8ba-1eeaeeb3b999 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:21.797052 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec773a4-116a-422a-b8ba-1eeaeeb3b999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:21.816075 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-cec773a4-116a-422a-b8ba-1eeaeeb3b999 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:28:21.817262 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-cec773a4-116a-422a-b8ba-1eeaeeb3b999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:28:21.825078 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1226/2451] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:28:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:28:21.829376 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83bc434-7ee9-4a98-9f05-cf0434434534 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:28:21.838971 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83bc434-7ee9-4a98-9f05-cf0434434534 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:28:21.843541 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e98b1-8703-4f9f-ba9b-5f18ed6bebba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:28:21.844194 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e98b1-8703-4f9f-ba9b-5f18ed6bebba admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:21.844471 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e98b1-8703-4f9f-ba9b-5f18ed6bebba admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:21.844745 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e98b1-8703-4f9f-ba9b-5f18ed6bebba admin admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:21.845486 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8e98b1-8703-4f9f-ba9b-5f18ed6bebba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:28:21.845844 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8e98b1-8703-4f9f-ba9b-5f18ed6bebba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:28:21.847506 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8e98b1-8703-4f9f-ba9b-5f18ed6bebba admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:28:21.859292 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1226/2452] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 17 18:28:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:28:21.864421 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec773a4-116a-422a-b8ba-1eeaeeb3b999 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:28:21.873437 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec773a4-116a-422a-b8ba-1eeaeeb3b999 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:28:21.878824 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cecbfc2-1fe8-4ae3-b76f-c228c0442915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:28:21.879463 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cecbfc2-1fe8-4ae3-b76f-c228c0442915 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:21.879744 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cecbfc2-1fe8-4ae3-b76f-c228c0442915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:21.880021 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cecbfc2-1fe8-4ae3-b76f-c228c0442915 admin admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:21.880706 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cecbfc2-1fe8-4ae3-b76f-c228c0442915 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:28:21.882645 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cecbfc2-1fe8-4ae3-b76f-c228c0442915 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:28:21.906762 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1227/2453] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:28:21 2022] POST /identity/v3/projects => generated 375 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:28:21.910696 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e98b1-8703-4f9f-ba9b-5f18ed6bebba admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:28:21.920346 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e98b1-8703-4f9f-ba9b-5f18ed6bebba admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:28:21.975295 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533da4fd-56ac-4c9e-91f7-55e08bfbb092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:28:21.975851 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533da4fd-56ac-4c9e-91f7-55e08bfbb092 admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:21.976128 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533da4fd-56ac-4c9e-91f7-55e08bfbb092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:21.976394 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533da4fd-56ac-4c9e-91f7-55e08bfbb092 admin admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:21.977068 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533da4fd-56ac-4c9e-91f7-55e08bfbb092 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:28:21.979060 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533da4fd-56ac-4c9e-91f7-55e08bfbb092 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:28:21.998426 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1227/2454] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:28:21 2022] POST /identity/v3/users => generated 288 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:28:22.003055 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cecbfc2-1fe8-4ae3-b76f-c228c0442915 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:28:22.012909 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cecbfc2-1fe8-4ae3-b76f-c228c0442915 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:28:22.017447 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c039a3a-7def-427f-b8bb-5d2e98898110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:28:22.018144 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c039a3a-7def-427f-b8bb-5d2e98898110 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:22.018423 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c039a3a-7def-427f-b8bb-5d2e98898110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:22.018694 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c039a3a-7def-427f-b8bb-5d2e98898110 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:22.019405 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c039a3a-7def-427f-b8bb-5d2e98898110 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:28:22.021041 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c039a3a-7def-427f-b8bb-5d2e98898110 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:28:22.031646 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1228/2455] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:28:22.035389 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533da4fd-56ac-4c9e-91f7-55e08bfbb092 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:28:22.044870 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533da4fd-56ac-4c9e-91f7-55e08bfbb092 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:28:22.049859 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4d438-bcf1-4e22-867f-11deaa91d4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:28:22.050487 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4d438-bcf1-4e22-867f-11deaa91d4bb admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:22.050762 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4d438-bcf1-4e22-867f-11deaa91d4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:22.051032 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4d438-bcf1-4e22-867f-11deaa91d4bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:22.051743 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d4d438-bcf1-4e22-867f-11deaa91d4bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:28:22.053297 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d4d438-bcf1-4e22-867f-11deaa91d4bb admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:28:22.062793 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1228/2456] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:28:22.067353 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c039a3a-7def-427f-b8bb-5d2e98898110 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:28:22.077024 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c039a3a-7def-427f-b8bb-5d2e98898110 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:28:22.081593 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7775b6-7146-4bac-a986-c10086cbca8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:28:22.082442 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7775b6-7146-4bac-a986-c10086cbca8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:22.082720 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7775b6-7146-4bac-a986-c10086cbca8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:22.082992 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7775b6-7146-4bac-a986-c10086cbca8c admin admin] PATH_INFO: `/v3/projects/0a61a63d2d224c25b063fe64a9fd115c/users/d4a32856cbfe42e092973e5625131bc5/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:22.096816 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7775b6-7146-4bac-a986-c10086cbca8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a61a63d2d224c25b063fe64a9fd115c, user_id=d4a32856cbfe42e092973e5625131bc5, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:28:22.099482 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7775b6-7146-4bac-a986-c10086cbca8c admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:28:22.112202 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1229/2457] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:28:22 2022] PUT /identity/v3/projects/0a61a63d2d224c25b063fe64a9fd115c/users/d4a32856cbfe42e092973e5625131bc5/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:28:22.123156 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58852593-a1c9-4e95-bfe0-698a215fd500 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:22.123438 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58852593-a1c9-4e95-bfe0-698a215fd500 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:22.123706 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58852593-a1c9-4e95-bfe0-698a215fd500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:22.149687 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-58852593-a1c9-4e95-bfe0-698a215fd500 None None] MFA Rules not processed for user `d4a32856cbfe42e092973e5625131bc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:28:22.150876 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-58852593-a1c9-4e95-bfe0-698a215fd500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:28:22.213910 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1229/2458] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:28:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:28:22.218419 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7775b6-7146-4bac-a986-c10086cbca8c admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:28:22.280162 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7775b6-7146-4bac-a986-c10086cbca8c admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:28:22.285513 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace0cd3b-9dd2-466e-bd8e-9f4d6496b7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:28:22.286165 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0cd3b-9dd2-466e-bd8e-9f4d6496b7ad admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:22.286445 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0cd3b-9dd2-466e-bd8e-9f4d6496b7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:22.286718 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0cd3b-9dd2-466e-bd8e-9f4d6496b7ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:22.287704 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace0cd3b-9dd2-466e-bd8e-9f4d6496b7ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:28:22.291263 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace0cd3b-9dd2-466e-bd8e-9f4d6496b7ad admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:28:22.318849 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1230/2459] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:28:22 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:28:22.325445 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58852593-a1c9-4e95-bfe0-698a215fd500 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:28:22.336430 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58852593-a1c9-4e95-bfe0-698a215fd500 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:28:22.390566 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede6375-193b-4110-a4af-52e2d5ddb22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:28:22.391222 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede6375-193b-4110-a4af-52e2d5ddb22d admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:22.391502 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede6375-193b-4110-a4af-52e2d5ddb22d admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:22.391775 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede6375-193b-4110-a4af-52e2d5ddb22d admin admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:22.392468 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ede6375-193b-4110-a4af-52e2d5ddb22d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:28:22.394435 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ede6375-193b-4110-a4af-52e2d5ddb22d admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:28:22.414234 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1230/2460] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:28:22 2022] POST /identity/v3/users => generated 295 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:28:22.418338 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace0cd3b-9dd2-466e-bd8e-9f4d6496b7ad admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:28:22.429412 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace0cd3b-9dd2-466e-bd8e-9f4d6496b7ad admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:28:22.434119 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe067dbb-081f-41f7-a1df-e0b6f685b001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:28:22.434765 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe067dbb-081f-41f7-a1df-e0b6f685b001 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:22.435044 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe067dbb-081f-41f7-a1df-e0b6f685b001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:22.435320 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe067dbb-081f-41f7-a1df-e0b6f685b001 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:22.436037 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe067dbb-081f-41f7-a1df-e0b6f685b001 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:28:22.437697 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe067dbb-081f-41f7-a1df-e0b6f685b001 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:28:22.447935 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1231/2461] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:28:22.452285 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede6375-193b-4110-a4af-52e2d5ddb22d admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:28:22.463746 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede6375-193b-4110-a4af-52e2d5ddb22d admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:28:22.468378 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223bc20-c945-41c5-9686-c01bd1cc4a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:28:22.469257 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223bc20-c945-41c5-9686-c01bd1cc4a81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:22.469576 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223bc20-c945-41c5-9686-c01bd1cc4a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:22.469857 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223bc20-c945-41c5-9686-c01bd1cc4a81 admin admin] PATH_INFO: `/v3/projects/759e84fcc3dd47afbe2a22a3df365f98/users/8319cf3a92db42ec826efab151362a2b/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:22.487813 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8223bc20-c945-41c5-9686-c01bd1cc4a81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=759e84fcc3dd47afbe2a22a3df365f98, user_id=8319cf3a92db42ec826efab151362a2b, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:28:22.493047 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8223bc20-c945-41c5-9686-c01bd1cc4a81 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:28:22.507144 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1231/2462] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:28:22 2022] PUT /identity/v3/projects/759e84fcc3dd47afbe2a22a3df365f98/users/8319cf3a92db42ec826efab151362a2b/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:28:22.510792 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe067dbb-081f-41f7-a1df-e0b6f685b001 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:28:22.521173 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe067dbb-081f-41f7-a1df-e0b6f685b001 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:28:22.575462 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c45db-2f61-470b-860b-b33290834002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:28:22.576133 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c45db-2f61-470b-860b-b33290834002 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:22.576614 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c45db-2f61-470b-860b-b33290834002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:22.576885 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c45db-2f61-470b-860b-b33290834002 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:22.577686 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c45db-2f61-470b-860b-b33290834002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:28:22.579260 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c45db-2f61-470b-860b-b33290834002 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:28:22.589084 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1232/2463] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:28:22.593357 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223bc20-c945-41c5-9686-c01bd1cc4a81 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:28:22.603962 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223bc20-c945-41c5-9686-c01bd1cc4a81 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:28:22.608453 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d1fa3-f212-45fc-8696-cdd793141e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:28:22.609321 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d1fa3-f212-45fc-8696-cdd793141e80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:22.609632 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d1fa3-f212-45fc-8696-cdd793141e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:22.609907 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d1fa3-f212-45fc-8696-cdd793141e80 admin admin] PATH_INFO: `/v3/projects/759e84fcc3dd47afbe2a22a3df365f98/users/8319cf3a92db42ec826efab151362a2b/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:22.611846 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244d1fa3-f212-45fc-8696-cdd793141e80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=759e84fcc3dd47afbe2a22a3df365f98, user_id=8319cf3a92db42ec826efab151362a2b, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:28:22.614509 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244d1fa3-f212-45fc-8696-cdd793141e80 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:28:22.624233 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1232/2464] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:28:22 2022] PUT /identity/v3/projects/759e84fcc3dd47afbe2a22a3df365f98/users/8319cf3a92db42ec826efab151362a2b/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:28:22.634350 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b6dd92-5be2-46b1-a229-d53c26dfff3d None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:22.634634 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b6dd92-5be2-46b1-a229-d53c26dfff3d None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:22.634913 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b6dd92-5be2-46b1-a229-d53c26dfff3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:22.661141 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-61b6dd92-5be2-46b1-a229-d53c26dfff3d None None] MFA Rules not processed for user `8319cf3a92db42ec826efab151362a2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:28:22.662370 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-61b6dd92-5be2-46b1-a229-d53c26dfff3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:28:22.727183 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1233/2465] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:28:22 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:28:22.737817 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d1fa3-f212-45fc-8696-cdd793141e80 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:28:22.739516 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-244d1fa3-f212-45fc-8696-cdd793141e80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:28:22.794039 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d1fa3-f212-45fc-8696-cdd793141e80 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:28:22.797582 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8cdd84-37e9-4aa4-9738-2685317c8fe4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:28:22.798207 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8cdd84-37e9-4aa4-9738-2685317c8fe4 service cinder] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:22.798487 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8cdd84-37e9-4aa4-9738-2685317c8fe4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:22.798760 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8cdd84-37e9-4aa4-9738-2685317c8fe4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:22.855043 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8cdd84-37e9-4aa4-9738-2685317c8fe4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:28:22.856962 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8cdd84-37e9-4aa4-9738-2685317c8fe4 service cinder] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:28:22.869381 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1233/2466] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:28:22 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:28:28.737431 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b6dd92-5be2-46b1-a229-d53c26dfff3d None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:28:28.738982 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-61b6dd92-5be2-46b1-a229-d53c26dfff3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:28:28.811275 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b6dd92-5be2-46b1-a229-d53c26dfff3d None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:28:28.817181 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d07bd-6903-4d16-bc6a-b76ec2accaa3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b430b739cb54fc7911bc89f8ea2df72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:28:28.817849 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d07bd-6903-4d16-bc6a-b76ec2accaa3 service nova] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:28.818128 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d07bd-6903-4d16-bc6a-b76ec2accaa3 service nova] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:28.818399 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d07bd-6903-4d16-bc6a-b76ec2accaa3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:28.820135 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-2d5d07bd-6903-4d16-bc6a-b76ec2accaa3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:28:28.831984 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d07bd-6903-4d16-bc6a-b76ec2accaa3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:28:28.833772 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d07bd-6903-4d16-bc6a-b76ec2accaa3 service nova] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:28:28.844423 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1234/2467] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:28:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:28:30.511727 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8cdd84-37e9-4aa4-9738-2685317c8fe4 service cinder] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:28:30.513105 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-dc8cdd84-37e9-4aa4-9738-2685317c8fe4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:28:30.525121 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8cdd84-37e9-4aa4-9738-2685317c8fe4 service cinder] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:28:30.528709 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f487bb-56bc-4ff3-ba0a-9f7f3d0d41cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:28:30.529336 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f487bb-56bc-4ff3-ba0a-9f7f3d0d41cb service cinder] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:30.529677 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f487bb-56bc-4ff3-ba0a-9f7f3d0d41cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:30.529955 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f487bb-56bc-4ff3-ba0a-9f7f3d0d41cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:30.539289 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f487bb-56bc-4ff3-ba0a-9f7f3d0d41cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:28:30.540698 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f487bb-56bc-4ff3-ba0a-9f7f3d0d41cb service cinder] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:28:30.549956 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1234/2468] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:28:30 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:28:31.535040 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b0f978-1d1a-4088-949e-e06dad3002da None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:31.535506 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b0f978-1d1a-4088-949e-e06dad3002da None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:31.535598 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b0f978-1d1a-4088-949e-e06dad3002da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:31.553574 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-68b0f978-1d1a-4088-949e-e06dad3002da None None] MFA Rules not processed for user `f370e353067848b5843c5650183be347`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:28:31.554787 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-68b0f978-1d1a-4088-949e-e06dad3002da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:28:31.612147 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1235/2469] 10.222.0.65 () {58 vars in 967 bytes} [Tue May 17 18:28:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:28:31.624962 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f487bb-56bc-4ff3-ba0a-9f7f3d0d41cb service cinder] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:28:31.626902 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-88f487bb-56bc-4ff3-ba0a-9f7f3d0d41cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:28:31.696991 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f487bb-56bc-4ff3-ba0a-9f7f3d0d41cb service cinder] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:28:31.702233 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7886559-db4e-4dc9-984e-14e648e8b494 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1464e84a3a2d4321a98b98d398bc7be3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:28:31.702869 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7886559-db4e-4dc9-984e-14e648e8b494 service swift] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:31.703150 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7886559-db4e-4dc9-984e-14e648e8b494 service swift] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:31.703422 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7886559-db4e-4dc9-984e-14e648e8b494 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:31.711660 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7886559-db4e-4dc9-984e-14e648e8b494 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:28:31.713223 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7886559-db4e-4dc9-984e-14e648e8b494 service swift] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:28:31.720960 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1235/2470] 10.222.0.65 () {60 vars in 1384 bytes} [Tue May 17 18:28:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 18:29:00.283611 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b0f978-1d1a-4088-949e-e06dad3002da None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:00.343512 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b0f978-1d1a-4088-949e-e06dad3002da None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:00.347913 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff5b045-d400-4c0c-826f-42d012e1834c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:00.348756 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff5b045-d400-4c0c-826f-42d012e1834c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:00.349030 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff5b045-d400-4c0c-826f-42d012e1834c admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:00.349299 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff5b045-d400-4c0c-826f-42d012e1834c admin admin] PATH_INFO: `/v3/users/d4a32856cbfe42e092973e5625131bc5` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:00.351028 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff5b045-d400-4c0c-826f-42d012e1834c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4a32856cbfe42e092973e5625131bc5)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:00.352917 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff5b045-d400-4c0c-826f-42d012e1834c admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:00.395441 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-9ff5b045-d400-4c0c-826f-42d012e1834c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4a32856cbfe42e092973e5625131bc5'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:00.406447 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-9ff5b045-d400-4c0c-826f-42d012e1834c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4a32856cbfe42e092973e5625131bc5'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:00.407082 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-9ff5b045-d400-4c0c-826f-42d012e1834c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4a32856cbfe42e092973e5625131bc5'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:00.407670 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-9ff5b045-d400-4c0c-826f-42d012e1834c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4a32856cbfe42e092973e5625131bc5'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:00.414748 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-9ff5b045-d400-4c0c-826f-42d012e1834c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4a32856cbfe42e092973e5625131bc5'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:00.426854 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1236/2471] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:29:00 2022] DELETE /identity/v3/users/d4a32856cbfe42e092973e5625131bc5 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:29:00.432135 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78aa689-2685-4f9d-8cef-f7b465502102 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:00.432608 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78aa689-2685-4f9d-8cef-f7b465502102 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:00.432711 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78aa689-2685-4f9d-8cef-f7b465502102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:00.449464 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-c78aa689-2685-4f9d-8cef-f7b465502102 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:29:00.450685 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-c78aa689-2685-4f9d-8cef-f7b465502102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:29:00.507245 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1236/2472] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:29:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:29:00.516947 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff5b045-d400-4c0c-826f-42d012e1834c admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:00.518325 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-9ff5b045-d400-4c0c-826f-42d012e1834c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:29:00.572358 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff5b045-d400-4c0c-826f-42d012e1834c admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:00.575972 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053bbdb3-6a1f-497b-8988-3b17e71f4bcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:00.576591 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053bbdb3-6a1f-497b-8988-3b17e71f4bcc service neutron] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:00.577130 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053bbdb3-6a1f-497b-8988-3b17e71f4bcc service neutron] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:00.577404 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053bbdb3-6a1f-497b-8988-3b17e71f4bcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:00.586106 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053bbdb3-6a1f-497b-8988-3b17e71f4bcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:00.587547 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053bbdb3-6a1f-497b-8988-3b17e71f4bcc service neutron] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:00.596579 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1237/2473] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:29:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:29:00.855493 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78aa689-2685-4f9d-8cef-f7b465502102 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:00.856924 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-c78aa689-2685-4f9d-8cef-f7b465502102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:29:00.875662 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78aa689-2685-4f9d-8cef-f7b465502102 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:00.882004 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d5a8c-1850-4321-b3b3-a60e58d80343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:00.882830 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d5a8c-1850-4321-b3b3-a60e58d80343 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:00.883114 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d5a8c-1850-4321-b3b3-a60e58d80343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:00.883383 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d5a8c-1850-4321-b3b3-a60e58d80343 admin admin] PATH_INFO: `/v3/projects/0a61a63d2d224c25b063fe64a9fd115c` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:00.884582 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d5a8c-1850-4321-b3b3-a60e58d80343 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a61a63d2d224c25b063fe64a9fd115c)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:00.886562 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d5a8c-1850-4321-b3b3-a60e58d80343 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:00.931510 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-961d5a8c-1850-4321-b3b3-a60e58d80343 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a61a63d2d224c25b063fe64a9fd115c', 'request_id': 'req-961d5a8c-1850-4321-b3b3-a60e58d80343'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:00.938463 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-961d5a8c-1850-4321-b3b3-a60e58d80343 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a61a63d2d224c25b063fe64a9fd115c', 'request_id': 'req-961d5a8c-1850-4321-b3b3-a60e58d80343'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:00.946809 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-961d5a8c-1850-4321-b3b3-a60e58d80343 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a61a63d2d224c25b063fe64a9fd115c', 'request_id': 'req-961d5a8c-1850-4321-b3b3-a60e58d80343'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:00.957150 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-961d5a8c-1850-4321-b3b3-a60e58d80343 admin admin] The token cache is being invalidate because project 0a61a63d2d224c25b063fe64a9fd115c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:29:00.957437 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-961d5a8c-1850-4321-b3b3-a60e58d80343 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:00.958093 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-961d5a8c-1850-4321-b3b3-a60e58d80343 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:00.960143 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1237/2474] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:29:00 2022] DELETE /identity/v3/projects/0a61a63d2d224c25b063fe64a9fd115c => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:29:00.964359 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053bbdb3-6a1f-497b-8988-3b17e71f4bcc service neutron] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:00.973757 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053bbdb3-6a1f-497b-8988-3b17e71f4bcc service neutron] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:01.028051 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b773ecce-695b-43aa-b60e-bcd9143ac8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:01.028832 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b773ecce-695b-43aa-b60e-bcd9143ac8bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:01.029111 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b773ecce-695b-43aa-b60e-bcd9143ac8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:01.029386 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b773ecce-695b-43aa-b60e-bcd9143ac8bb admin admin] PATH_INFO: `/v3/users/8319cf3a92db42ec826efab151362a2b` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:01.030582 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b773ecce-695b-43aa-b60e-bcd9143ac8bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8319cf3a92db42ec826efab151362a2b)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:01.032484 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b773ecce-695b-43aa-b60e-bcd9143ac8bb admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:01.075936 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-b773ecce-695b-43aa-b60e-bcd9143ac8bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8319cf3a92db42ec826efab151362a2b'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:01.087981 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-b773ecce-695b-43aa-b60e-bcd9143ac8bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8319cf3a92db42ec826efab151362a2b'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:01.088621 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-b773ecce-695b-43aa-b60e-bcd9143ac8bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8319cf3a92db42ec826efab151362a2b'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:01.089217 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-b773ecce-695b-43aa-b60e-bcd9143ac8bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8319cf3a92db42ec826efab151362a2b'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:01.095849 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-b773ecce-695b-43aa-b60e-bcd9143ac8bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8319cf3a92db42ec826efab151362a2b'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:01.107758 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1238/2475] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:29:00 2022] DELETE /identity/v3/users/8319cf3a92db42ec826efab151362a2b => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:29:01.365835 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d5a8c-1850-4321-b3b3-a60e58d80343 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:01.367269 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-961d5a8c-1850-4321-b3b3-a60e58d80343 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:29:01.383359 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d5a8c-1850-4321-b3b3-a60e58d80343 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:01.438911 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ce9ce-245d-403a-bf98-004117609b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:01.439753 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ce9ce-245d-403a-bf98-004117609b16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:01.440025 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ce9ce-245d-403a-bf98-004117609b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:01.440290 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ce9ce-245d-403a-bf98-004117609b16 admin admin] PATH_INFO: `/v3/projects/759e84fcc3dd47afbe2a22a3df365f98` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:01.441525 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033ce9ce-245d-403a-bf98-004117609b16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=759e84fcc3dd47afbe2a22a3df365f98)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:01.444034 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033ce9ce-245d-403a-bf98-004117609b16 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:01.487942 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-033ce9ce-245d-403a-bf98-004117609b16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '759e84fcc3dd47afbe2a22a3df365f98', 'request_id': 'req-033ce9ce-245d-403a-bf98-004117609b16'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:01.494284 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-033ce9ce-245d-403a-bf98-004117609b16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '759e84fcc3dd47afbe2a22a3df365f98', 'request_id': 'req-033ce9ce-245d-403a-bf98-004117609b16'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:01.501361 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-033ce9ce-245d-403a-bf98-004117609b16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '759e84fcc3dd47afbe2a22a3df365f98', 'request_id': 'req-033ce9ce-245d-403a-bf98-004117609b16'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:01.511387 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-033ce9ce-245d-403a-bf98-004117609b16 admin admin] The token cache is being invalidate because project 759e84fcc3dd47afbe2a22a3df365f98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:29:01.511670 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-033ce9ce-245d-403a-bf98-004117609b16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:01.512346 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-033ce9ce-245d-403a-bf98-004117609b16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:01.513922 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1238/2476] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:29:01 2022] DELETE /identity/v3/projects/759e84fcc3dd47afbe2a22a3df365f98 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:29:01.518786 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ff3cb-9ec6-460c-8133-d069c5c231e0 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:01.519260 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ff3cb-9ec6-460c-8133-d069c5c231e0 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:01.519376 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ff3cb-9ec6-460c-8133-d069c5c231e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:01.537836 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-574ff3cb-9ec6-460c-8133-d069c5c231e0 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:29:01.539015 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-574ff3cb-9ec6-460c-8133-d069c5c231e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:29:01.596771 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1239/2477] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:29:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:29:01.606013 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876964d3-ffc2-417d-81eb-5af25b977f2a None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:01.606297 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876964d3-ffc2-417d-81eb-5af25b977f2a None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:01.606589 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876964d3-ffc2-417d-81eb-5af25b977f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:01.626424 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-876964d3-ffc2-417d-81eb-5af25b977f2a None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:29:01.627614 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-876964d3-ffc2-417d-81eb-5af25b977f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:29:01.635386 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1239/2478] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:29:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:29:01.639561 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ff3cb-9ec6-460c-8133-d069c5c231e0 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:01.649535 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ff3cb-9ec6-460c-8133-d069c5c231e0 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:01.654003 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f4869-ad67-42c3-ab0e-56526dad1d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:01.654640 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f4869-ad67-42c3-ab0e-56526dad1d73 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:01.654916 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f4869-ad67-42c3-ab0e-56526dad1d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:01.655187 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f4869-ad67-42c3-ab0e-56526dad1d73 admin admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:01.655900 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827f4869-ad67-42c3-ab0e-56526dad1d73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:29:01.656205 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827f4869-ad67-42c3-ab0e-56526dad1d73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:01.657837 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827f4869-ad67-42c3-ab0e-56526dad1d73 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:01.669703 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1240/2479] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 17 18:29:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:29:01.673811 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876964d3-ffc2-417d-81eb-5af25b977f2a None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:01.682681 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876964d3-ffc2-417d-81eb-5af25b977f2a None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:01.687238 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca0094-0a3d-4c57-bd49-0c4f1e299cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:01.687892 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca0094-0a3d-4c57-bd49-0c4f1e299cda admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:01.688166 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca0094-0a3d-4c57-bd49-0c4f1e299cda admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:01.688433 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca0094-0a3d-4c57-bd49-0c4f1e299cda admin admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:01.689114 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abca0094-0a3d-4c57-bd49-0c4f1e299cda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:01.691015 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abca0094-0a3d-4c57-bd49-0c4f1e299cda admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:01.715785 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1240/2480] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:29:01 2022] POST /identity/v3/projects => generated 381 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:29:01.719783 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f4869-ad67-42c3-ab0e-56526dad1d73 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:01.729993 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f4869-ad67-42c3-ab0e-56526dad1d73 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:01.783448 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c96b4c-8691-4246-a905-4410a9614b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:01.784100 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c96b4c-8691-4246-a905-4410a9614b0f admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:01.784375 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c96b4c-8691-4246-a905-4410a9614b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:01.784645 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c96b4c-8691-4246-a905-4410a9614b0f admin admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:01.785317 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c96b4c-8691-4246-a905-4410a9614b0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:01.787251 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c96b4c-8691-4246-a905-4410a9614b0f admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:01.806224 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1241/2481] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:29:01 2022] POST /identity/v3/users => generated 291 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:29:01.810274 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca0094-0a3d-4c57-bd49-0c4f1e299cda admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:01.820718 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca0094-0a3d-4c57-bd49-0c4f1e299cda admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:01.825268 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d841378a-2415-4a2f-9056-2669b8396c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:01.825946 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d841378a-2415-4a2f-9056-2669b8396c3e admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:01.826226 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d841378a-2415-4a2f-9056-2669b8396c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:01.826498 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d841378a-2415-4a2f-9056-2669b8396c3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:01.827468 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d841378a-2415-4a2f-9056-2669b8396c3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:01.829063 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d841378a-2415-4a2f-9056-2669b8396c3e admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:01.839947 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1241/2482] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:29:01.844009 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c96b4c-8691-4246-a905-4410a9614b0f admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:01.853869 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c96b4c-8691-4246-a905-4410a9614b0f admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:01.858297 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af498ef0-d0c4-47e2-86b5-6821e160b38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:01.858935 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af498ef0-d0c4-47e2-86b5-6821e160b38e admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:01.859210 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af498ef0-d0c4-47e2-86b5-6821e160b38e admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:01.859479 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af498ef0-d0c4-47e2-86b5-6821e160b38e admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:01.860190 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af498ef0-d0c4-47e2-86b5-6821e160b38e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:01.861795 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af498ef0-d0c4-47e2-86b5-6821e160b38e admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:01.871337 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1242/2483] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:29:01 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:29:01.875514 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d841378a-2415-4a2f-9056-2669b8396c3e admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:01.885856 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d841378a-2415-4a2f-9056-2669b8396c3e admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:01.890456 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deb331a-aa46-4f00-8e15-c6a143e8f456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:01.891316 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb331a-aa46-4f00-8e15-c6a143e8f456 admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:01.891595 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb331a-aa46-4f00-8e15-c6a143e8f456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:01.891868 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb331a-aa46-4f00-8e15-c6a143e8f456 admin admin] PATH_INFO: `/v3/projects/a7fba21a3c77430f8ef9ae8830567687/users/230209909bb642e9a124f09c5b7ade15/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:01.906350 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deb331a-aa46-4f00-8e15-c6a143e8f456 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7fba21a3c77430f8ef9ae8830567687, user_id=230209909bb642e9a124f09c5b7ade15, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:01.908965 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deb331a-aa46-4f00-8e15-c6a143e8f456 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:01.921218 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1242/2484] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:29:01 2022] PUT /identity/v3/projects/a7fba21a3c77430f8ef9ae8830567687/users/230209909bb642e9a124f09c5b7ade15/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:29:01.931521 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359bb85-93b8-4a5e-b540-80ce12ae429d None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:01.931808 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359bb85-93b8-4a5e-b540-80ce12ae429d None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:01.932082 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f359bb85-93b8-4a5e-b540-80ce12ae429d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:01.958022 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-f359bb85-93b8-4a5e-b540-80ce12ae429d None None] MFA Rules not processed for user `230209909bb642e9a124f09c5b7ade15`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:29:01.959797 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-f359bb85-93b8-4a5e-b540-80ce12ae429d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:29:02.019684 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1243/2485] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:29:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:29:02.024673 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deb331a-aa46-4f00-8e15-c6a143e8f456 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:02.082227 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deb331a-aa46-4f00-8e15-c6a143e8f456 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:02.087621 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de68679c-a162-4630-8d84-93a3bbd48cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:02.088283 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68679c-a162-4630-8d84-93a3bbd48cfc admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:02.088566 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68679c-a162-4630-8d84-93a3bbd48cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:02.088843 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de68679c-a162-4630-8d84-93a3bbd48cfc admin admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:02.089564 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de68679c-a162-4630-8d84-93a3bbd48cfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:02.091499 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de68679c-a162-4630-8d84-93a3bbd48cfc admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:02.115424 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1243/2486] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:29:02 2022] POST /identity/v3/projects => generated 383 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:29:02.119326 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359bb85-93b8-4a5e-b540-80ce12ae429d None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:02.129692 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f359bb85-93b8-4a5e-b540-80ce12ae429d None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:02.183520 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf55f3dd-7919-4347-a308-5341fa217ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:02.184185 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55f3dd-7919-4347-a308-5341fa217ed9 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:02.184465 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55f3dd-7919-4347-a308-5341fa217ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:02.184739 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55f3dd-7919-4347-a308-5341fa217ed9 admin admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:02.185422 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf55f3dd-7919-4347-a308-5341fa217ed9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:02.187376 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf55f3dd-7919-4347-a308-5341fa217ed9 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:02.206623 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1244/2487] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:29:02 2022] POST /identity/v3/users => generated 298 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:29:02.210599 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de68679c-a162-4630-8d84-93a3bbd48cfc admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:02.220842 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de68679c-a162-4630-8d84-93a3bbd48cfc admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:02.225518 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93864e87-3969-4428-8f5c-e00c4a643296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:02.226169 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93864e87-3969-4428-8f5c-e00c4a643296 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:02.226449 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93864e87-3969-4428-8f5c-e00c4a643296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:02.226725 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93864e87-3969-4428-8f5c-e00c4a643296 admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:02.227447 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93864e87-3969-4428-8f5c-e00c4a643296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:02.229128 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93864e87-3969-4428-8f5c-e00c4a643296 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:02.239627 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1244/2488] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:29:02.243877 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf55f3dd-7919-4347-a308-5341fa217ed9 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:02.253517 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf55f3dd-7919-4347-a308-5341fa217ed9 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:02.258668 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe922a9-c10c-4157-96a5-26669fae2c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:02.259523 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe922a9-c10c-4157-96a5-26669fae2c6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:02.259797 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe922a9-c10c-4157-96a5-26669fae2c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:02.260070 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe922a9-c10c-4157-96a5-26669fae2c6e admin admin] PATH_INFO: `/v3/projects/27cfa3c9a12e496aa022cc234f4ef521/users/b3d42136ad1e4e61b953702d045b0efd/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:02.274623 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe922a9-c10c-4157-96a5-26669fae2c6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=27cfa3c9a12e496aa022cc234f4ef521, user_id=b3d42136ad1e4e61b953702d045b0efd, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:02.277298 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe922a9-c10c-4157-96a5-26669fae2c6e admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:02.289191 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1245/2489] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:29:02 2022] PUT /identity/v3/projects/27cfa3c9a12e496aa022cc234f4ef521/users/b3d42136ad1e4e61b953702d045b0efd/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:29:02.293075 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93864e87-3969-4428-8f5c-e00c4a643296 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:02.303181 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93864e87-3969-4428-8f5c-e00c4a643296 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:02.356426 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf7c317-da6f-4e01-9545-83773bbe5268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:02.357065 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7c317-da6f-4e01-9545-83773bbe5268 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:02.357340 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7c317-da6f-4e01-9545-83773bbe5268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:02.357638 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf7c317-da6f-4e01-9545-83773bbe5268 admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:02.358342 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf7c317-da6f-4e01-9545-83773bbe5268 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:02.360182 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf7c317-da6f-4e01-9545-83773bbe5268 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:02.370260 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1245/2490] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:29:02.374185 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe922a9-c10c-4157-96a5-26669fae2c6e admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:02.384313 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe922a9-c10c-4157-96a5-26669fae2c6e admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:02.388863 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80882cb4-4101-4949-b875-6caf4ee9a715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:02.389753 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80882cb4-4101-4949-b875-6caf4ee9a715 admin admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:02.390029 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80882cb4-4101-4949-b875-6caf4ee9a715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:02.390301 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80882cb4-4101-4949-b875-6caf4ee9a715 admin admin] PATH_INFO: `/v3/projects/27cfa3c9a12e496aa022cc234f4ef521/users/b3d42136ad1e4e61b953702d045b0efd/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:02.392241 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80882cb4-4101-4949-b875-6caf4ee9a715 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27cfa3c9a12e496aa022cc234f4ef521, user_id=b3d42136ad1e4e61b953702d045b0efd, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:02.394891 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80882cb4-4101-4949-b875-6caf4ee9a715 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:02.405146 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1246/2491] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:29:02 2022] PUT /identity/v3/projects/27cfa3c9a12e496aa022cc234f4ef521/users/b3d42136ad1e4e61b953702d045b0efd/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:29:02.416832 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9039c26-7f01-4dba-88ee-8499343e05ee None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:02.417140 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9039c26-7f01-4dba-88ee-8499343e05ee None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:02.417416 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9039c26-7f01-4dba-88ee-8499343e05ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:02.442464 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-c9039c26-7f01-4dba-88ee-8499343e05ee None None] MFA Rules not processed for user `b3d42136ad1e4e61b953702d045b0efd`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:29:02.443716 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-c9039c26-7f01-4dba-88ee-8499343e05ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:29:02.510032 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1246/2492] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:29:02 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:29:02.520631 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80882cb4-4101-4949-b875-6caf4ee9a715 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:02.522962 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-80882cb4-4101-4949-b875-6caf4ee9a715 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:29:02.576664 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80882cb4-4101-4949-b875-6caf4ee9a715 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:02.580533 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd81176-5fa4-4110-90e1-c998e0d49d73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:02.581154 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd81176-5fa4-4110-90e1-c998e0d49d73 service cinder] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:02.581426 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd81176-5fa4-4110-90e1-c998e0d49d73 service cinder] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:02.581732 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd81176-5fa4-4110-90e1-c998e0d49d73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:02.590969 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd81176-5fa4-4110-90e1-c998e0d49d73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:02.592434 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd81176-5fa4-4110-90e1-c998e0d49d73 service cinder] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:02.601781 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1247/2493] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:29:02 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:29:02.694906 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9039c26-7f01-4dba-88ee-8499343e05ee None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:02.704672 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9039c26-7f01-4dba-88ee-8499343e05ee None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:02.708284 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900b10d-4bbe-48a9-b3cd-7bd287129492 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:02.709448 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900b10d-4bbe-48a9-b3cd-7bd287129492 service cinder] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:02.709779 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900b10d-4bbe-48a9-b3cd-7bd287129492 service cinder] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:02.710050 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900b10d-4bbe-48a9-b3cd-7bd287129492 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:02.763891 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e900b10d-4bbe-48a9-b3cd-7bd287129492 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:02.765314 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e900b10d-4bbe-48a9-b3cd-7bd287129492 service cinder] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:02.774556 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1247/2494] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:29:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:29:05.301961 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd81176-5fa4-4110-90e1-c998e0d49d73 service cinder] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:05.361193 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd81176-5fa4-4110-90e1-c998e0d49d73 service cinder] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:05.365907 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f7fcf2-5361-4d73-9e70-4545440a55bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:05.367242 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7fcf2-5361-4d73-9e70-4545440a55bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:05.367520 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7fcf2-5361-4d73-9e70-4545440a55bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:05.367938 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7fcf2-5361-4d73-9e70-4545440a55bb admin admin] PATH_INFO: `/v3/users/230209909bb642e9a124f09c5b7ade15` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:05.369843 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f7fcf2-5361-4d73-9e70-4545440a55bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=230209909bb642e9a124f09c5b7ade15)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:05.371869 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f7fcf2-5361-4d73-9e70-4545440a55bb admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:05.415983 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-58f7fcf2-5361-4d73-9e70-4545440a55bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '230209909bb642e9a124f09c5b7ade15'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:05.427104 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-58f7fcf2-5361-4d73-9e70-4545440a55bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '230209909bb642e9a124f09c5b7ade15'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:05.427767 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-58f7fcf2-5361-4d73-9e70-4545440a55bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '230209909bb642e9a124f09c5b7ade15'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:05.428365 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-58f7fcf2-5361-4d73-9e70-4545440a55bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '230209909bb642e9a124f09c5b7ade15'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:05.434905 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-58f7fcf2-5361-4d73-9e70-4545440a55bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '230209909bb642e9a124f09c5b7ade15'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:05.448119 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1248/2495] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:29:05 2022] DELETE /identity/v3/users/230209909bb642e9a124f09c5b7ade15 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:29:05.452950 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c650ba0-81ae-4f11-ac4a-5cc070045631 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:05.453452 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c650ba0-81ae-4f11-ac4a-5cc070045631 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:05.453571 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c650ba0-81ae-4f11-ac4a-5cc070045631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:05.470768 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-6c650ba0-81ae-4f11-ac4a-5cc070045631 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:29:05.471961 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-6c650ba0-81ae-4f11-ac4a-5cc070045631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:29:05.528924 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1248/2496] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:29:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:29:05.538543 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f7fcf2-5361-4d73-9e70-4545440a55bb admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:05.539926 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-58f7fcf2-5361-4d73-9e70-4545440a55bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:29:05.595026 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f7fcf2-5361-4d73-9e70-4545440a55bb admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:05.598620 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38f27a3-5388-4606-960b-bf5d5b836d42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:05.599251 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f27a3-5388-4606-960b-bf5d5b836d42 service neutron] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:05.599564 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f27a3-5388-4606-960b-bf5d5b836d42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:05.599841 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38f27a3-5388-4606-960b-bf5d5b836d42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:05.609076 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38f27a3-5388-4606-960b-bf5d5b836d42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:05.610596 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38f27a3-5388-4606-960b-bf5d5b836d42 service neutron] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:05.620275 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1249/2497] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:29:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:29:05.886430 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c650ba0-81ae-4f11-ac4a-5cc070045631 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:05.887862 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-6c650ba0-81ae-4f11-ac4a-5cc070045631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:29:05.900394 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c650ba0-81ae-4f11-ac4a-5cc070045631 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:05.905100 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15bb04-db30-4b73-b720-59983acece0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:05.906013 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15bb04-db30-4b73-b720-59983acece0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:05.906277 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15bb04-db30-4b73-b720-59983acece0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:05.906567 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a15bb04-db30-4b73-b720-59983acece0b admin admin] PATH_INFO: `/v3/projects/a7fba21a3c77430f8ef9ae8830567687` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:05.907756 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a15bb04-db30-4b73-b720-59983acece0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7fba21a3c77430f8ef9ae8830567687)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:05.909707 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a15bb04-db30-4b73-b720-59983acece0b admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:05.955945 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-5a15bb04-db30-4b73-b720-59983acece0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7fba21a3c77430f8ef9ae8830567687', 'request_id': 'req-5a15bb04-db30-4b73-b720-59983acece0b'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:05.961822 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-5a15bb04-db30-4b73-b720-59983acece0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7fba21a3c77430f8ef9ae8830567687', 'request_id': 'req-5a15bb04-db30-4b73-b720-59983acece0b'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:05.968925 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-5a15bb04-db30-4b73-b720-59983acece0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7fba21a3c77430f8ef9ae8830567687', 'request_id': 'req-5a15bb04-db30-4b73-b720-59983acece0b'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:05.978861 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-5a15bb04-db30-4b73-b720-59983acece0b admin admin] The token cache is being invalidate because project a7fba21a3c77430f8ef9ae8830567687 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:29:05.979141 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-5a15bb04-db30-4b73-b720-59983acece0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:05.979748 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-5a15bb04-db30-4b73-b720-59983acece0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:05.981476 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1249/2498] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:29:05 2022] DELETE /identity/v3/projects/a7fba21a3c77430f8ef9ae8830567687 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:29:05.985281 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38f27a3-5388-4606-960b-bf5d5b836d42 service neutron] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:05.995372 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38f27a3-5388-4606-960b-bf5d5b836d42 service neutron] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:06.054018 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73422bb-f05c-44a5-9a53-dc6fb44949d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:06.054886 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73422bb-f05c-44a5-9a53-dc6fb44949d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:06.059094 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73422bb-f05c-44a5-9a53-dc6fb44949d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:06.059400 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73422bb-f05c-44a5-9a53-dc6fb44949d7 admin admin] PATH_INFO: `/v3/users/b3d42136ad1e4e61b953702d045b0efd` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:06.060731 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73422bb-f05c-44a5-9a53-dc6fb44949d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3d42136ad1e4e61b953702d045b0efd)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:06.062664 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73422bb-f05c-44a5-9a53-dc6fb44949d7 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:06.108966 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-a73422bb-f05c-44a5-9a53-dc6fb44949d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3d42136ad1e4e61b953702d045b0efd'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:06.120526 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-a73422bb-f05c-44a5-9a53-dc6fb44949d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3d42136ad1e4e61b953702d045b0efd'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:06.121301 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-a73422bb-f05c-44a5-9a53-dc6fb44949d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3d42136ad1e4e61b953702d045b0efd'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:06.121927 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-a73422bb-f05c-44a5-9a53-dc6fb44949d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3d42136ad1e4e61b953702d045b0efd'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:06.129135 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-a73422bb-f05c-44a5-9a53-dc6fb44949d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3d42136ad1e4e61b953702d045b0efd'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:06.141258 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1250/2499] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:29:05 2022] DELETE /identity/v3/users/b3d42136ad1e4e61b953702d045b0efd => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:29:06.398981 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15bb04-db30-4b73-b720-59983acece0b admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:06.400369 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-5a15bb04-db30-4b73-b720-59983acece0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:29:06.413676 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a15bb04-db30-4b73-b720-59983acece0b admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:06.469354 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b4416d-6546-4d4e-8248-b9fbee3f0564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:06.470262 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4416d-6546-4d4e-8248-b9fbee3f0564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:06.470536 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4416d-6546-4d4e-8248-b9fbee3f0564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:06.470827 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b4416d-6546-4d4e-8248-b9fbee3f0564 admin admin] PATH_INFO: `/v3/projects/27cfa3c9a12e496aa022cc234f4ef521` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:06.471988 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b4416d-6546-4d4e-8248-b9fbee3f0564 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27cfa3c9a12e496aa022cc234f4ef521)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:06.473952 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b4416d-6546-4d4e-8248-b9fbee3f0564 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:06.518337 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-c5b4416d-6546-4d4e-8248-b9fbee3f0564 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27cfa3c9a12e496aa022cc234f4ef521', 'request_id': 'req-c5b4416d-6546-4d4e-8248-b9fbee3f0564'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:06.524937 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-c5b4416d-6546-4d4e-8248-b9fbee3f0564 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27cfa3c9a12e496aa022cc234f4ef521', 'request_id': 'req-c5b4416d-6546-4d4e-8248-b9fbee3f0564'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:06.532019 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-c5b4416d-6546-4d4e-8248-b9fbee3f0564 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27cfa3c9a12e496aa022cc234f4ef521', 'request_id': 'req-c5b4416d-6546-4d4e-8248-b9fbee3f0564'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:06.542204 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-c5b4416d-6546-4d4e-8248-b9fbee3f0564 admin admin] The token cache is being invalidate because project 27cfa3c9a12e496aa022cc234f4ef521 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:29:06.542484 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-c5b4416d-6546-4d4e-8248-b9fbee3f0564 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:06.543100 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-c5b4416d-6546-4d4e-8248-b9fbee3f0564 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:06.544674 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1250/2500] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:29:06 2022] DELETE /identity/v3/projects/27cfa3c9a12e496aa022cc234f4ef521 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:29:06.549705 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291c46b-b31f-4c45-a99f-38126cda67f7 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:06.550195 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291c46b-b31f-4c45-a99f-38126cda67f7 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:06.550387 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291c46b-b31f-4c45-a99f-38126cda67f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:06.570705 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-d291c46b-b31f-4c45-a99f-38126cda67f7 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:29:06.571897 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-d291c46b-b31f-4c45-a99f-38126cda67f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:29:06.627514 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1251/2501] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:29:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:29:06.635952 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313ecae-6044-4cb1-8703-6d8cfca3484d None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:06.636237 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313ecae-6044-4cb1-8703-6d8cfca3484d None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:06.636513 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313ecae-6044-4cb1-8703-6d8cfca3484d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:06.654599 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-e313ecae-6044-4cb1-8703-6d8cfca3484d None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:29:06.655780 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-e313ecae-6044-4cb1-8703-6d8cfca3484d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:29:06.663330 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1251/2502] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:29:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:29:06.667313 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d291c46b-b31f-4c45-a99f-38126cda67f7 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:06.676553 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d291c46b-b31f-4c45-a99f-38126cda67f7 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:06.681635 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90fda3e-19d5-40ba-9513-89cb17df2738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:06.682272 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90fda3e-19d5-40ba-9513-89cb17df2738 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:06.682544 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90fda3e-19d5-40ba-9513-89cb17df2738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:06.682812 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90fda3e-19d5-40ba-9513-89cb17df2738 admin admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:06.683547 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90fda3e-19d5-40ba-9513-89cb17df2738 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:29:06.683843 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90fda3e-19d5-40ba-9513-89cb17df2738 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:06.685411 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90fda3e-19d5-40ba-9513-89cb17df2738 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:06.697490 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1252/2503] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 17 18:29:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:29:06.701690 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313ecae-6044-4cb1-8703-6d8cfca3484d None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:06.711399 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313ecae-6044-4cb1-8703-6d8cfca3484d None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:06.716054 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379fa60e-01b0-4f06-9499-5aafacd171db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:06.716692 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379fa60e-01b0-4f06-9499-5aafacd171db admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:06.716976 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379fa60e-01b0-4f06-9499-5aafacd171db admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:06.717248 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379fa60e-01b0-4f06-9499-5aafacd171db admin admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:06.718005 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379fa60e-01b0-4f06-9499-5aafacd171db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:06.719888 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379fa60e-01b0-4f06-9499-5aafacd171db admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:06.744470 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1252/2504] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:29:06 2022] POST /identity/v3/projects => generated 409 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:29:06.748573 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90fda3e-19d5-40ba-9513-89cb17df2738 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:06.758954 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90fda3e-19d5-40ba-9513-89cb17df2738 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:06.813402 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d7182-21e3-4be8-8265-792056476735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:06.814085 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d7182-21e3-4be8-8265-792056476735 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:06.814401 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d7182-21e3-4be8-8265-792056476735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:06.814675 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d7182-21e3-4be8-8265-792056476735 admin admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:06.815361 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17d7182-21e3-4be8-8265-792056476735 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:06.817259 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17d7182-21e3-4be8-8265-792056476735 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:06.839674 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1253/2505] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:29:06 2022] POST /identity/v3/users => generated 305 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:29:06.840916 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379fa60e-01b0-4f06-9499-5aafacd171db admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:06.851036 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379fa60e-01b0-4f06-9499-5aafacd171db admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:06.855857 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65351031-e953-4ec6-a963-3772afbd3428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:06.856514 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65351031-e953-4ec6-a963-3772afbd3428 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:06.856795 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65351031-e953-4ec6-a963-3772afbd3428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:06.857067 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65351031-e953-4ec6-a963-3772afbd3428 admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:06.857831 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65351031-e953-4ec6-a963-3772afbd3428 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:06.859418 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65351031-e953-4ec6-a963-3772afbd3428 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:06.870200 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1253/2506] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:29:06.874033 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d7182-21e3-4be8-8265-792056476735 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:06.884493 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d7182-21e3-4be8-8265-792056476735 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:06.889099 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b69add-005b-478b-aad1-b3cea2183f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:06.889774 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b69add-005b-478b-aad1-b3cea2183f0e admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:06.890055 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b69add-005b-478b-aad1-b3cea2183f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:06.890328 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b69add-005b-478b-aad1-b3cea2183f0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:06.891040 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b69add-005b-478b-aad1-b3cea2183f0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:06.892614 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b69add-005b-478b-aad1-b3cea2183f0e admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:06.902109 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1254/2507] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:29:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:29:06.906176 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65351031-e953-4ec6-a963-3772afbd3428 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:06.915763 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65351031-e953-4ec6-a963-3772afbd3428 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:06.920462 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1507efab-d70b-4d4a-8c01-310572e91c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:06.921319 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507efab-d70b-4d4a-8c01-310572e91c3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:06.921626 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507efab-d70b-4d4a-8c01-310572e91c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:06.922041 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1507efab-d70b-4d4a-8c01-310572e91c3a admin admin] PATH_INFO: `/v3/projects/25db3df8940f439db573302db769cd31/users/2d0fa16a8cba4daa97f6720e4235fadc/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:06.936719 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1507efab-d70b-4d4a-8c01-310572e91c3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=25db3df8940f439db573302db769cd31, user_id=2d0fa16a8cba4daa97f6720e4235fadc, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:06.939828 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1507efab-d70b-4d4a-8c01-310572e91c3a admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:06.953197 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1254/2508] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:29:06 2022] PUT /identity/v3/projects/25db3df8940f439db573302db769cd31/users/2d0fa16a8cba4daa97f6720e4235fadc/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:29:06.963356 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e1d974-f7e1-409d-8f66-ade9c096fe53 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:06.963637 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e1d974-f7e1-409d-8f66-ade9c096fe53 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:06.963909 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e1d974-f7e1-409d-8f66-ade9c096fe53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:06.989714 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-77e1d974-f7e1-409d-8f66-ade9c096fe53 None None] MFA Rules not processed for user `2d0fa16a8cba4daa97f6720e4235fadc`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:29:06.991414 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-77e1d974-f7e1-409d-8f66-ade9c096fe53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:29:07.051722 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1255/2509] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:29:06 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:29:07.056764 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1507efab-d70b-4d4a-8c01-310572e91c3a admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:07.114840 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1507efab-d70b-4d4a-8c01-310572e91c3a admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:07.119983 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f803696-e2e2-47de-8b40-af76e6369612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:07.120618 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f803696-e2e2-47de-8b40-af76e6369612 admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:07.120895 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f803696-e2e2-47de-8b40-af76e6369612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:07.121171 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f803696-e2e2-47de-8b40-af76e6369612 admin admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:07.121873 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f803696-e2e2-47de-8b40-af76e6369612 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:07.123755 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f803696-e2e2-47de-8b40-af76e6369612 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:07.147365 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1255/2510] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:29:07 2022] POST /identity/v3/projects => generated 409 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:29:07.151412 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e1d974-f7e1-409d-8f66-ade9c096fe53 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:07.161675 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e1d974-f7e1-409d-8f66-ade9c096fe53 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:07.214981 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cd0cce-1c3f-4b1c-8cde-8698ec249649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:07.215635 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd0cce-1c3f-4b1c-8cde-8698ec249649 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:07.215914 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd0cce-1c3f-4b1c-8cde-8698ec249649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:07.216188 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd0cce-1c3f-4b1c-8cde-8698ec249649 admin admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:07.216870 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cd0cce-1c3f-4b1c-8cde-8698ec249649 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:07.218815 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cd0cce-1c3f-4b1c-8cde-8698ec249649 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:07.237684 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1256/2511] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:29:07 2022] POST /identity/v3/users => generated 311 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:29:07.242348 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f803696-e2e2-47de-8b40-af76e6369612 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:07.252741 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f803696-e2e2-47de-8b40-af76e6369612 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:07.257655 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2341cfe2-8a14-4032-ad51-628f7eb21bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:07.258349 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2341cfe2-8a14-4032-ad51-628f7eb21bda admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:07.258664 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2341cfe2-8a14-4032-ad51-628f7eb21bda admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:07.258941 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2341cfe2-8a14-4032-ad51-628f7eb21bda admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:07.259735 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2341cfe2-8a14-4032-ad51-628f7eb21bda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:07.261350 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2341cfe2-8a14-4032-ad51-628f7eb21bda admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:07.272534 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1256/2512] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:29:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:29:07.276504 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cd0cce-1c3f-4b1c-8cde-8698ec249649 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:07.286254 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cd0cce-1c3f-4b1c-8cde-8698ec249649 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:07.291333 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3047741f-69f1-44d3-93de-f84f68bcb87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:07.292187 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047741f-69f1-44d3-93de-f84f68bcb87a admin admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:07.292465 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047741f-69f1-44d3-93de-f84f68bcb87a admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:07.292767 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3047741f-69f1-44d3-93de-f84f68bcb87a admin admin] PATH_INFO: `/v3/projects/491c631cb75f489d817d446a9ec7f7ae/users/758f080bc5e54ea7b4c296ccd07d501f/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:07.307101 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3047741f-69f1-44d3-93de-f84f68bcb87a admin admin] RBAC: Authorizing `identity:create_grant(project_id=491c631cb75f489d817d446a9ec7f7ae, user_id=758f080bc5e54ea7b4c296ccd07d501f, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:07.309812 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3047741f-69f1-44d3-93de-f84f68bcb87a admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:07.322709 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1257/2513] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:29:07 2022] PUT /identity/v3/projects/491c631cb75f489d817d446a9ec7f7ae/users/758f080bc5e54ea7b4c296ccd07d501f/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:29:07.326610 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2341cfe2-8a14-4032-ad51-628f7eb21bda admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:07.337139 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2341cfe2-8a14-4032-ad51-628f7eb21bda admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:07.395232 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97529d34-8a07-4722-97d2-bc7c2d7e2862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:07.396061 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97529d34-8a07-4722-97d2-bc7c2d7e2862 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:07.396441 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97529d34-8a07-4722-97d2-bc7c2d7e2862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:07.396947 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97529d34-8a07-4722-97d2-bc7c2d7e2862 admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:07.398452 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97529d34-8a07-4722-97d2-bc7c2d7e2862 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:07.399999 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97529d34-8a07-4722-97d2-bc7c2d7e2862 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:07.409776 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1257/2514] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:29:07 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:29:07.414027 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3047741f-69f1-44d3-93de-f84f68bcb87a admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:07.424302 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3047741f-69f1-44d3-93de-f84f68bcb87a admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:07.429302 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c7133c-f78a-4240-b0bd-15405ebb234a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:07.430199 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c7133c-f78a-4240-b0bd-15405ebb234a admin admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:07.430522 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c7133c-f78a-4240-b0bd-15405ebb234a admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:07.430793 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c7133c-f78a-4240-b0bd-15405ebb234a admin admin] PATH_INFO: `/v3/projects/491c631cb75f489d817d446a9ec7f7ae/users/758f080bc5e54ea7b4c296ccd07d501f/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:07.432687 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c7133c-f78a-4240-b0bd-15405ebb234a admin admin] RBAC: Authorizing `identity:create_grant(project_id=491c631cb75f489d817d446a9ec7f7ae, user_id=758f080bc5e54ea7b4c296ccd07d501f, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:07.435327 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c7133c-f78a-4240-b0bd-15405ebb234a admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:07.445916 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1258/2515] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:29:07 2022] PUT /identity/v3/projects/491c631cb75f489d817d446a9ec7f7ae/users/758f080bc5e54ea7b4c296ccd07d501f/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:29:07.456935 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d0615-d239-4f73-a1ed-523ffee4599c None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:07.457217 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d0615-d239-4f73-a1ed-523ffee4599c None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:07.457517 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d0615-d239-4f73-a1ed-523ffee4599c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:07.482681 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-9b4d0615-d239-4f73-a1ed-523ffee4599c None None] MFA Rules not processed for user `758f080bc5e54ea7b4c296ccd07d501f`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:29:07.483889 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-9b4d0615-d239-4f73-a1ed-523ffee4599c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:29:07.547959 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1258/2516] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:29:07 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:29:07.559238 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c7133c-f78a-4240-b0bd-15405ebb234a admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:07.561026 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-67c7133c-f78a-4240-b0bd-15405ebb234a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:29:07.616628 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c7133c-f78a-4240-b0bd-15405ebb234a admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:07.620245 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea48b0a-f2f2-493e-87aa-78bcd6805a66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:07.620868 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea48b0a-f2f2-493e-87aa-78bcd6805a66 service cinder] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:07.621149 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea48b0a-f2f2-493e-87aa-78bcd6805a66 service cinder] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:07.621423 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea48b0a-f2f2-493e-87aa-78bcd6805a66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:07.630208 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea48b0a-f2f2-493e-87aa-78bcd6805a66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:07.631667 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea48b0a-f2f2-493e-87aa-78bcd6805a66 service cinder] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:07.640700 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1259/2517] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:29:07 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:29:07.781690 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d0615-d239-4f73-a1ed-523ffee4599c None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:07.791202 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4d0615-d239-4f73-a1ed-523ffee4599c None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:07.795104 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e073b1-1b1d-4d92-9037-ff69dac1b00e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:07.795743 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e073b1-1b1d-4d92-9037-ff69dac1b00e service cinder] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:07.796045 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e073b1-1b1d-4d92-9037-ff69dac1b00e service cinder] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:07.796320 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e073b1-1b1d-4d92-9037-ff69dac1b00e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:07.852108 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e073b1-1b1d-4d92-9037-ff69dac1b00e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:07.853580 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e073b1-1b1d-4d92-9037-ff69dac1b00e service cinder] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:07.862317 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1259/2518] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:29:07 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:29:17.127102 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea48b0a-f2f2-493e-87aa-78bcd6805a66 service cinder] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:17.186476 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea48b0a-f2f2-493e-87aa-78bcd6805a66 service cinder] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:17.190870 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada97fa4-82e2-4164-9a12-4a028665fc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:17.191807 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada97fa4-82e2-4164-9a12-4a028665fc18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:17.192098 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada97fa4-82e2-4164-9a12-4a028665fc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:17.192356 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada97fa4-82e2-4164-9a12-4a028665fc18 admin admin] PATH_INFO: `/v3/users/2d0fa16a8cba4daa97f6720e4235fadc` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:17.193562 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada97fa4-82e2-4164-9a12-4a028665fc18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d0fa16a8cba4daa97f6720e4235fadc)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:17.196066 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada97fa4-82e2-4164-9a12-4a028665fc18 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:17.240367 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-ada97fa4-82e2-4164-9a12-4a028665fc18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d0fa16a8cba4daa97f6720e4235fadc'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:17.251983 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-ada97fa4-82e2-4164-9a12-4a028665fc18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d0fa16a8cba4daa97f6720e4235fadc'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:17.252628 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-ada97fa4-82e2-4164-9a12-4a028665fc18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d0fa16a8cba4daa97f6720e4235fadc'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:17.253226 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-ada97fa4-82e2-4164-9a12-4a028665fc18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d0fa16a8cba4daa97f6720e4235fadc'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:17.260382 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-ada97fa4-82e2-4164-9a12-4a028665fc18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d0fa16a8cba4daa97f6720e4235fadc'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:17.272345 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1260/2519] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:29:17 2022] DELETE /identity/v3/users/2d0fa16a8cba4daa97f6720e4235fadc => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:29:17.276812 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff18f59-fe74-48d6-836e-3fc0a6508ad4 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:17.277293 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff18f59-fe74-48d6-836e-3fc0a6508ad4 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:17.277409 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff18f59-fe74-48d6-836e-3fc0a6508ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:17.294132 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-bff18f59-fe74-48d6-836e-3fc0a6508ad4 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:29:17.295305 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-bff18f59-fe74-48d6-836e-3fc0a6508ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:29:17.351887 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1260/2520] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:29:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:29:17.361400 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada97fa4-82e2-4164-9a12-4a028665fc18 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:17.362822 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-ada97fa4-82e2-4164-9a12-4a028665fc18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:29:17.416885 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada97fa4-82e2-4164-9a12-4a028665fc18 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:17.420420 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b6317-2c88-48a7-bfb6-e5fa8f6be3f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:17.421039 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b6317-2c88-48a7-bfb6-e5fa8f6be3f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:17.421314 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b6317-2c88-48a7-bfb6-e5fa8f6be3f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:17.421619 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b6317-2c88-48a7-bfb6-e5fa8f6be3f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:17.430696 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306b6317-2c88-48a7-bfb6-e5fa8f6be3f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:17.432110 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306b6317-2c88-48a7-bfb6-e5fa8f6be3f9 service neutron] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:17.441298 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1261/2521] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:29:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:29:17.698398 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff18f59-fe74-48d6-836e-3fc0a6508ad4 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:17.699900 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-bff18f59-fe74-48d6-836e-3fc0a6508ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:29:17.713283 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff18f59-fe74-48d6-836e-3fc0a6508ad4 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:17.717966 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f78c6a4-00d8-4513-919f-d17c3df97330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:17.718952 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78c6a4-00d8-4513-919f-d17c3df97330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:17.719291 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78c6a4-00d8-4513-919f-d17c3df97330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:17.719628 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f78c6a4-00d8-4513-919f-d17c3df97330 admin admin] PATH_INFO: `/v3/projects/25db3df8940f439db573302db769cd31` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:17.720875 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f78c6a4-00d8-4513-919f-d17c3df97330 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25db3df8940f439db573302db769cd31)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:17.723227 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f78c6a4-00d8-4513-919f-d17c3df97330 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:17.769616 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-9f78c6a4-00d8-4513-919f-d17c3df97330 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25db3df8940f439db573302db769cd31', 'request_id': 'req-9f78c6a4-00d8-4513-919f-d17c3df97330'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:17.775504 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-9f78c6a4-00d8-4513-919f-d17c3df97330 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25db3df8940f439db573302db769cd31', 'request_id': 'req-9f78c6a4-00d8-4513-919f-d17c3df97330'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:17.782137 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-9f78c6a4-00d8-4513-919f-d17c3df97330 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25db3df8940f439db573302db769cd31', 'request_id': 'req-9f78c6a4-00d8-4513-919f-d17c3df97330'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:17.796757 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-9f78c6a4-00d8-4513-919f-d17c3df97330 admin admin] The token cache is being invalidate because project 25db3df8940f439db573302db769cd31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:29:17.797046 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-9f78c6a4-00d8-4513-919f-d17c3df97330 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:17.797725 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-9f78c6a4-00d8-4513-919f-d17c3df97330 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:17.799310 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1261/2522] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:29:17 2022] DELETE /identity/v3/projects/25db3df8940f439db573302db769cd31 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:29:17.803439 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b6317-2c88-48a7-bfb6-e5fa8f6be3f9 service neutron] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:17.813529 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b6317-2c88-48a7-bfb6-e5fa8f6be3f9 service neutron] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:17.868539 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e6218-cf1d-441b-9f1d-0582674f13ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:17.869396 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e6218-cf1d-441b-9f1d-0582674f13ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:17.869703 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e6218-cf1d-441b-9f1d-0582674f13ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:17.869978 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e6218-cf1d-441b-9f1d-0582674f13ec admin admin] PATH_INFO: `/v3/users/758f080bc5e54ea7b4c296ccd07d501f` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:17.871183 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0e6218-cf1d-441b-9f1d-0582674f13ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=758f080bc5e54ea7b4c296ccd07d501f)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:17.873102 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0e6218-cf1d-441b-9f1d-0582674f13ec admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:17.917632 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-4c0e6218-cf1d-441b-9f1d-0582674f13ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '758f080bc5e54ea7b4c296ccd07d501f'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:17.928583 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-4c0e6218-cf1d-441b-9f1d-0582674f13ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '758f080bc5e54ea7b4c296ccd07d501f'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:17.929222 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-4c0e6218-cf1d-441b-9f1d-0582674f13ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '758f080bc5e54ea7b4c296ccd07d501f'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:17.929828 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-4c0e6218-cf1d-441b-9f1d-0582674f13ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '758f080bc5e54ea7b4c296ccd07d501f'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:17.936282 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-4c0e6218-cf1d-441b-9f1d-0582674f13ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '758f080bc5e54ea7b4c296ccd07d501f'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:17.948317 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1262/2523] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:29:17 2022] DELETE /identity/v3/users/758f080bc5e54ea7b4c296ccd07d501f => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:29:18.210376 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f78c6a4-00d8-4513-919f-d17c3df97330 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:18.212419 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-9f78c6a4-00d8-4513-919f-d17c3df97330 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:29:18.225367 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f78c6a4-00d8-4513-919f-d17c3df97330 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:18.282663 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e319444-dcc2-4b20-a4a0-22254ad4aa1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:18.283731 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e319444-dcc2-4b20-a4a0-22254ad4aa1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:18.284012 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e319444-dcc2-4b20-a4a0-22254ad4aa1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:18.284284 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e319444-dcc2-4b20-a4a0-22254ad4aa1d admin admin] PATH_INFO: `/v3/projects/491c631cb75f489d817d446a9ec7f7ae` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:18.285481 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e319444-dcc2-4b20-a4a0-22254ad4aa1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=491c631cb75f489d817d446a9ec7f7ae)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:18.287383 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e319444-dcc2-4b20-a4a0-22254ad4aa1d admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:18.331486 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-1e319444-dcc2-4b20-a4a0-22254ad4aa1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '491c631cb75f489d817d446a9ec7f7ae', 'request_id': 'req-1e319444-dcc2-4b20-a4a0-22254ad4aa1d'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:18.338240 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-1e319444-dcc2-4b20-a4a0-22254ad4aa1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '491c631cb75f489d817d446a9ec7f7ae', 'request_id': 'req-1e319444-dcc2-4b20-a4a0-22254ad4aa1d'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:18.346073 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-1e319444-dcc2-4b20-a4a0-22254ad4aa1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '491c631cb75f489d817d446a9ec7f7ae', 'request_id': 'req-1e319444-dcc2-4b20-a4a0-22254ad4aa1d'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:18.356065 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-1e319444-dcc2-4b20-a4a0-22254ad4aa1d admin admin] The token cache is being invalidate because project 491c631cb75f489d817d446a9ec7f7ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:29:18.356353 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-1e319444-dcc2-4b20-a4a0-22254ad4aa1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:18.356968 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-1e319444-dcc2-4b20-a4a0-22254ad4aa1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:18.358554 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1262/2524] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:29:18 2022] DELETE /identity/v3/projects/491c631cb75f489d817d446a9ec7f7ae => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:29:18.363439 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456352c-cb1f-4711-abbb-074bdae19548 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:18.363879 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456352c-cb1f-4711-abbb-074bdae19548 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:18.364002 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456352c-cb1f-4711-abbb-074bdae19548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:18.381109 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-9456352c-cb1f-4711-abbb-074bdae19548 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:29:18.383143 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-9456352c-cb1f-4711-abbb-074bdae19548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:29:18.438936 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1263/2525] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:29:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:29:18.447198 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a406ed9-f39f-4582-b9bf-75d6caee02dd None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:18.447483 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a406ed9-f39f-4582-b9bf-75d6caee02dd None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:18.447758 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a406ed9-f39f-4582-b9bf-75d6caee02dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:18.466570 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-6a406ed9-f39f-4582-b9bf-75d6caee02dd None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:29:18.467686 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-6a406ed9-f39f-4582-b9bf-75d6caee02dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:29:18.475320 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1263/2526] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:29:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:29:18.479307 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9456352c-cb1f-4711-abbb-074bdae19548 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:18.488638 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9456352c-cb1f-4711-abbb-074bdae19548 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:18.493355 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450df6ff-9822-47ac-b879-05b11ba1c381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:18.494069 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450df6ff-9822-47ac-b879-05b11ba1c381 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:18.494353 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450df6ff-9822-47ac-b879-05b11ba1c381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:18.494626 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450df6ff-9822-47ac-b879-05b11ba1c381 admin admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:18.495337 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450df6ff-9822-47ac-b879-05b11ba1c381 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:29:18.495639 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450df6ff-9822-47ac-b879-05b11ba1c381 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:18.497226 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450df6ff-9822-47ac-b879-05b11ba1c381 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:18.509213 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1264/2527] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 17 18:29:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:29:18.513541 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a406ed9-f39f-4582-b9bf-75d6caee02dd None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:18.522362 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a406ed9-f39f-4582-b9bf-75d6caee02dd None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:18.527556 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4dbab7-ecd8-4f0d-b754-dd62ce746e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:18.528191 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4dbab7-ecd8-4f0d-b754-dd62ce746e69 admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:18.528469 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4dbab7-ecd8-4f0d-b754-dd62ce746e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:18.528741 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4dbab7-ecd8-4f0d-b754-dd62ce746e69 admin admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:18.529478 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4dbab7-ecd8-4f0d-b754-dd62ce746e69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:18.531717 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4dbab7-ecd8-4f0d-b754-dd62ce746e69 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:18.555933 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1264/2528] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:29:18 2022] POST /identity/v3/projects => generated 377 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:29:18.559965 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450df6ff-9822-47ac-b879-05b11ba1c381 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:18.569567 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450df6ff-9822-47ac-b879-05b11ba1c381 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:18.623315 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1fa120-f619-4be2-8bef-f4ccf6e23aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:18.623957 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1fa120-f619-4be2-8bef-f4ccf6e23aad admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:18.624239 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1fa120-f619-4be2-8bef-f4ccf6e23aad admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:18.624501 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1fa120-f619-4be2-8bef-f4ccf6e23aad admin admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:18.625166 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1fa120-f619-4be2-8bef-f4ccf6e23aad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:18.627082 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1fa120-f619-4be2-8bef-f4ccf6e23aad admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:18.645274 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1265/2529] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:29:18 2022] POST /identity/v3/users => generated 289 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:29:18.649335 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4dbab7-ecd8-4f0d-b754-dd62ce746e69 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:18.659310 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4dbab7-ecd8-4f0d-b754-dd62ce746e69 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:18.663931 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28269380-85e8-4089-9d9d-9954382aeb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:18.664578 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28269380-85e8-4089-9d9d-9954382aeb0b admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:18.664887 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28269380-85e8-4089-9d9d-9954382aeb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:18.665155 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28269380-85e8-4089-9d9d-9954382aeb0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:18.665900 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28269380-85e8-4089-9d9d-9954382aeb0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:18.667509 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28269380-85e8-4089-9d9d-9954382aeb0b admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:18.677494 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1265/2530] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:29:18.681473 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1fa120-f619-4be2-8bef-f4ccf6e23aad admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:18.691097 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1fa120-f619-4be2-8bef-f4ccf6e23aad admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:18.696196 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d09de3-cbe4-4359-9ebe-458f1a636d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:18.696834 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d09de3-cbe4-4359-9ebe-458f1a636d45 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:18.697108 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d09de3-cbe4-4359-9ebe-458f1a636d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:18.697375 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d09de3-cbe4-4359-9ebe-458f1a636d45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:18.698125 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d09de3-cbe4-4359-9ebe-458f1a636d45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:18.699704 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d09de3-cbe4-4359-9ebe-458f1a636d45 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:18.709946 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1266/2531] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:29:18.714000 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28269380-85e8-4089-9d9d-9954382aeb0b admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:18.723775 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28269380-85e8-4089-9d9d-9954382aeb0b admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:18.728513 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1761f-e802-4955-bc65-df82f906dd6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:18.729420 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1761f-e802-4955-bc65-df82f906dd6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:18.729721 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1761f-e802-4955-bc65-df82f906dd6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:18.729992 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1761f-e802-4955-bc65-df82f906dd6a admin admin] PATH_INFO: `/v3/projects/fec8c533f5954580a8ffbba3ef4f3216/users/e9cb7417babb4e239847395447f2c660/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:18.744606 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b1761f-e802-4955-bc65-df82f906dd6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fec8c533f5954580a8ffbba3ef4f3216, user_id=e9cb7417babb4e239847395447f2c660, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:18.747337 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b1761f-e802-4955-bc65-df82f906dd6a admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:18.760874 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1266/2532] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:29:18 2022] PUT /identity/v3/projects/fec8c533f5954580a8ffbba3ef4f3216/users/e9cb7417babb4e239847395447f2c660/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:29:18.771358 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94933988-867b-46fa-b5e0-fc1b43e261ff None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:18.771645 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94933988-867b-46fa-b5e0-fc1b43e261ff None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:18.771922 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94933988-867b-46fa-b5e0-fc1b43e261ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:18.803127 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-94933988-867b-46fa-b5e0-fc1b43e261ff None None] MFA Rules not processed for user `e9cb7417babb4e239847395447f2c660`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:29:18.804999 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-94933988-867b-46fa-b5e0-fc1b43e261ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:29:18.867432 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1267/2533] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:29:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:29:18.879065 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1761f-e802-4955-bc65-df82f906dd6a admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:18.880732 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-e0b1761f-e802-4955-bc65-df82f906dd6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:29:18.936152 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1761f-e802-4955-bc65-df82f906dd6a admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:18.939735 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe0cccc-1566-4414-bcb2-98d0eda4c298 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:18.940368 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0cccc-1566-4414-bcb2-98d0eda4c298 service cinder] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:18.940644 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0cccc-1566-4414-bcb2-98d0eda4c298 service cinder] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:18.940915 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0cccc-1566-4414-bcb2-98d0eda4c298 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:18.949754 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe0cccc-1566-4414-bcb2-98d0eda4c298 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:18.951170 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe0cccc-1566-4414-bcb2-98d0eda4c298 service cinder] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:18.960282 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1267/2534] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:29:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:29:40.061577 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94933988-867b-46fa-b5e0-fc1b43e261ff None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:40.063042 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-94933988-867b-46fa-b5e0-fc1b43e261ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:29:40.187030 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94933988-867b-46fa-b5e0-fc1b43e261ff None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:40.192673 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0daa2f-508b-4af7-a68d-9c62c989b3e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b430b739cb54fc7911bc89f8ea2df72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:40.193409 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0daa2f-508b-4af7-a68d-9c62c989b3e3 service nova] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:40.193717 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0daa2f-508b-4af7-a68d-9c62c989b3e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:40.193987 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0daa2f-508b-4af7-a68d-9c62c989b3e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:40.196443 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-9d0daa2f-508b-4af7-a68d-9c62c989b3e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:29:40.272504 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0daa2f-508b-4af7-a68d-9c62c989b3e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:40.275072 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0daa2f-508b-4af7-a68d-9c62c989b3e3 service nova] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:40.292564 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1268/2535] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:29:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:29:42.497222 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe0cccc-1566-4414-bcb2-98d0eda4c298 service cinder] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:42.589581 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe0cccc-1566-4414-bcb2-98d0eda4c298 service cinder] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:42.594162 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1d53c8-9a1b-45e7-954f-aa372843d3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:42.595008 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d53c8-9a1b-45e7-954f-aa372843d3ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:42.595286 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d53c8-9a1b-45e7-954f-aa372843d3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:42.595559 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1d53c8-9a1b-45e7-954f-aa372843d3ef admin admin] PATH_INFO: `/v3/users/e9cb7417babb4e239847395447f2c660` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:42.596735 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1d53c8-9a1b-45e7-954f-aa372843d3ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9cb7417babb4e239847395447f2c660)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:42.598669 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1d53c8-9a1b-45e7-954f-aa372843d3ef admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:42.642473 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-9e1d53c8-9a1b-45e7-954f-aa372843d3ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9cb7417babb4e239847395447f2c660'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:42.649018 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-9e1d53c8-9a1b-45e7-954f-aa372843d3ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9cb7417babb4e239847395447f2c660'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:42.649686 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-9e1d53c8-9a1b-45e7-954f-aa372843d3ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9cb7417babb4e239847395447f2c660'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:42.656124 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-9e1d53c8-9a1b-45e7-954f-aa372843d3ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9cb7417babb4e239847395447f2c660'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:42.656732 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-9e1d53c8-9a1b-45e7-954f-aa372843d3ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9cb7417babb4e239847395447f2c660'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:42.672877 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1268/2536] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:29:42 2022] DELETE /identity/v3/users/e9cb7417babb4e239847395447f2c660 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:29:42.677359 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d703939-8b8f-47d0-b773-89814e2d7fa1 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:42.677882 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d703939-8b8f-47d0-b773-89814e2d7fa1 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:42.677982 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d703939-8b8f-47d0-b773-89814e2d7fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:42.715927 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-0d703939-8b8f-47d0-b773-89814e2d7fa1 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:29:42.717279 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-0d703939-8b8f-47d0-b773-89814e2d7fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:29:42.773423 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1269/2537] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:29:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:29:42.782902 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1d53c8-9a1b-45e7-954f-aa372843d3ef admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:42.784340 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-9e1d53c8-9a1b-45e7-954f-aa372843d3ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:29:42.859467 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1d53c8-9a1b-45e7-954f-aa372843d3ef admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:42.863186 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fa6aa0-b649-43b5-869d-6098ff29b632 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:42.863821 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa6aa0-b649-43b5-869d-6098ff29b632 service neutron] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:42.864098 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa6aa0-b649-43b5-869d-6098ff29b632 service neutron] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:42.864369 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa6aa0-b649-43b5-869d-6098ff29b632 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:42.873792 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa6aa0-b649-43b5-869d-6098ff29b632 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:42.875214 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fa6aa0-b649-43b5-869d-6098ff29b632 service neutron] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:42.884346 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1269/2538] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:29:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:29:43.141191 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d703939-8b8f-47d0-b773-89814e2d7fa1 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:43.142642 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-0d703939-8b8f-47d0-b773-89814e2d7fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:29:43.154228 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d703939-8b8f-47d0-b773-89814e2d7fa1 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:43.158813 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc79f3d8-f21c-4ea2-819e-3acb0c6be768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:43.159652 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79f3d8-f21c-4ea2-819e-3acb0c6be768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:43.159927 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79f3d8-f21c-4ea2-819e-3acb0c6be768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:43.160195 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc79f3d8-f21c-4ea2-819e-3acb0c6be768 admin admin] PATH_INFO: `/v3/projects/fec8c533f5954580a8ffbba3ef4f3216` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:43.161368 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc79f3d8-f21c-4ea2-819e-3acb0c6be768 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fec8c533f5954580a8ffbba3ef4f3216)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:43.163291 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc79f3d8-f21c-4ea2-819e-3acb0c6be768 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:43.220511 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-cc79f3d8-f21c-4ea2-819e-3acb0c6be768 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fec8c533f5954580a8ffbba3ef4f3216', 'request_id': 'req-cc79f3d8-f21c-4ea2-819e-3acb0c6be768'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:43.226515 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-cc79f3d8-f21c-4ea2-819e-3acb0c6be768 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fec8c533f5954580a8ffbba3ef4f3216', 'request_id': 'req-cc79f3d8-f21c-4ea2-819e-3acb0c6be768'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:43.233332 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-cc79f3d8-f21c-4ea2-819e-3acb0c6be768 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fec8c533f5954580a8ffbba3ef4f3216', 'request_id': 'req-cc79f3d8-f21c-4ea2-819e-3acb0c6be768'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:43.243516 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-cc79f3d8-f21c-4ea2-819e-3acb0c6be768 admin admin] The token cache is being invalidate because project fec8c533f5954580a8ffbba3ef4f3216 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:29:43.243795 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-cc79f3d8-f21c-4ea2-819e-3acb0c6be768 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:43.244441 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-cc79f3d8-f21c-4ea2-819e-3acb0c6be768 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:43.246650 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1270/2539] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:29:43 2022] DELETE /identity/v3/projects/fec8c533f5954580a8ffbba3ef4f3216 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:29:43.251448 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eebd428-a15c-4ddb-967e-4afc4dba8ba5 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:43.251731 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eebd428-a15c-4ddb-967e-4afc4dba8ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:43.252007 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eebd428-a15c-4ddb-967e-4afc4dba8ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:43.269947 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-7eebd428-a15c-4ddb-967e-4afc4dba8ba5 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:29:43.271402 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-7eebd428-a15c-4ddb-967e-4afc4dba8ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:29:43.328262 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1270/2540] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:29:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:29:43.335929 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9065a4-9d38-447f-a9f2-dc343ca2e944 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:43.336209 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9065a4-9d38-447f-a9f2-dc343ca2e944 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:43.336480 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9065a4-9d38-447f-a9f2-dc343ca2e944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:43.355149 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-bf9065a4-9d38-447f-a9f2-dc343ca2e944 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:29:43.356324 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-bf9065a4-9d38-447f-a9f2-dc343ca2e944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:29:43.363916 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1271/2541] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:29:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:29:43.367822 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eebd428-a15c-4ddb-967e-4afc4dba8ba5 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:43.377417 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eebd428-a15c-4ddb-967e-4afc4dba8ba5 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:43.381976 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c67541-dd4b-4d50-b589-e16c3b137d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:43.382612 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c67541-dd4b-4d50-b589-e16c3b137d34 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:43.382894 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c67541-dd4b-4d50-b589-e16c3b137d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:43.383168 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c67541-dd4b-4d50-b589-e16c3b137d34 admin admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:43.383884 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c67541-dd4b-4d50-b589-e16c3b137d34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:29:43.384191 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c67541-dd4b-4d50-b589-e16c3b137d34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:43.385815 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c67541-dd4b-4d50-b589-e16c3b137d34 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:43.397039 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1271/2542] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 17 18:29:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:29:43.401732 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9065a4-9d38-447f-a9f2-dc343ca2e944 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:43.410488 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9065a4-9d38-447f-a9f2-dc343ca2e944 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:43.414957 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39901a2-b3a5-4a67-9c99-d5f19b1b1d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:43.415579 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39901a2-b3a5-4a67-9c99-d5f19b1b1d53 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:43.415850 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39901a2-b3a5-4a67-9c99-d5f19b1b1d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:43.416113 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39901a2-b3a5-4a67-9c99-d5f19b1b1d53 admin admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:43.417369 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39901a2-b3a5-4a67-9c99-d5f19b1b1d53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:43.419255 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39901a2-b3a5-4a67-9c99-d5f19b1b1d53 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:43.443113 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1272/2543] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:29:43 2022] POST /identity/v3/projects => generated 377 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:29:43.447135 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c67541-dd4b-4d50-b589-e16c3b137d34 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:43.457034 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c67541-dd4b-4d50-b589-e16c3b137d34 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:43.511269 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862aaa4a-ed0b-423b-b216-9edc2a2eb0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:43.511934 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862aaa4a-ed0b-423b-b216-9edc2a2eb0cb admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:43.512193 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862aaa4a-ed0b-423b-b216-9edc2a2eb0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:43.512490 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862aaa4a-ed0b-423b-b216-9edc2a2eb0cb admin admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:43.513203 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862aaa4a-ed0b-423b-b216-9edc2a2eb0cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:43.515337 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862aaa4a-ed0b-423b-b216-9edc2a2eb0cb admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:43.538643 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1272/2544] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:29:43 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:29:43.545039 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39901a2-b3a5-4a67-9c99-d5f19b1b1d53 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:43.558701 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39901a2-b3a5-4a67-9c99-d5f19b1b1d53 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:43.563396 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb6711a-1820-41f3-8efe-4fcb8d6d770e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:43.564049 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6711a-1820-41f3-8efe-4fcb8d6d770e admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:43.564325 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6711a-1820-41f3-8efe-4fcb8d6d770e admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:43.564599 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6711a-1820-41f3-8efe-4fcb8d6d770e admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:43.565313 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb6711a-1820-41f3-8efe-4fcb8d6d770e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:43.566931 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb6711a-1820-41f3-8efe-4fcb8d6d770e admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:43.577182 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1273/2545] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:29:43.581360 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862aaa4a-ed0b-423b-b216-9edc2a2eb0cb admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:43.591600 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862aaa4a-ed0b-423b-b216-9edc2a2eb0cb admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:43.596186 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d46569-2fc9-494c-8925-c8d83ceb7a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:43.596832 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d46569-2fc9-494c-8925-c8d83ceb7a1b admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:43.597110 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d46569-2fc9-494c-8925-c8d83ceb7a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:43.597385 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d46569-2fc9-494c-8925-c8d83ceb7a1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:43.598263 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d46569-2fc9-494c-8925-c8d83ceb7a1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:43.599842 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d46569-2fc9-494c-8925-c8d83ceb7a1b admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:43.610565 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1273/2546] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:29:43.614559 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb6711a-1820-41f3-8efe-4fcb8d6d770e admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:43.624107 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb6711a-1820-41f3-8efe-4fcb8d6d770e admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:43.628617 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c5cb3-76d4-49bb-bac5-97e4c7868856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:43.629485 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c5cb3-76d4-49bb-bac5-97e4c7868856 admin admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:43.629781 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c5cb3-76d4-49bb-bac5-97e4c7868856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:43.630052 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c5cb3-76d4-49bb-bac5-97e4c7868856 admin admin] PATH_INFO: `/v3/projects/1c1caaeedca04fbbbc9e2ce8448f63a5/users/5ae226cdb8694da0ab50d3c74fec344f/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:43.644251 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5c5cb3-76d4-49bb-bac5-97e4c7868856 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c1caaeedca04fbbbc9e2ce8448f63a5, user_id=5ae226cdb8694da0ab50d3c74fec344f, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:43.646925 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5c5cb3-76d4-49bb-bac5-97e4c7868856 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:43.659586 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1274/2547] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:29:43 2022] PUT /identity/v3/projects/1c1caaeedca04fbbbc9e2ce8448f63a5/users/5ae226cdb8694da0ab50d3c74fec344f/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:29:43.669995 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733cebe-31fc-4d8d-9b51-1e839744da3e None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:43.670223 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733cebe-31fc-4d8d-9b51-1e839744da3e None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:43.670501 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733cebe-31fc-4d8d-9b51-1e839744da3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:43.695724 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-f733cebe-31fc-4d8d-9b51-1e839744da3e None None] MFA Rules not processed for user `5ae226cdb8694da0ab50d3c74fec344f`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:29:43.696921 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-f733cebe-31fc-4d8d-9b51-1e839744da3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:29:43.758464 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1274/2548] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:29:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:29:43.763329 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c5cb3-76d4-49bb-bac5-97e4c7868856 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:43.820843 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c5cb3-76d4-49bb-bac5-97e4c7868856 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:43.825844 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1a1a2-f7c8-4821-8b0b-498d748b3e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:43.826484 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1a1a2-f7c8-4821-8b0b-498d748b3e3f admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:43.826759 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1a1a2-f7c8-4821-8b0b-498d748b3e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:43.827029 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1a1a2-f7c8-4821-8b0b-498d748b3e3f admin admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:43.827950 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd1a1a2-f7c8-4821-8b0b-498d748b3e3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:43.829860 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd1a1a2-f7c8-4821-8b0b-498d748b3e3f admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:43.857875 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1275/2549] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:29:43 2022] POST /identity/v3/projects => generated 377 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:29:43.861833 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733cebe-31fc-4d8d-9b51-1e839744da3e None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:43.872207 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733cebe-31fc-4d8d-9b51-1e839744da3e None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:43.932140 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7378e980-1834-415b-b15f-0b62dbf3d2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:43.932726 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7378e980-1834-415b-b15f-0b62dbf3d2e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:43.933004 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7378e980-1834-415b-b15f-0b62dbf3d2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:43.933273 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7378e980-1834-415b-b15f-0b62dbf3d2e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:43.933983 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7378e980-1834-415b-b15f-0b62dbf3d2e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:43.935872 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7378e980-1834-415b-b15f-0b62dbf3d2e1 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:43.955166 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1275/2550] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:29:43 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:29:43.959201 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1a1a2-f7c8-4821-8b0b-498d748b3e3f admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:43.969979 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1a1a2-f7c8-4821-8b0b-498d748b3e3f admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:43.974666 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5212aa3a-8b7b-4b1d-88af-6a15d782f13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:43.975301 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212aa3a-8b7b-4b1d-88af-6a15d782f13d admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:43.975574 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212aa3a-8b7b-4b1d-88af-6a15d782f13d admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:43.975843 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212aa3a-8b7b-4b1d-88af-6a15d782f13d admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:43.976561 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5212aa3a-8b7b-4b1d-88af-6a15d782f13d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:43.978215 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5212aa3a-8b7b-4b1d-88af-6a15d782f13d admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:43.988291 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1276/2551] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:29:43.992007 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7378e980-1834-415b-b15f-0b62dbf3d2e1 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:44.002325 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7378e980-1834-415b-b15f-0b62dbf3d2e1 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:44.006795 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca4192-52a3-4503-b738-08b8a3348c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:44.007430 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca4192-52a3-4503-b738-08b8a3348c6c admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:44.007706 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca4192-52a3-4503-b738-08b8a3348c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:44.007975 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca4192-52a3-4503-b738-08b8a3348c6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:44.008690 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ca4192-52a3-4503-b738-08b8a3348c6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:44.010367 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ca4192-52a3-4503-b738-08b8a3348c6c admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:44.020020 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1276/2552] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:29:44.023980 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5212aa3a-8b7b-4b1d-88af-6a15d782f13d admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:44.033895 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5212aa3a-8b7b-4b1d-88af-6a15d782f13d admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:44.038372 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f476037-8f60-453b-bbba-2dc691296727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:44.039243 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f476037-8f60-453b-bbba-2dc691296727 admin admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:44.039515 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f476037-8f60-453b-bbba-2dc691296727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:44.039779 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f476037-8f60-453b-bbba-2dc691296727 admin admin] PATH_INFO: `/v3/projects/36ee79bbb23246bf92cfe32577b6aa24/users/0d56e1ea40e64eae9d775756685bce45/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:44.054432 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f476037-8f60-453b-bbba-2dc691296727 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36ee79bbb23246bf92cfe32577b6aa24, user_id=0d56e1ea40e64eae9d775756685bce45, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:44.057081 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f476037-8f60-453b-bbba-2dc691296727 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:44.071099 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1277/2553] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:29:44 2022] PUT /identity/v3/projects/36ee79bbb23246bf92cfe32577b6aa24/users/0d56e1ea40e64eae9d775756685bce45/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:29:44.082240 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6686d15-38dd-41f9-b3db-4024cd00a102 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:44.082529 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6686d15-38dd-41f9-b3db-4024cd00a102 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:44.082799 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6686d15-38dd-41f9-b3db-4024cd00a102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:44.109905 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-a6686d15-38dd-41f9-b3db-4024cd00a102 None None] MFA Rules not processed for user `0d56e1ea40e64eae9d775756685bce45`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:29:44.111104 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-a6686d15-38dd-41f9-b3db-4024cd00a102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:29:44.172272 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1277/2554] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:29:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:29:44.176746 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f476037-8f60-453b-bbba-2dc691296727 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:44.239541 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f476037-8f60-453b-bbba-2dc691296727 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:44.244112 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb7dfd-710e-4c16-b3fb-73f0f01e9212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:44.244753 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb7dfd-710e-4c16-b3fb-73f0f01e9212 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:44.245029 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb7dfd-710e-4c16-b3fb-73f0f01e9212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:44.245302 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceb7dfd-710e-4c16-b3fb-73f0f01e9212 admin admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:44.246029 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceb7dfd-710e-4c16-b3fb-73f0f01e9212 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:44.247922 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceb7dfd-710e-4c16-b3fb-73f0f01e9212 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:44.272394 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1278/2555] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:29:44 2022] POST /identity/v3/projects => generated 375 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:29:44.276952 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6686d15-38dd-41f9-b3db-4024cd00a102 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:44.287207 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6686d15-38dd-41f9-b3db-4024cd00a102 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:44.340645 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d76aea6-3e7d-4e2c-ab37-7a077168d0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:44.341290 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76aea6-3e7d-4e2c-ab37-7a077168d0ca admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:44.341598 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76aea6-3e7d-4e2c-ab37-7a077168d0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:44.341906 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76aea6-3e7d-4e2c-ab37-7a077168d0ca admin admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:44.342584 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d76aea6-3e7d-4e2c-ab37-7a077168d0ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:44.344467 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d76aea6-3e7d-4e2c-ab37-7a077168d0ca admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:44.363343 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1278/2556] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:29:44 2022] POST /identity/v3/users => generated 294 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:29:44.367381 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb7dfd-710e-4c16-b3fb-73f0f01e9212 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:44.377406 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceb7dfd-710e-4c16-b3fb-73f0f01e9212 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:44.381889 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8912ee83-b07b-41a0-9e67-3fd74e2c851e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:44.382525 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912ee83-b07b-41a0-9e67-3fd74e2c851e admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:44.382797 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912ee83-b07b-41a0-9e67-3fd74e2c851e admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:44.383065 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8912ee83-b07b-41a0-9e67-3fd74e2c851e admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:44.383775 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8912ee83-b07b-41a0-9e67-3fd74e2c851e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:44.385885 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8912ee83-b07b-41a0-9e67-3fd74e2c851e admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:44.395913 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1279/2557] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:29:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:29:44.399737 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d76aea6-3e7d-4e2c-ab37-7a077168d0ca admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:44.409944 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d76aea6-3e7d-4e2c-ab37-7a077168d0ca admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:44.415052 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46954be-00da-4689-95c6-74087cbd1fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:44.415950 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46954be-00da-4689-95c6-74087cbd1fbd admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:44.416255 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46954be-00da-4689-95c6-74087cbd1fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:44.416529 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46954be-00da-4689-95c6-74087cbd1fbd admin admin] PATH_INFO: `/v3/projects/7b212121a16a49c09077fa727727aa26/users/54dbcc0b44d94180934d6df0a1c6033d/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:44.430596 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46954be-00da-4689-95c6-74087cbd1fbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b212121a16a49c09077fa727727aa26, user_id=54dbcc0b44d94180934d6df0a1c6033d, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:44.433206 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46954be-00da-4689-95c6-74087cbd1fbd admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:44.445207 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1279/2558] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:29:44 2022] PUT /identity/v3/projects/7b212121a16a49c09077fa727727aa26/users/54dbcc0b44d94180934d6df0a1c6033d/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:29:44.449777 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8912ee83-b07b-41a0-9e67-3fd74e2c851e admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:44.459777 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8912ee83-b07b-41a0-9e67-3fd74e2c851e admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:44.514303 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92537471-48b3-456d-93a6-643877fa18f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:44.514872 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92537471-48b3-456d-93a6-643877fa18f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:44.515149 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92537471-48b3-456d-93a6-643877fa18f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:44.515617 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92537471-48b3-456d-93a6-643877fa18f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:44.516135 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92537471-48b3-456d-93a6-643877fa18f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:44.517787 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92537471-48b3-456d-93a6-643877fa18f7 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:44.530084 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1280/2559] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:29:44 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:29:44.534019 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46954be-00da-4689-95c6-74087cbd1fbd admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:44.544163 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46954be-00da-4689-95c6-74087cbd1fbd admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:44.548679 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e620214-2551-4335-b225-693c31f51adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:44.549582 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e620214-2551-4335-b225-693c31f51adb admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:44.549859 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e620214-2551-4335-b225-693c31f51adb admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:44.550129 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e620214-2551-4335-b225-693c31f51adb admin admin] PATH_INFO: `/v3/projects/7b212121a16a49c09077fa727727aa26/users/54dbcc0b44d94180934d6df0a1c6033d/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:44.552075 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e620214-2551-4335-b225-693c31f51adb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b212121a16a49c09077fa727727aa26, user_id=54dbcc0b44d94180934d6df0a1c6033d, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:44.554748 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e620214-2551-4335-b225-693c31f51adb admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:44.565149 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1280/2560] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:29:44 2022] PUT /identity/v3/projects/7b212121a16a49c09077fa727727aa26/users/54dbcc0b44d94180934d6df0a1c6033d/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:29:44.575909 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7949acd4-0e2e-442f-b20b-99349751de24 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:44.576195 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7949acd4-0e2e-442f-b20b-99349751de24 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:44.576468 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7949acd4-0e2e-442f-b20b-99349751de24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:44.602412 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-7949acd4-0e2e-442f-b20b-99349751de24 None None] MFA Rules not processed for user `54dbcc0b44d94180934d6df0a1c6033d`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:29:44.603598 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-7949acd4-0e2e-442f-b20b-99349751de24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:29:44.668042 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1281/2561] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:29:44 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:29:44.679094 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e620214-2551-4335-b225-693c31f51adb admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:44.680754 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-1e620214-2551-4335-b225-693c31f51adb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:29:44.736564 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e620214-2551-4335-b225-693c31f51adb admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:44.740123 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b0e3cf-e6a5-4251-ae6e-703fbed98180 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:44.740747 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0e3cf-e6a5-4251-ae6e-703fbed98180 service cinder] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:44.741025 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0e3cf-e6a5-4251-ae6e-703fbed98180 service cinder] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:44.741298 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b0e3cf-e6a5-4251-ae6e-703fbed98180 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:44.794369 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b0e3cf-e6a5-4251-ae6e-703fbed98180 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:44.795713 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b0e3cf-e6a5-4251-ae6e-703fbed98180 service cinder] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:44.805020 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1281/2562] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:29:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:29:46.261511 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7949acd4-0e2e-442f-b20b-99349751de24 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:46.262886 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-7949acd4-0e2e-442f-b20b-99349751de24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:29:46.274372 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7949acd4-0e2e-442f-b20b-99349751de24 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:46.277859 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930b225-db68-43f5-881a-1d75dbd56515 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:46.278479 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930b225-db68-43f5-881a-1d75dbd56515 service cinder] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:46.278755 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930b225-db68-43f5-881a-1d75dbd56515 service cinder] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:46.279026 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930b225-db68-43f5-881a-1d75dbd56515 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:46.333394 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930b225-db68-43f5-881a-1d75dbd56515 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:46.334827 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930b225-db68-43f5-881a-1d75dbd56515 service cinder] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:46.343512 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1282/2563] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:29:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:29:46.836203 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b0e3cf-e6a5-4251-ae6e-703fbed98180 service cinder] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:46.844719 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b0e3cf-e6a5-4251-ae6e-703fbed98180 service cinder] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:46.848273 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704e592b-3498-40b6-88ce-e14666e963a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:46.848898 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e592b-3498-40b6-88ce-e14666e963a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:46.849178 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e592b-3498-40b6-88ce-e14666e963a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:46.849451 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704e592b-3498-40b6-88ce-e14666e963a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:46.858861 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704e592b-3498-40b6-88ce-e14666e963a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:46.860225 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704e592b-3498-40b6-88ce-e14666e963a6 service cinder] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:46.869426 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1282/2564] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:29:46 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:29:50.683003 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930b225-db68-43f5-881a-1d75dbd56515 service cinder] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:50.742478 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930b225-db68-43f5-881a-1d75dbd56515 service cinder] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:50.747522 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cc30ac-0778-4f85-9fe4-a9a5a3973884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:50.748376 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc30ac-0778-4f85-9fe4-a9a5a3973884 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:50.748650 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc30ac-0778-4f85-9fe4-a9a5a3973884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:50.748950 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc30ac-0778-4f85-9fe4-a9a5a3973884 admin admin] PATH_INFO: `/v3/users/5ae226cdb8694da0ab50d3c74fec344f` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:50.750125 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cc30ac-0778-4f85-9fe4-a9a5a3973884 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ae226cdb8694da0ab50d3c74fec344f)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:50.752031 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cc30ac-0778-4f85-9fe4-a9a5a3973884 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:50.798934 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-08cc30ac-0778-4f85-9fe4-a9a5a3973884 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ae226cdb8694da0ab50d3c74fec344f'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:50.811366 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-08cc30ac-0778-4f85-9fe4-a9a5a3973884 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ae226cdb8694da0ab50d3c74fec344f'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:50.812042 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-08cc30ac-0778-4f85-9fe4-a9a5a3973884 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ae226cdb8694da0ab50d3c74fec344f'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:50.813130 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-08cc30ac-0778-4f85-9fe4-a9a5a3973884 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ae226cdb8694da0ab50d3c74fec344f'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:50.819880 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-08cc30ac-0778-4f85-9fe4-a9a5a3973884 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ae226cdb8694da0ab50d3c74fec344f'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:50.835950 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1283/2565] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:29:50 2022] DELETE /identity/v3/users/5ae226cdb8694da0ab50d3c74fec344f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:29:50.837660 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac21df-7c27-4c32-8878-39fddc92fcaa None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:50.838480 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac21df-7c27-4c32-8878-39fddc92fcaa None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:50.838753 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac21df-7c27-4c32-8878-39fddc92fcaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:50.855935 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-64ac21df-7c27-4c32-8878-39fddc92fcaa None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:29:50.857251 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-64ac21df-7c27-4c32-8878-39fddc92fcaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:29:50.916152 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1283/2566] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:29:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:29:50.926831 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cc30ac-0778-4f85-9fe4-a9a5a3973884 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:50.928221 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-08cc30ac-0778-4f85-9fe4-a9a5a3973884 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:29:50.987949 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cc30ac-0778-4f85-9fe4-a9a5a3973884 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:50.991595 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c10cb-a2b2-4054-8c87-84fe22176352 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:50.992230 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c10cb-a2b2-4054-8c87-84fe22176352 service neutron] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:50.992513 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c10cb-a2b2-4054-8c87-84fe22176352 service neutron] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:50.992787 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c10cb-a2b2-4054-8c87-84fe22176352 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:51.001837 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c10cb-a2b2-4054-8c87-84fe22176352 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:51.003264 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7c10cb-a2b2-4054-8c87-84fe22176352 service neutron] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:51.012481 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1284/2567] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:29:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:29:51.270005 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac21df-7c27-4c32-8878-39fddc92fcaa None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:51.271541 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-64ac21df-7c27-4c32-8878-39fddc92fcaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:29:51.284607 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac21df-7c27-4c32-8878-39fddc92fcaa None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:51.289217 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af0989c-7440-4db7-80aa-bbd095c300b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:51.290171 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0989c-7440-4db7-80aa-bbd095c300b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:51.290446 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0989c-7440-4db7-80aa-bbd095c300b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:51.290718 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0989c-7440-4db7-80aa-bbd095c300b4 admin admin] PATH_INFO: `/v3/projects/1c1caaeedca04fbbbc9e2ce8448f63a5` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:51.292601 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af0989c-7440-4db7-80aa-bbd095c300b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c1caaeedca04fbbbc9e2ce8448f63a5)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:51.294545 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af0989c-7440-4db7-80aa-bbd095c300b4 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:51.341570 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-8af0989c-7440-4db7-80aa-bbd095c300b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c1caaeedca04fbbbc9e2ce8448f63a5', 'request_id': 'req-8af0989c-7440-4db7-80aa-bbd095c300b4'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:51.347456 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-8af0989c-7440-4db7-80aa-bbd095c300b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c1caaeedca04fbbbc9e2ce8448f63a5', 'request_id': 'req-8af0989c-7440-4db7-80aa-bbd095c300b4'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:51.355413 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-8af0989c-7440-4db7-80aa-bbd095c300b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c1caaeedca04fbbbc9e2ce8448f63a5', 'request_id': 'req-8af0989c-7440-4db7-80aa-bbd095c300b4'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:51.365213 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-8af0989c-7440-4db7-80aa-bbd095c300b4 admin admin] The token cache is being invalidate because project 1c1caaeedca04fbbbc9e2ce8448f63a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:29:51.365528 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-8af0989c-7440-4db7-80aa-bbd095c300b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:51.366149 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-8af0989c-7440-4db7-80aa-bbd095c300b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:51.367674 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1284/2568] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:29:51 2022] DELETE /identity/v3/projects/1c1caaeedca04fbbbc9e2ce8448f63a5 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:29:51.371835 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c10cb-a2b2-4054-8c87-84fe22176352 service neutron] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:51.381127 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7c10cb-a2b2-4054-8c87-84fe22176352 service neutron] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:51.434913 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e291e-5ab9-4ecc-b28e-540c09aa8380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:51.435761 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e291e-5ab9-4ecc-b28e-540c09aa8380 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:51.436039 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e291e-5ab9-4ecc-b28e-540c09aa8380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:51.436309 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e291e-5ab9-4ecc-b28e-540c09aa8380 admin admin] PATH_INFO: `/v3/users/0d56e1ea40e64eae9d775756685bce45` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:51.437501 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763e291e-5ab9-4ecc-b28e-540c09aa8380 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d56e1ea40e64eae9d775756685bce45)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:51.439415 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763e291e-5ab9-4ecc-b28e-540c09aa8380 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:51.485132 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-763e291e-5ab9-4ecc-b28e-540c09aa8380 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d56e1ea40e64eae9d775756685bce45'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:51.496818 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-763e291e-5ab9-4ecc-b28e-540c09aa8380 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d56e1ea40e64eae9d775756685bce45'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:51.497490 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-763e291e-5ab9-4ecc-b28e-540c09aa8380 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d56e1ea40e64eae9d775756685bce45'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:51.498093 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-763e291e-5ab9-4ecc-b28e-540c09aa8380 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d56e1ea40e64eae9d775756685bce45'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:51.504631 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-763e291e-5ab9-4ecc-b28e-540c09aa8380 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d56e1ea40e64eae9d775756685bce45'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:51.517719 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1285/2569] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:29:51 2022] DELETE /identity/v3/users/0d56e1ea40e64eae9d775756685bce45 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:29:51.777167 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af0989c-7440-4db7-80aa-bbd095c300b4 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:51.778619 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-8af0989c-7440-4db7-80aa-bbd095c300b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:29:51.791465 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af0989c-7440-4db7-80aa-bbd095c300b4 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:51.863094 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6480ca60-e3fb-498c-a573-2f5614755646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:51.863955 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6480ca60-e3fb-498c-a573-2f5614755646 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:51.864230 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6480ca60-e3fb-498c-a573-2f5614755646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:51.864498 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6480ca60-e3fb-498c-a573-2f5614755646 admin admin] PATH_INFO: `/v3/projects/36ee79bbb23246bf92cfe32577b6aa24` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:51.865695 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6480ca60-e3fb-498c-a573-2f5614755646 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36ee79bbb23246bf92cfe32577b6aa24)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:51.867630 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6480ca60-e3fb-498c-a573-2f5614755646 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:51.912158 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-6480ca60-e3fb-498c-a573-2f5614755646 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36ee79bbb23246bf92cfe32577b6aa24', 'request_id': 'req-6480ca60-e3fb-498c-a573-2f5614755646'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:51.918766 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-6480ca60-e3fb-498c-a573-2f5614755646 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36ee79bbb23246bf92cfe32577b6aa24', 'request_id': 'req-6480ca60-e3fb-498c-a573-2f5614755646'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:51.925499 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-6480ca60-e3fb-498c-a573-2f5614755646 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36ee79bbb23246bf92cfe32577b6aa24', 'request_id': 'req-6480ca60-e3fb-498c-a573-2f5614755646'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:51.936707 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-6480ca60-e3fb-498c-a573-2f5614755646 admin admin] The token cache is being invalidate because project 36ee79bbb23246bf92cfe32577b6aa24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:29:51.936988 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-6480ca60-e3fb-498c-a573-2f5614755646 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:51.937623 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-6480ca60-e3fb-498c-a573-2f5614755646 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:51.939173 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1285/2570] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:29:51 2022] DELETE /identity/v3/projects/36ee79bbb23246bf92cfe32577b6aa24 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:29:51.943220 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e291e-5ab9-4ecc-b28e-540c09aa8380 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:51.944607 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-763e291e-5ab9-4ecc-b28e-540c09aa8380 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:29:51.957452 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e291e-5ab9-4ecc-b28e-540c09aa8380 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:52.010846 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c015249-7955-4558-b71a-9b77bf424980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:52.011695 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c015249-7955-4558-b71a-9b77bf424980 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:52.011972 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c015249-7955-4558-b71a-9b77bf424980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:52.012241 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c015249-7955-4558-b71a-9b77bf424980 admin admin] PATH_INFO: `/v3/users/54dbcc0b44d94180934d6df0a1c6033d` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:52.013402 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c015249-7955-4558-b71a-9b77bf424980 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54dbcc0b44d94180934d6df0a1c6033d)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:52.015368 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c015249-7955-4558-b71a-9b77bf424980 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:52.058522 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-1c015249-7955-4558-b71a-9b77bf424980 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54dbcc0b44d94180934d6df0a1c6033d'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:52.069496 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-1c015249-7955-4558-b71a-9b77bf424980 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54dbcc0b44d94180934d6df0a1c6033d'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:52.070137 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-1c015249-7955-4558-b71a-9b77bf424980 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54dbcc0b44d94180934d6df0a1c6033d'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:52.070726 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-1c015249-7955-4558-b71a-9b77bf424980 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54dbcc0b44d94180934d6df0a1c6033d'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:52.077993 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-1c015249-7955-4558-b71a-9b77bf424980 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54dbcc0b44d94180934d6df0a1c6033d'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:52.089978 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1286/2571] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:29:51 2022] DELETE /identity/v3/users/54dbcc0b44d94180934d6df0a1c6033d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:29:52.401307 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6480ca60-e3fb-498c-a573-2f5614755646 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:52.402749 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-6480ca60-e3fb-498c-a573-2f5614755646 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:29:52.415407 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6480ca60-e3fb-498c-a573-2f5614755646 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:52.471217 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61561a11-796f-4654-9595-704cdb579d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:52.472059 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61561a11-796f-4654-9595-704cdb579d22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:52.472334 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61561a11-796f-4654-9595-704cdb579d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:52.472604 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61561a11-796f-4654-9595-704cdb579d22 admin admin] PATH_INFO: `/v3/projects/7b212121a16a49c09077fa727727aa26` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:52.473901 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61561a11-796f-4654-9595-704cdb579d22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b212121a16a49c09077fa727727aa26)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:52.475781 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61561a11-796f-4654-9595-704cdb579d22 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:52.521168 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-61561a11-796f-4654-9595-704cdb579d22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b212121a16a49c09077fa727727aa26', 'request_id': 'req-61561a11-796f-4654-9595-704cdb579d22'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:52.527483 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-61561a11-796f-4654-9595-704cdb579d22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b212121a16a49c09077fa727727aa26', 'request_id': 'req-61561a11-796f-4654-9595-704cdb579d22'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:52.533817 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-61561a11-796f-4654-9595-704cdb579d22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b212121a16a49c09077fa727727aa26', 'request_id': 'req-61561a11-796f-4654-9595-704cdb579d22'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:52.543609 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-61561a11-796f-4654-9595-704cdb579d22 admin admin] The token cache is being invalidate because project 7b212121a16a49c09077fa727727aa26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:29:52.543894 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-61561a11-796f-4654-9595-704cdb579d22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:52.544506 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-61561a11-796f-4654-9595-704cdb579d22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:52.546081 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1286/2572] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:29:52 2022] DELETE /identity/v3/projects/7b212121a16a49c09077fa727727aa26 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:29:52.551025 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ef7cc-1de3-4f8c-addf-e0bc3824d733 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:52.551310 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ef7cc-1de3-4f8c-addf-e0bc3824d733 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:52.551585 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ef7cc-1de3-4f8c-addf-e0bc3824d733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:52.569773 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-505ef7cc-1de3-4f8c-addf-e0bc3824d733 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:29:52.570886 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-505ef7cc-1de3-4f8c-addf-e0bc3824d733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:29:52.627556 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1287/2573] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:29:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:29:52.635356 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5979fdf-72d1-4445-ac0e-5962d8aca03f None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:52.635644 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5979fdf-72d1-4445-ac0e-5962d8aca03f None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:52.635961 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5979fdf-72d1-4445-ac0e-5962d8aca03f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:52.653708 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-d5979fdf-72d1-4445-ac0e-5962d8aca03f None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:29:52.654886 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-d5979fdf-72d1-4445-ac0e-5962d8aca03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:29:52.662528 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1287/2574] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:29:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:29:52.666505 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ef7cc-1de3-4f8c-addf-e0bc3824d733 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:52.676579 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ef7cc-1de3-4f8c-addf-e0bc3824d733 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:52.681094 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec1d982-ccc6-4bc0-be14-9bc4c94836f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:52.681777 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec1d982-ccc6-4bc0-be14-9bc4c94836f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:52.682059 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec1d982-ccc6-4bc0-be14-9bc4c94836f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:52.682334 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec1d982-ccc6-4bc0-be14-9bc4c94836f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:52.683663 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec1d982-ccc6-4bc0-be14-9bc4c94836f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:29:52.683964 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec1d982-ccc6-4bc0-be14-9bc4c94836f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:52.685585 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec1d982-ccc6-4bc0-be14-9bc4c94836f7 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:52.696988 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1288/2575] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 17 18:29:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:29:52.701234 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5979fdf-72d1-4445-ac0e-5962d8aca03f None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:52.710490 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5979fdf-72d1-4445-ac0e-5962d8aca03f None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:52.715047 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f280c00-1f06-40cc-b874-26b9d8fbf521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:52.715681 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f280c00-1f06-40cc-b874-26b9d8fbf521 admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:52.715958 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f280c00-1f06-40cc-b874-26b9d8fbf521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:52.716231 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f280c00-1f06-40cc-b874-26b9d8fbf521 admin admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:52.716911 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f280c00-1f06-40cc-b874-26b9d8fbf521 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:52.718822 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f280c00-1f06-40cc-b874-26b9d8fbf521 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:52.743260 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1288/2576] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:29:52 2022] POST /identity/v3/projects => generated 391 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:29:52.747929 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec1d982-ccc6-4bc0-be14-9bc4c94836f7 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:52.757680 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec1d982-ccc6-4bc0-be14-9bc4c94836f7 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:52.810914 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c6a74e-56ef-468d-b31a-37c756e61c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:52.811570 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6a74e-56ef-468d-b31a-37c756e61c16 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:52.811851 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6a74e-56ef-468d-b31a-37c756e61c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:52.812125 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6a74e-56ef-468d-b31a-37c756e61c16 admin admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:52.812830 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c6a74e-56ef-468d-b31a-37c756e61c16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:52.814906 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c6a74e-56ef-468d-b31a-37c756e61c16 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:52.834982 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1289/2577] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:29:52 2022] POST /identity/v3/users => generated 296 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:29:52.838296 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f280c00-1f06-40cc-b874-26b9d8fbf521 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:52.848316 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f280c00-1f06-40cc-b874-26b9d8fbf521 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:52.852857 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f822cada-36aa-4679-abec-cafd7886f730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:52.853523 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f822cada-36aa-4679-abec-cafd7886f730 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:52.853803 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f822cada-36aa-4679-abec-cafd7886f730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:52.854077 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f822cada-36aa-4679-abec-cafd7886f730 admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:52.855314 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f822cada-36aa-4679-abec-cafd7886f730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:52.856899 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f822cada-36aa-4679-abec-cafd7886f730 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:52.867475 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1289/2578] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:29:52.872146 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c6a74e-56ef-468d-b31a-37c756e61c16 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:52.881730 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c6a74e-56ef-468d-b31a-37c756e61c16 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:52.886229 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b437fa84-17cf-4592-8677-8bdf11720f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:52.886863 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437fa84-17cf-4592-8677-8bdf11720f64 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:52.887139 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437fa84-17cf-4592-8677-8bdf11720f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:52.887407 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437fa84-17cf-4592-8677-8bdf11720f64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:52.888118 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b437fa84-17cf-4592-8677-8bdf11720f64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:52.889723 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b437fa84-17cf-4592-8677-8bdf11720f64 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:52.899795 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1290/2579] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:29:52.903615 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f822cada-36aa-4679-abec-cafd7886f730 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:52.913276 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f822cada-36aa-4679-abec-cafd7886f730 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:52.918488 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749463c4-363d-4e1d-b368-edc34428afd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:52.919346 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749463c4-363d-4e1d-b368-edc34428afd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:52.919620 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749463c4-363d-4e1d-b368-edc34428afd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:52.919887 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749463c4-363d-4e1d-b368-edc34428afd3 admin admin] PATH_INFO: `/v3/projects/28195ceb06a049e8805f2a92ad831b7e/users/9e1309cb9bfa4cca93bd800d380373e4/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:52.934905 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749463c4-363d-4e1d-b368-edc34428afd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28195ceb06a049e8805f2a92ad831b7e, user_id=9e1309cb9bfa4cca93bd800d380373e4, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:52.937525 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749463c4-363d-4e1d-b368-edc34428afd3 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:52.949898 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1290/2580] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:29:52 2022] PUT /identity/v3/projects/28195ceb06a049e8805f2a92ad831b7e/users/9e1309cb9bfa4cca93bd800d380373e4/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:29:53.013003 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e38ec7-8d44-4fef-ac22-ed622c0ad527 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:53.013611 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e38ec7-8d44-4fef-ac22-ed622c0ad527 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:53.013611 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e38ec7-8d44-4fef-ac22-ed622c0ad527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:53.040846 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-50e38ec7-8d44-4fef-ac22-ed622c0ad527 None None] MFA Rules not processed for user `9e1309cb9bfa4cca93bd800d380373e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:29:53.042710 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-50e38ec7-8d44-4fef-ac22-ed622c0ad527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:29:53.104303 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1291/2581] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:29:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:29:53.115378 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749463c4-363d-4e1d-b368-edc34428afd3 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:53.117073 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-749463c4-363d-4e1d-b368-edc34428afd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:29:53.172109 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749463c4-363d-4e1d-b368-edc34428afd3 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:53.175686 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b5932-13bc-4059-a657-63db07824603 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:53.176319 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b5932-13bc-4059-a657-63db07824603 service cinder] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:53.176595 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b5932-13bc-4059-a657-63db07824603 service cinder] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:53.176866 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b5932-13bc-4059-a657-63db07824603 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:53.186690 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5b5932-13bc-4059-a657-63db07824603 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:53.188035 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5b5932-13bc-4059-a657-63db07824603 service cinder] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:53.197162 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1291/2582] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:29:53 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:29:54.099270 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e38ec7-8d44-4fef-ac22-ed622c0ad527 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:54.103838 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-50e38ec7-8d44-4fef-ac22-ed622c0ad527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:29:54.188935 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e38ec7-8d44-4fef-ac22-ed622c0ad527 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:54.194796 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f2d6bb-c6df-4224-b58f-a18902bd3321 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b430b739cb54fc7911bc89f8ea2df72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:54.195620 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2d6bb-c6df-4224-b58f-a18902bd3321 service nova] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:54.195904 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2d6bb-c6df-4224-b58f-a18902bd3321 service nova] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:54.196178 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2d6bb-c6df-4224-b58f-a18902bd3321 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:54.198961 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-80f2d6bb-c6df-4224-b58f-a18902bd3321 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:29:54.212367 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f2d6bb-c6df-4224-b58f-a18902bd3321 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:54.214719 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f2d6bb-c6df-4224-b58f-a18902bd3321 service nova] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:54.226927 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1292/2583] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:29:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:30:07.287682 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b5932-13bc-4059-a657-63db07824603 service cinder] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:07.289092 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-7f5b5932-13bc-4059-a657-63db07824603 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:07.356502 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b5932-13bc-4059-a657-63db07824603 service cinder] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:07.360393 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ae8bd6-e314-4d57-8319-acb88cda0fb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:07.361144 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ae8bd6-e314-4d57-8319-acb88cda0fb2 service neutron] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:07.361313 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ae8bd6-e314-4d57-8319-acb88cda0fb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:07.361615 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ae8bd6-e314-4d57-8319-acb88cda0fb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:07.363392 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-55ae8bd6-e314-4d57-8319-acb88cda0fb2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:07.430862 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ae8bd6-e314-4d57-8319-acb88cda0fb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:07.432327 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ae8bd6-e314-4d57-8319-acb88cda0fb2 service neutron] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:07.442232 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1292/2584] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:30:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:30:10.524494 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f2d6bb-c6df-4224-b58f-a18902bd3321 service nova] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:10.528537 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-80f2d6bb-c6df-4224-b58f-a18902bd3321 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:10.545193 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f2d6bb-c6df-4224-b58f-a18902bd3321 service nova] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:10.549676 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce670869-8ac8-428b-ac05-96e7e479396f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:10.550521 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce670869-8ac8-428b-ac05-96e7e479396f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:10.550795 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce670869-8ac8-428b-ac05-96e7e479396f admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:10.551064 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce670869-8ac8-428b-ac05-96e7e479396f admin admin] PATH_INFO: `/v3/users/13b4ec46d3cb49faba3f063dcfd644c3` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:10.552232 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce670869-8ac8-428b-ac05-96e7e479396f admin admin] RBAC: Authorizing `identity:delete_user(user_id=13b4ec46d3cb49faba3f063dcfd644c3)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:10.554173 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce670869-8ac8-428b-ac05-96e7e479396f admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:10.598400 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-ce670869-8ac8-428b-ac05-96e7e479396f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13b4ec46d3cb49faba3f063dcfd644c3'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:10.610042 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-ce670869-8ac8-428b-ac05-96e7e479396f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13b4ec46d3cb49faba3f063dcfd644c3'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:10.610694 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-ce670869-8ac8-428b-ac05-96e7e479396f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13b4ec46d3cb49faba3f063dcfd644c3'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:10.611294 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-ce670869-8ac8-428b-ac05-96e7e479396f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13b4ec46d3cb49faba3f063dcfd644c3'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:10.617852 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-ce670869-8ac8-428b-ac05-96e7e479396f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13b4ec46d3cb49faba3f063dcfd644c3'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:10.630026 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1293/2585] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:30:10 2022] DELETE /identity/v3/users/13b4ec46d3cb49faba3f063dcfd644c3 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:30:10.798806 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ae8bd6-e314-4d57-8319-acb88cda0fb2 service neutron] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:10.810407 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ae8bd6-e314-4d57-8319-acb88cda0fb2 service neutron] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:10.872978 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bc6de8-b2ff-45a9-89bf-2c7c243bd220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:10.873974 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc6de8-b2ff-45a9-89bf-2c7c243bd220 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:10.874260 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc6de8-b2ff-45a9-89bf-2c7c243bd220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:10.874530 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bc6de8-b2ff-45a9-89bf-2c7c243bd220 admin admin] PATH_INFO: `/v3/projects/37a912f3b6fa407bb4495fb6462250e8` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:10.875727 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bc6de8-b2ff-45a9-89bf-2c7c243bd220 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37a912f3b6fa407bb4495fb6462250e8)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:10.877655 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bc6de8-b2ff-45a9-89bf-2c7c243bd220 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:10.925052 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-56bc6de8-b2ff-45a9-89bf-2c7c243bd220 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37a912f3b6fa407bb4495fb6462250e8', 'request_id': 'req-56bc6de8-b2ff-45a9-89bf-2c7c243bd220'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:10.930974 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-56bc6de8-b2ff-45a9-89bf-2c7c243bd220 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37a912f3b6fa407bb4495fb6462250e8', 'request_id': 'req-56bc6de8-b2ff-45a9-89bf-2c7c243bd220'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:10.938104 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-56bc6de8-b2ff-45a9-89bf-2c7c243bd220 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37a912f3b6fa407bb4495fb6462250e8', 'request_id': 'req-56bc6de8-b2ff-45a9-89bf-2c7c243bd220'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:10.949005 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-56bc6de8-b2ff-45a9-89bf-2c7c243bd220 admin admin] The token cache is being invalidate because project 37a912f3b6fa407bb4495fb6462250e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:30:10.949290 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-56bc6de8-b2ff-45a9-89bf-2c7c243bd220 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:10.950006 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-56bc6de8-b2ff-45a9-89bf-2c7c243bd220 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:10.951585 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1293/2586] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:30:10 2022] DELETE /identity/v3/projects/37a912f3b6fa407bb4495fb6462250e8 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:30:10.956696 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52811252-1fc1-46ae-8c02-53c218e3e466 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:10.957022 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52811252-1fc1-46ae-8c02-53c218e3e466 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:10.957336 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52811252-1fc1-46ae-8c02-53c218e3e466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:10.976923 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-52811252-1fc1-46ae-8c02-53c218e3e466 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:30:10.978060 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-52811252-1fc1-46ae-8c02-53c218e3e466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:11.034807 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1294/2587] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:30:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:30:11.042672 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a567a-a189-41b8-ae77-1652fcfd5139 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:11.042960 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a567a-a189-41b8-ae77-1652fcfd5139 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:11.043238 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a567a-a189-41b8-ae77-1652fcfd5139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:11.061355 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-f12a567a-a189-41b8-ae77-1652fcfd5139 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:30:11.062592 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-f12a567a-a189-41b8-ae77-1652fcfd5139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:11.070369 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1294/2588] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:30:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:30:11.075311 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52811252-1fc1-46ae-8c02-53c218e3e466 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:11.084793 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52811252-1fc1-46ae-8c02-53c218e3e466 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:11.089262 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd91be-3f5f-4b0f-83d6-89e4aa6725c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:11.089933 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd91be-3f5f-4b0f-83d6-89e4aa6725c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:11.090212 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd91be-3f5f-4b0f-83d6-89e4aa6725c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:11.090483 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd91be-3f5f-4b0f-83d6-89e4aa6725c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:11.091199 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd91be-3f5f-4b0f-83d6-89e4aa6725c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:30:11.091502 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd91be-3f5f-4b0f-83d6-89e4aa6725c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:11.093079 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd91be-3f5f-4b0f-83d6-89e4aa6725c7 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:11.104158 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1295/2589] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 17 18:30:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:30:11.108400 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a567a-a189-41b8-ae77-1652fcfd5139 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:11.117566 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a567a-a189-41b8-ae77-1652fcfd5139 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:11.122711 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b295c4a-d5c3-4707-95a5-75ed1c883135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:11.123349 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b295c4a-d5c3-4707-95a5-75ed1c883135 admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:11.123628 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b295c4a-d5c3-4707-95a5-75ed1c883135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:11.123902 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b295c4a-d5c3-4707-95a5-75ed1c883135 admin admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:11.124588 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b295c4a-d5c3-4707-95a5-75ed1c883135 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:11.126513 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b295c4a-d5c3-4707-95a5-75ed1c883135 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:11.151524 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1295/2590] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:30:11 2022] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:30:11.155599 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd91be-3f5f-4b0f-83d6-89e4aa6725c7 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:11.165055 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd91be-3f5f-4b0f-83d6-89e4aa6725c7 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:11.218458 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ccc08-6b4e-4d77-88f0-a09242c39e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:11.219117 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ccc08-6b4e-4d77-88f0-a09242c39e73 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:11.219396 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ccc08-6b4e-4d77-88f0-a09242c39e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:11.219669 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20ccc08-6b4e-4d77-88f0-a09242c39e73 admin admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:11.220401 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20ccc08-6b4e-4d77-88f0-a09242c39e73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:11.222385 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20ccc08-6b4e-4d77-88f0-a09242c39e73 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:11.241235 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1296/2591] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:30:11 2022] POST /identity/v3/users => generated 286 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:30:11.245787 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b295c4a-d5c3-4707-95a5-75ed1c883135 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:11.255749 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b295c4a-d5c3-4707-95a5-75ed1c883135 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:11.260945 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5b32fd-3d6d-4d0c-8aff-6a57fcb17c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:11.261615 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b32fd-3d6d-4d0c-8aff-6a57fcb17c3b admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:11.261891 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b32fd-3d6d-4d0c-8aff-6a57fcb17c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:11.262160 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b32fd-3d6d-4d0c-8aff-6a57fcb17c3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:11.262876 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5b32fd-3d6d-4d0c-8aff-6a57fcb17c3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:11.264450 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5b32fd-3d6d-4d0c-8aff-6a57fcb17c3b admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:11.274615 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1296/2592] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:30:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:30:11.278409 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ccc08-6b4e-4d77-88f0-a09242c39e73 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:11.288087 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20ccc08-6b4e-4d77-88f0-a09242c39e73 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:11.292618 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e7631f-e54a-4f50-a3be-1f3d09c3a969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:11.293253 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e7631f-e54a-4f50-a3be-1f3d09c3a969 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:11.293569 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e7631f-e54a-4f50-a3be-1f3d09c3a969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:11.293844 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e7631f-e54a-4f50-a3be-1f3d09c3a969 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:11.294551 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e7631f-e54a-4f50-a3be-1f3d09c3a969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:11.296133 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e7631f-e54a-4f50-a3be-1f3d09c3a969 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:11.305672 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1297/2593] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:30:11 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:30:11.309952 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5b32fd-3d6d-4d0c-8aff-6a57fcb17c3b admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:11.319696 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5b32fd-3d6d-4d0c-8aff-6a57fcb17c3b admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:11.325451 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a66a1f-655d-4e19-9bb0-fd355f2640ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:11.326333 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a66a1f-655d-4e19-9bb0-fd355f2640ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:11.326604 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a66a1f-655d-4e19-9bb0-fd355f2640ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:11.326878 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a66a1f-655d-4e19-9bb0-fd355f2640ff admin admin] PATH_INFO: `/v3/projects/c66a04a7b6814162bc8a7cc6381a9067/users/94f3d33cb141425d959a09201b9b9ca9/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:11.341308 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a66a1f-655d-4e19-9bb0-fd355f2640ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=c66a04a7b6814162bc8a7cc6381a9067, user_id=94f3d33cb141425d959a09201b9b9ca9, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:11.343988 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a66a1f-655d-4e19-9bb0-fd355f2640ff admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:11.356977 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1297/2594] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:30:11 2022] PUT /identity/v3/projects/c66a04a7b6814162bc8a7cc6381a9067/users/94f3d33cb141425d959a09201b9b9ca9/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:30:11.366968 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4693f-c24a-4612-a384-f3df63b8fbe2 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:11.367258 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4693f-c24a-4612-a384-f3df63b8fbe2 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:11.367537 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4693f-c24a-4612-a384-f3df63b8fbe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:11.393712 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-fef4693f-c24a-4612-a384-f3df63b8fbe2 None None] MFA Rules not processed for user `94f3d33cb141425d959a09201b9b9ca9`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:30:11.394887 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-fef4693f-c24a-4612-a384-f3df63b8fbe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:11.456888 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1298/2595] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:30:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:30:11.467733 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a66a1f-655d-4e19-9bb0-fd355f2640ff admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:11.469413 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-36a66a1f-655d-4e19-9bb0-fd355f2640ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:11.540016 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a66a1f-655d-4e19-9bb0-fd355f2640ff admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:11.546064 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b3169-a70d-40f3-a8f1-15075d808284 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b430b739cb54fc7911bc89f8ea2df72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:11.546706 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b3169-a70d-40f3-a8f1-15075d808284 service nova] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:11.546984 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b3169-a70d-40f3-a8f1-15075d808284 service nova] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:11.547258 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b3169-a70d-40f3-a8f1-15075d808284 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:11.555095 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b3169-a70d-40f3-a8f1-15075d808284 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:11.556666 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b3169-a70d-40f3-a8f1-15075d808284 service nova] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:11.565996 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1298/2596] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:30:11 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:30:14.411036 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4693f-c24a-4612-a384-f3df63b8fbe2 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:14.468578 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4693f-c24a-4612-a384-f3df63b8fbe2 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:14.473240 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1925a504-20b2-4d06-839a-c555dc80b50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:14.474131 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925a504-20b2-4d06-839a-c555dc80b50a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:14.474443 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925a504-20b2-4d06-839a-c555dc80b50a admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:14.474744 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925a504-20b2-4d06-839a-c555dc80b50a admin admin] PATH_INFO: `/v3/users/94f3d33cb141425d959a09201b9b9ca9` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:14.475937 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1925a504-20b2-4d06-839a-c555dc80b50a admin admin] RBAC: Authorizing `identity:delete_user(user_id=94f3d33cb141425d959a09201b9b9ca9)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:14.478074 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1925a504-20b2-4d06-839a-c555dc80b50a admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:14.524398 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-1925a504-20b2-4d06-839a-c555dc80b50a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94f3d33cb141425d959a09201b9b9ca9'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:14.537057 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-1925a504-20b2-4d06-839a-c555dc80b50a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94f3d33cb141425d959a09201b9b9ca9'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:14.537912 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-1925a504-20b2-4d06-839a-c555dc80b50a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94f3d33cb141425d959a09201b9b9ca9'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:14.538682 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-1925a504-20b2-4d06-839a-c555dc80b50a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94f3d33cb141425d959a09201b9b9ca9'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:14.546239 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-1925a504-20b2-4d06-839a-c555dc80b50a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94f3d33cb141425d959a09201b9b9ca9'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:14.558535 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1299/2597] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:30:14 2022] DELETE /identity/v3/users/94f3d33cb141425d959a09201b9b9ca9 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:30:14.563633 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c5d46-08ab-4bf6-82ee-80a759541928 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:14.564116 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c5d46-08ab-4bf6-82ee-80a759541928 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:14.564212 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c5d46-08ab-4bf6-82ee-80a759541928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:14.580946 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-6f7c5d46-08ab-4bf6-82ee-80a759541928 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:30:14.582180 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-6f7c5d46-08ab-4bf6-82ee-80a759541928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:14.643454 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1299/2598] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:30:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:30:14.653398 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1925a504-20b2-4d06-839a-c555dc80b50a admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:14.655343 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-1925a504-20b2-4d06-839a-c555dc80b50a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:14.710253 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1925a504-20b2-4d06-839a-c555dc80b50a admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:14.713983 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b9880-3208-4393-b5f6-ed0f9676b01d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:14.714636 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b9880-3208-4393-b5f6-ed0f9676b01d service neutron] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:14.714913 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b9880-3208-4393-b5f6-ed0f9676b01d service neutron] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:14.715195 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b9880-3208-4393-b5f6-ed0f9676b01d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:14.724364 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b9880-3208-4393-b5f6-ed0f9676b01d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:14.725827 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b9880-3208-4393-b5f6-ed0f9676b01d service neutron] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:14.736060 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1300/2599] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:30:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:30:15.006513 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c5d46-08ab-4bf6-82ee-80a759541928 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:15.008098 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-6f7c5d46-08ab-4bf6-82ee-80a759541928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:15.026050 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c5d46-08ab-4bf6-82ee-80a759541928 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:15.032156 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8821fb-adc7-477c-8841-04f25058c6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:15.033798 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8821fb-adc7-477c-8841-04f25058c6b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:15.034118 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8821fb-adc7-477c-8841-04f25058c6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:15.034383 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8821fb-adc7-477c-8841-04f25058c6b0 admin admin] PATH_INFO: `/v3/projects/c66a04a7b6814162bc8a7cc6381a9067` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:15.035691 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8821fb-adc7-477c-8841-04f25058c6b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c66a04a7b6814162bc8a7cc6381a9067)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:15.037802 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8821fb-adc7-477c-8841-04f25058c6b0 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:15.087263 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-4c8821fb-adc7-477c-8841-04f25058c6b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c66a04a7b6814162bc8a7cc6381a9067', 'request_id': 'req-4c8821fb-adc7-477c-8841-04f25058c6b0'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:15.093876 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-4c8821fb-adc7-477c-8841-04f25058c6b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c66a04a7b6814162bc8a7cc6381a9067', 'request_id': 'req-4c8821fb-adc7-477c-8841-04f25058c6b0'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:15.101838 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-4c8821fb-adc7-477c-8841-04f25058c6b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c66a04a7b6814162bc8a7cc6381a9067', 'request_id': 'req-4c8821fb-adc7-477c-8841-04f25058c6b0'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:15.112506 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-4c8821fb-adc7-477c-8841-04f25058c6b0 admin admin] The token cache is being invalidate because project c66a04a7b6814162bc8a7cc6381a9067 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:30:15.112792 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-4c8821fb-adc7-477c-8841-04f25058c6b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:15.113414 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-4c8821fb-adc7-477c-8841-04f25058c6b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:15.114989 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1300/2600] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:30:15 2022] DELETE /identity/v3/projects/c66a04a7b6814162bc8a7cc6381a9067 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:30:15.119839 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b19604-013e-473c-a164-eafd9d4daf4a None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:15.120128 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b19604-013e-473c-a164-eafd9d4daf4a None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:15.120406 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b19604-013e-473c-a164-eafd9d4daf4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:15.137478 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-85b19604-013e-473c-a164-eafd9d4daf4a None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:30:15.139340 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-85b19604-013e-473c-a164-eafd9d4daf4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:15.204414 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1301/2601] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:30:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:30:15.214543 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc878b9-73e3-40fc-886a-e0d7be7a7547 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:15.215009 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc878b9-73e3-40fc-886a-e0d7be7a7547 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:15.215135 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc878b9-73e3-40fc-886a-e0d7be7a7547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:15.239873 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-7cc878b9-73e3-40fc-886a-e0d7be7a7547 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:30:15.241191 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-7cc878b9-73e3-40fc-886a-e0d7be7a7547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:15.249511 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1301/2602] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:30:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:30:15.253761 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b19604-013e-473c-a164-eafd9d4daf4a None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:15.263928 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b19604-013e-473c-a164-eafd9d4daf4a None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:15.270800 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a919296-6bce-4e9b-b7b1-bf8859fee996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:15.271674 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a919296-6bce-4e9b-b7b1-bf8859fee996 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:15.272109 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a919296-6bce-4e9b-b7b1-bf8859fee996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:15.272449 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a919296-6bce-4e9b-b7b1-bf8859fee996 admin admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:15.273513 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a919296-6bce-4e9b-b7b1-bf8859fee996 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:30:15.273858 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a919296-6bce-4e9b-b7b1-bf8859fee996 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:15.275984 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a919296-6bce-4e9b-b7b1-bf8859fee996 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:15.288939 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1302/2603] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 17 18:30:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:30:15.293576 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc878b9-73e3-40fc-886a-e0d7be7a7547 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:15.302660 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc878b9-73e3-40fc-886a-e0d7be7a7547 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:15.307313 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7349e612-e851-47b9-b22b-073905f7c32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:15.307952 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349e612-e851-47b9-b22b-073905f7c32f admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:15.308233 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349e612-e851-47b9-b22b-073905f7c32f admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:15.308511 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349e612-e851-47b9-b22b-073905f7c32f admin admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:15.309196 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7349e612-e851-47b9-b22b-073905f7c32f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:15.311175 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7349e612-e851-47b9-b22b-073905f7c32f admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:15.339882 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1302/2604] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:30:15 2022] POST /identity/v3/projects => generated 369 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:30:15.341150 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a919296-6bce-4e9b-b7b1-bf8859fee996 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:15.352915 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a919296-6bce-4e9b-b7b1-bf8859fee996 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:15.428487 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f2985-794b-40ac-94bc-dd5c8cb15339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:15.429254 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f2985-794b-40ac-94bc-dd5c8cb15339 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:15.429617 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f2985-794b-40ac-94bc-dd5c8cb15339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:15.429968 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f2985-794b-40ac-94bc-dd5c8cb15339 admin admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:15.433179 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873f2985-794b-40ac-94bc-dd5c8cb15339 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:15.433270 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873f2985-794b-40ac-94bc-dd5c8cb15339 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:15.459498 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1303/2605] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:30:15 2022] POST /identity/v3/users => generated 285 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:30:15.466521 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7349e612-e851-47b9-b22b-073905f7c32f admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:15.477700 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7349e612-e851-47b9-b22b-073905f7c32f admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:15.486132 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb54c2f-102a-45a3-91a2-bf3490a8efaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:15.486803 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb54c2f-102a-45a3-91a2-bf3490a8efaf admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:15.487088 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb54c2f-102a-45a3-91a2-bf3490a8efaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:15.487384 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb54c2f-102a-45a3-91a2-bf3490a8efaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:15.488092 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb54c2f-102a-45a3-91a2-bf3490a8efaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:15.489723 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb54c2f-102a-45a3-91a2-bf3490a8efaf admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:15.506683 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1303/2606] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:30:15.511648 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f2985-794b-40ac-94bc-dd5c8cb15339 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:15.527294 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f2985-794b-40ac-94bc-dd5c8cb15339 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:15.533841 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f491c-c943-4ca4-9bee-c6e791fc2c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:15.534614 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f491c-c943-4ca4-9bee-c6e791fc2c8c admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:15.534898 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f491c-c943-4ca4-9bee-c6e791fc2c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:15.535185 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f491c-c943-4ca4-9bee-c6e791fc2c8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:15.536036 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9f491c-c943-4ca4-9bee-c6e791fc2c8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:15.537853 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9f491c-c943-4ca4-9bee-c6e791fc2c8c admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:15.553334 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1304/2607] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:30:15.557795 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb54c2f-102a-45a3-91a2-bf3490a8efaf admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:15.581860 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb54c2f-102a-45a3-91a2-bf3490a8efaf admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:15.587649 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e1c08-525a-4a62-86a1-a1f4c5dbedd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:15.588623 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e1c08-525a-4a62-86a1-a1f4c5dbedd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:15.588974 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e1c08-525a-4a62-86a1-a1f4c5dbedd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:15.589313 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58e1c08-525a-4a62-86a1-a1f4c5dbedd6 admin admin] PATH_INFO: `/v3/projects/bcc663a705f34cfa87b6adb161b5ac7d/users/fd0cc6acc4574a8b898f9e451bde10c1/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:15.607201 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58e1c08-525a-4a62-86a1-a1f4c5dbedd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcc663a705f34cfa87b6adb161b5ac7d, user_id=fd0cc6acc4574a8b898f9e451bde10c1, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:15.609982 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58e1c08-525a-4a62-86a1-a1f4c5dbedd6 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:15.627265 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1304/2608] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:30:15 2022] PUT /identity/v3/projects/bcc663a705f34cfa87b6adb161b5ac7d/users/fd0cc6acc4574a8b898f9e451bde10c1/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:30:15.645164 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911f1ec-1349-4f79-a5c0-41ffa9c8f070 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:15.645761 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911f1ec-1349-4f79-a5c0-41ffa9c8f070 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:15.646283 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3911f1ec-1349-4f79-a5c0-41ffa9c8f070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:15.680856 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-3911f1ec-1349-4f79-a5c0-41ffa9c8f070 None None] MFA Rules not processed for user `fd0cc6acc4574a8b898f9e451bde10c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:30:15.682241 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-3911f1ec-1349-4f79-a5c0-41ffa9c8f070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:15.748944 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1305/2609] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:30:15 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:30:15.753717 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e1c08-525a-4a62-86a1-a1f4c5dbedd6 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:15.813656 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58e1c08-525a-4a62-86a1-a1f4c5dbedd6 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:15.818535 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bae69e-30fb-4107-96b2-ef21b6f024ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:15.819210 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bae69e-30fb-4107-96b2-ef21b6f024ae admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:15.819493 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bae69e-30fb-4107-96b2-ef21b6f024ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:15.819771 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bae69e-30fb-4107-96b2-ef21b6f024ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:15.820501 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bae69e-30fb-4107-96b2-ef21b6f024ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:15.822434 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bae69e-30fb-4107-96b2-ef21b6f024ae admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:15.849423 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1305/2610] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:30:15 2022] POST /identity/v3/projects => generated 367 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:30:15.861662 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3911f1ec-1349-4f79-a5c0-41ffa9c8f070 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:15.872901 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3911f1ec-1349-4f79-a5c0-41ffa9c8f070 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:15.933533 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b84772-95d2-4471-b223-c678a4dc2c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:15.934185 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b84772-95d2-4471-b223-c678a4dc2c39 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:15.934464 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b84772-95d2-4471-b223-c678a4dc2c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:15.934736 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b84772-95d2-4471-b223-c678a4dc2c39 admin admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:15.935453 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b84772-95d2-4471-b223-c678a4dc2c39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:15.937418 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b84772-95d2-4471-b223-c678a4dc2c39 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:15.958265 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1306/2611] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:30:15 2022] POST /identity/v3/users => generated 290 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:30:15.962172 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bae69e-30fb-4107-96b2-ef21b6f024ae admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:15.973190 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bae69e-30fb-4107-96b2-ef21b6f024ae admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:15.977759 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6153b37c-7917-4171-9b50-c9e026b410a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:15.978405 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153b37c-7917-4171-9b50-c9e026b410a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:15.978679 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153b37c-7917-4171-9b50-c9e026b410a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:15.978954 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153b37c-7917-4171-9b50-c9e026b410a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:15.979673 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6153b37c-7917-4171-9b50-c9e026b410a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:15.981250 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6153b37c-7917-4171-9b50-c9e026b410a8 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:15.992069 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1306/2612] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:30:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:30:15.996222 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b84772-95d2-4471-b223-c678a4dc2c39 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:16.006203 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b84772-95d2-4471-b223-c678a4dc2c39 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:16.010783 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2422f5f8-4442-4f1f-95a5-f77b7b7ce15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:16.011635 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2422f5f8-4442-4f1f-95a5-f77b7b7ce15b admin admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:16.011915 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2422f5f8-4442-4f1f-95a5-f77b7b7ce15b admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:16.012182 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2422f5f8-4442-4f1f-95a5-f77b7b7ce15b admin admin] PATH_INFO: `/v3/projects/456d983fda56496a885048cf5b14b7ab/users/8b56e61b03e847c482ab944902039842/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:16.027321 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2422f5f8-4442-4f1f-95a5-f77b7b7ce15b admin admin] RBAC: Authorizing `identity:create_grant(project_id=456d983fda56496a885048cf5b14b7ab, user_id=8b56e61b03e847c482ab944902039842, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:16.030534 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2422f5f8-4442-4f1f-95a5-f77b7b7ce15b admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:16.043570 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1307/2613] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:30:15 2022] PUT /identity/v3/projects/456d983fda56496a885048cf5b14b7ab/users/8b56e61b03e847c482ab944902039842/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:30:16.047776 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6153b37c-7917-4171-9b50-c9e026b410a8 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:16.057424 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6153b37c-7917-4171-9b50-c9e026b410a8 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:16.112489 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b05a1d-ca1b-437b-8acc-48d7ede84bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:16.113126 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b05a1d-ca1b-437b-8acc-48d7ede84bf2 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:16.113393 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b05a1d-ca1b-437b-8acc-48d7ede84bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:16.113688 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b05a1d-ca1b-437b-8acc-48d7ede84bf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:16.114394 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b05a1d-ca1b-437b-8acc-48d7ede84bf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:16.115969 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b05a1d-ca1b-437b-8acc-48d7ede84bf2 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:16.125804 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1307/2614] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:30:16 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:30:16.129863 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2422f5f8-4442-4f1f-95a5-f77b7b7ce15b admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:16.141112 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2422f5f8-4442-4f1f-95a5-f77b7b7ce15b admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:16.145634 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e03d3-5e1c-44b0-8734-aa3f41aa827b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:16.146529 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e03d3-5e1c-44b0-8734-aa3f41aa827b admin admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:16.146804 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e03d3-5e1c-44b0-8734-aa3f41aa827b admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:16.147072 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e03d3-5e1c-44b0-8734-aa3f41aa827b admin admin] PATH_INFO: `/v3/projects/456d983fda56496a885048cf5b14b7ab/users/8b56e61b03e847c482ab944902039842/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:16.149015 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041e03d3-5e1c-44b0-8734-aa3f41aa827b admin admin] RBAC: Authorizing `identity:create_grant(project_id=456d983fda56496a885048cf5b14b7ab, user_id=8b56e61b03e847c482ab944902039842, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:16.151641 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041e03d3-5e1c-44b0-8734-aa3f41aa827b admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:16.162219 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1308/2615] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:30:16 2022] PUT /identity/v3/projects/456d983fda56496a885048cf5b14b7ab/users/8b56e61b03e847c482ab944902039842/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:30:16.175271 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e7ad7-4c01-4c10-a90f-10a4015abe1f None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:16.175562 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e7ad7-4c01-4c10-a90f-10a4015abe1f None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:16.175841 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e7ad7-4c01-4c10-a90f-10a4015abe1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:16.202088 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-d20e7ad7-4c01-4c10-a90f-10a4015abe1f None None] MFA Rules not processed for user `8b56e61b03e847c482ab944902039842`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:30:16.203495 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-d20e7ad7-4c01-4c10-a90f-10a4015abe1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:16.281099 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1308/2616] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:30:16 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:30:16.291483 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e03d3-5e1c-44b0-8734-aa3f41aa827b admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:16.293224 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-041e03d3-5e1c-44b0-8734-aa3f41aa827b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:16.355040 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e03d3-5e1c-44b0-8734-aa3f41aa827b admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:16.359718 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ed636-862c-4a1c-ab28-d3851e738eab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:16.360488 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ed636-862c-4a1c-ab28-d3851e738eab service cinder] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:16.360865 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ed636-862c-4a1c-ab28-d3851e738eab service cinder] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:16.361241 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ed636-862c-4a1c-ab28-d3851e738eab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:16.370804 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9ed636-862c-4a1c-ab28-d3851e738eab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:16.372580 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9ed636-862c-4a1c-ab28-d3851e738eab service cinder] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:16.383591 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1309/2617] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:30:16 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:30:16.431122 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e7ad7-4c01-4c10-a90f-10a4015abe1f None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:16.432526 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-d20e7ad7-4c01-4c10-a90f-10a4015abe1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:16.445122 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e7ad7-4c01-4c10-a90f-10a4015abe1f None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:16.451189 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ed531-d147-41c2-8d78-25243fe833c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:16.451858 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ed531-d147-41c2-8d78-25243fe833c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:16.452235 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ed531-d147-41c2-8d78-25243fe833c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:16.452512 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ed531-d147-41c2-8d78-25243fe833c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:16.541900 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406ed531-d147-41c2-8d78-25243fe833c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:16.543790 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406ed531-d147-41c2-8d78-25243fe833c4 service cinder] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:16.558874 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1309/2618] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:30:16 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:30:17.707639 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ed636-862c-4a1c-ab28-d3851e738eab service cinder] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:17.709243 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-cf9ed636-862c-4a1c-ab28-d3851e738eab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:17.778453 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ed636-862c-4a1c-ab28-d3851e738eab service cinder] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:17.783440 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ffa54b-73e6-472d-9a35-08d8d353e1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:17.784309 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ffa54b-73e6-472d-9a35-08d8d353e1d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:17.784589 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ffa54b-73e6-472d-9a35-08d8d353e1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:17.784983 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ffa54b-73e6-472d-9a35-08d8d353e1d3 admin admin] PATH_INFO: `/v3/users/9e1309cb9bfa4cca93bd800d380373e4` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:17.786207 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ffa54b-73e6-472d-9a35-08d8d353e1d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e1309cb9bfa4cca93bd800d380373e4)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:17.788148 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ffa54b-73e6-472d-9a35-08d8d353e1d3 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:17.837109 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-e3ffa54b-73e6-472d-9a35-08d8d353e1d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e1309cb9bfa4cca93bd800d380373e4'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:17.855669 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-e3ffa54b-73e6-472d-9a35-08d8d353e1d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e1309cb9bfa4cca93bd800d380373e4'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:17.856445 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-e3ffa54b-73e6-472d-9a35-08d8d353e1d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e1309cb9bfa4cca93bd800d380373e4'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:17.857654 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-e3ffa54b-73e6-472d-9a35-08d8d353e1d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e1309cb9bfa4cca93bd800d380373e4'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:17.866198 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-e3ffa54b-73e6-472d-9a35-08d8d353e1d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e1309cb9bfa4cca93bd800d380373e4'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:17.887621 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1310/2619] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:30:17 2022] DELETE /identity/v3/users/9e1309cb9bfa4cca93bd800d380373e4 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:30:17.892107 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df90ef8-6549-4807-b37e-de2ceb41a326 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:17.892567 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df90ef8-6549-4807-b37e-de2ceb41a326 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:17.892685 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df90ef8-6549-4807-b37e-de2ceb41a326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:17.911370 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-5df90ef8-6549-4807-b37e-de2ceb41a326 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:30:17.913045 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-5df90ef8-6549-4807-b37e-de2ceb41a326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:17.990188 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1310/2620] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:30:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:30:18.005591 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ffa54b-73e6-472d-9a35-08d8d353e1d3 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:18.007238 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-e3ffa54b-73e6-472d-9a35-08d8d353e1d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:18.080019 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ffa54b-73e6-472d-9a35-08d8d353e1d3 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:18.084064 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3439a26c-01d9-4907-a576-31e24d14607d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:18.084774 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439a26c-01d9-4907-a576-31e24d14607d service neutron] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:18.085128 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439a26c-01d9-4907-a576-31e24d14607d service neutron] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:18.085490 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439a26c-01d9-4907-a576-31e24d14607d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:18.098452 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3439a26c-01d9-4907-a576-31e24d14607d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:18.101795 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3439a26c-01d9-4907-a576-31e24d14607d service neutron] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:18.121840 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1311/2621] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:30:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:30:18.623231 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df90ef8-6549-4807-b37e-de2ceb41a326 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:18.624655 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-5df90ef8-6549-4807-b37e-de2ceb41a326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:18.648595 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df90ef8-6549-4807-b37e-de2ceb41a326 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:18.654465 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c503566-a1a8-4e87-bde5-df629818f63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:18.655446 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c503566-a1a8-4e87-bde5-df629818f63c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:18.655741 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c503566-a1a8-4e87-bde5-df629818f63c admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:18.656017 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c503566-a1a8-4e87-bde5-df629818f63c admin admin] PATH_INFO: `/v3/projects/28195ceb06a049e8805f2a92ad831b7e` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:18.657265 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c503566-a1a8-4e87-bde5-df629818f63c admin admin] RBAC: Authorizing `identity:delete_project(project_id=28195ceb06a049e8805f2a92ad831b7e)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:18.659232 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c503566-a1a8-4e87-bde5-df629818f63c admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:18.711318 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-3c503566-a1a8-4e87-bde5-df629818f63c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28195ceb06a049e8805f2a92ad831b7e', 'request_id': 'req-3c503566-a1a8-4e87-bde5-df629818f63c'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:18.717483 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-3c503566-a1a8-4e87-bde5-df629818f63c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28195ceb06a049e8805f2a92ad831b7e', 'request_id': 'req-3c503566-a1a8-4e87-bde5-df629818f63c'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:18.725271 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-3c503566-a1a8-4e87-bde5-df629818f63c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28195ceb06a049e8805f2a92ad831b7e', 'request_id': 'req-3c503566-a1a8-4e87-bde5-df629818f63c'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:18.735490 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-3c503566-a1a8-4e87-bde5-df629818f63c admin admin] The token cache is being invalidate because project 28195ceb06a049e8805f2a92ad831b7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:30:18.735783 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-3c503566-a1a8-4e87-bde5-df629818f63c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:18.736687 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-3c503566-a1a8-4e87-bde5-df629818f63c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:18.738221 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1311/2622] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:30:18 2022] DELETE /identity/v3/projects/28195ceb06a049e8805f2a92ad831b7e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:30:20.029832 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3439a26c-01d9-4907-a576-31e24d14607d service neutron] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:20.031279 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-3439a26c-01d9-4907-a576-31e24d14607d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:20.043305 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3439a26c-01d9-4907-a576-31e24d14607d service neutron] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:20.097081 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c7ec32-6f9f-4521-82d3-af9244487568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:20.097987 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7ec32-6f9f-4521-82d3-af9244487568 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:20.098268 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7ec32-6f9f-4521-82d3-af9244487568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:20.098564 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7ec32-6f9f-4521-82d3-af9244487568 admin admin] PATH_INFO: `/v3/users/fd0cc6acc4574a8b898f9e451bde10c1` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:20.099737 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c7ec32-6f9f-4521-82d3-af9244487568 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd0cc6acc4574a8b898f9e451bde10c1)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:20.101710 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c7ec32-6f9f-4521-82d3-af9244487568 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:20.144832 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-10c7ec32-6f9f-4521-82d3-af9244487568 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd0cc6acc4574a8b898f9e451bde10c1'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:20.156799 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-10c7ec32-6f9f-4521-82d3-af9244487568 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd0cc6acc4574a8b898f9e451bde10c1'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:20.157444 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-10c7ec32-6f9f-4521-82d3-af9244487568 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd0cc6acc4574a8b898f9e451bde10c1'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:20.158070 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-10c7ec32-6f9f-4521-82d3-af9244487568 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd0cc6acc4574a8b898f9e451bde10c1'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:20.164627 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-10c7ec32-6f9f-4521-82d3-af9244487568 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd0cc6acc4574a8b898f9e451bde10c1'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:20.177514 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1312/2623] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:30:20 2022] DELETE /identity/v3/users/fd0cc6acc4574a8b898f9e451bde10c1 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:30:20.182026 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05d589-5979-4f5b-8f9b-18c4847c73cc None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:20.182531 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05d589-5979-4f5b-8f9b-18c4847c73cc None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:20.182640 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa05d589-5979-4f5b-8f9b-18c4847c73cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:20.201682 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-fa05d589-5979-4f5b-8f9b-18c4847c73cc None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:30:20.203123 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-fa05d589-5979-4f5b-8f9b-18c4847c73cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:20.260320 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1312/2624] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:30:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:30:20.270528 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c7ec32-6f9f-4521-82d3-af9244487568 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:20.272127 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-10c7ec32-6f9f-4521-82d3-af9244487568 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:20.331438 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c7ec32-6f9f-4521-82d3-af9244487568 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:20.335380 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981a9f8a-c0c0-4cce-bb95-d3493325fd05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:20.336037 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a9f8a-c0c0-4cce-bb95-d3493325fd05 service neutron] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:20.336321 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a9f8a-c0c0-4cce-bb95-d3493325fd05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:20.336641 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a9f8a-c0c0-4cce-bb95-d3493325fd05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:20.346792 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981a9f8a-c0c0-4cce-bb95-d3493325fd05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:20.348355 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981a9f8a-c0c0-4cce-bb95-d3493325fd05 service neutron] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:20.357647 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1313/2625] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:30:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:30:20.614399 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa05d589-5979-4f5b-8f9b-18c4847c73cc None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:20.616083 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-fa05d589-5979-4f5b-8f9b-18c4847c73cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:20.632716 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa05d589-5979-4f5b-8f9b-18c4847c73cc None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:20.637630 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f6bc5-efee-4fe9-9ed1-36c572846f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:20.639221 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f6bc5-efee-4fe9-9ed1-36c572846f14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:20.639604 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f6bc5-efee-4fe9-9ed1-36c572846f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:20.639979 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f6bc5-efee-4fe9-9ed1-36c572846f14 admin admin] PATH_INFO: `/v3/projects/bcc663a705f34cfa87b6adb161b5ac7d` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:20.641122 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3f6bc5-efee-4fe9-9ed1-36c572846f14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcc663a705f34cfa87b6adb161b5ac7d)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:20.643312 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3f6bc5-efee-4fe9-9ed1-36c572846f14 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:20.688771 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-9f3f6bc5-efee-4fe9-9ed1-36c572846f14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcc663a705f34cfa87b6adb161b5ac7d', 'request_id': 'req-9f3f6bc5-efee-4fe9-9ed1-36c572846f14'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:20.694863 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-9f3f6bc5-efee-4fe9-9ed1-36c572846f14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcc663a705f34cfa87b6adb161b5ac7d', 'request_id': 'req-9f3f6bc5-efee-4fe9-9ed1-36c572846f14'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:20.702552 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-9f3f6bc5-efee-4fe9-9ed1-36c572846f14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcc663a705f34cfa87b6adb161b5ac7d', 'request_id': 'req-9f3f6bc5-efee-4fe9-9ed1-36c572846f14'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:20.712571 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-9f3f6bc5-efee-4fe9-9ed1-36c572846f14 admin admin] The token cache is being invalidate because project bcc663a705f34cfa87b6adb161b5ac7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:30:20.712851 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-9f3f6bc5-efee-4fe9-9ed1-36c572846f14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:20.713452 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-9f3f6bc5-efee-4fe9-9ed1-36c572846f14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:20.715022 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1313/2626] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:30:20 2022] DELETE /identity/v3/projects/bcc663a705f34cfa87b6adb161b5ac7d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:30:20.718960 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981a9f8a-c0c0-4cce-bb95-d3493325fd05 service neutron] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:20.728737 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981a9f8a-c0c0-4cce-bb95-d3493325fd05 service neutron] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:20.786698 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e496325d-6c24-4167-a621-a7c7422f07bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:20.787554 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496325d-6c24-4167-a621-a7c7422f07bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:20.787825 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496325d-6c24-4167-a621-a7c7422f07bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:20.788089 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496325d-6c24-4167-a621-a7c7422f07bd admin admin] PATH_INFO: `/v3/users/8b56e61b03e847c482ab944902039842` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:20.789253 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e496325d-6c24-4167-a621-a7c7422f07bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b56e61b03e847c482ab944902039842)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:20.791236 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e496325d-6c24-4167-a621-a7c7422f07bd admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:20.835451 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-e496325d-6c24-4167-a621-a7c7422f07bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b56e61b03e847c482ab944902039842'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:20.847296 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-e496325d-6c24-4167-a621-a7c7422f07bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b56e61b03e847c482ab944902039842'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:20.848050 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-e496325d-6c24-4167-a621-a7c7422f07bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b56e61b03e847c482ab944902039842'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:20.848743 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-e496325d-6c24-4167-a621-a7c7422f07bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b56e61b03e847c482ab944902039842'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:20.855881 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-e496325d-6c24-4167-a621-a7c7422f07bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b56e61b03e847c482ab944902039842'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:20.869012 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1314/2627] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:30:20 2022] DELETE /identity/v3/users/8b56e61b03e847c482ab944902039842 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:30:21.125113 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f6bc5-efee-4fe9-9ed1-36c572846f14 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:21.126551 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-9f3f6bc5-efee-4fe9-9ed1-36c572846f14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:21.143495 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e496325d-6c24-4167-a621-a7c7422f07bd admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:21.145100 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-e496325d-6c24-4167-a621-a7c7422f07bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:21.192152 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f6bc5-efee-4fe9-9ed1-36c572846f14 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:21.225052 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e496325d-6c24-4167-a621-a7c7422f07bd admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:21.230538 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b1e63-7b94-4a7f-a5b1-5cc69260e837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:21.231498 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b1e63-7b94-4a7f-a5b1-5cc69260e837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:21.232608 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b1e63-7b94-4a7f-a5b1-5cc69260e837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:21.233229 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b1e63-7b94-4a7f-a5b1-5cc69260e837 admin admin] PATH_INFO: `/v3/projects/456d983fda56496a885048cf5b14b7ab` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:21.234664 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0b1e63-7b94-4a7f-a5b1-5cc69260e837 admin admin] RBAC: Authorizing `identity:delete_project(project_id=456d983fda56496a885048cf5b14b7ab)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:21.236689 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0b1e63-7b94-4a7f-a5b1-5cc69260e837 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:21.246822 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ed105-33fa-422c-a251-f61da8ab249c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:21.248061 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ed105-33fa-422c-a251-f61da8ab249c service neutron] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:21.248308 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ed105-33fa-422c-a251-f61da8ab249c service neutron] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:21.248770 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ed105-33fa-422c-a251-f61da8ab249c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:21.250834 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-3f9ed105-33fa-422c-a251-f61da8ab249c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:21.264383 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ed105-33fa-422c-a251-f61da8ab249c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:21.265859 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ed105-33fa-422c-a251-f61da8ab249c service neutron] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:21.278063 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1314/2628] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:30:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:30:21.289948 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-9f0b1e63-7b94-4a7f-a5b1-5cc69260e837 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '456d983fda56496a885048cf5b14b7ab', 'request_id': 'req-9f0b1e63-7b94-4a7f-a5b1-5cc69260e837'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:21.296917 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-9f0b1e63-7b94-4a7f-a5b1-5cc69260e837 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '456d983fda56496a885048cf5b14b7ab', 'request_id': 'req-9f0b1e63-7b94-4a7f-a5b1-5cc69260e837'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:21.305897 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-9f0b1e63-7b94-4a7f-a5b1-5cc69260e837 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '456d983fda56496a885048cf5b14b7ab', 'request_id': 'req-9f0b1e63-7b94-4a7f-a5b1-5cc69260e837'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:21.317401 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-9f0b1e63-7b94-4a7f-a5b1-5cc69260e837 admin admin] The token cache is being invalidate because project 456d983fda56496a885048cf5b14b7ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:30:21.317973 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-9f0b1e63-7b94-4a7f-a5b1-5cc69260e837 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:21.318784 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-9f0b1e63-7b94-4a7f-a5b1-5cc69260e837 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:21.320491 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1315/2629] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:30:21 2022] DELETE /identity/v3/projects/456d983fda56496a885048cf5b14b7ab => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:30:21.327971 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b36dd6-ad60-4d07-8675-dbcd1ea779ef None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:21.328316 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b36dd6-ad60-4d07-8675-dbcd1ea779ef None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:21.328922 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b36dd6-ad60-4d07-8675-dbcd1ea779ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:21.347941 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-f5b36dd6-ad60-4d07-8675-dbcd1ea779ef None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:30:21.349399 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-f5b36dd6-ad60-4d07-8675-dbcd1ea779ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:21.415193 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1315/2630] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:30:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:30:21.425054 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0bcf1a-7d42-400b-be19-0540e055fbfe None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:21.425350 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0bcf1a-7d42-400b-be19-0540e055fbfe None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:21.425735 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0bcf1a-7d42-400b-be19-0540e055fbfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:21.445450 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-8d0bcf1a-7d42-400b-be19-0540e055fbfe None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:30:21.447770 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-8d0bcf1a-7d42-400b-be19-0540e055fbfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:21.456923 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1316/2631] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:30:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:30:21.461136 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b36dd6-ad60-4d07-8675-dbcd1ea779ef None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:21.472785 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b36dd6-ad60-4d07-8675-dbcd1ea779ef None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:21.478079 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9723e29b-bda8-4658-996a-df39a9836074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:21.479057 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9723e29b-bda8-4658-996a-df39a9836074 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:21.479701 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9723e29b-bda8-4658-996a-df39a9836074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:21.480188 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9723e29b-bda8-4658-996a-df39a9836074 admin admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:21.481345 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9723e29b-bda8-4658-996a-df39a9836074 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:30:21.482573 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9723e29b-bda8-4658-996a-df39a9836074 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:21.484570 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9723e29b-bda8-4658-996a-df39a9836074 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:21.499318 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1316/2632] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 17 18:30:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:30:21.504241 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0bcf1a-7d42-400b-be19-0540e055fbfe None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:21.514971 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0bcf1a-7d42-400b-be19-0540e055fbfe None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:21.520512 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010fca5a-3f7a-4edb-b216-551950b6b335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:21.521399 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010fca5a-3f7a-4edb-b216-551950b6b335 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:21.522136 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010fca5a-3f7a-4edb-b216-551950b6b335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:21.522607 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010fca5a-3f7a-4edb-b216-551950b6b335 admin admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:21.523311 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010fca5a-3f7a-4edb-b216-551950b6b335 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:21.525254 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010fca5a-3f7a-4edb-b216-551950b6b335 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:21.559915 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1317/2633] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:30:21 2022] POST /identity/v3/projects => generated 387 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:30:21.561025 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9723e29b-bda8-4658-996a-df39a9836074 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:21.570866 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9723e29b-bda8-4658-996a-df39a9836074 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:21.628126 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abe001d-dd56-4a29-ad06-7148e3a1450d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:21.628793 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe001d-dd56-4a29-ad06-7148e3a1450d admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:21.629100 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe001d-dd56-4a29-ad06-7148e3a1450d admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:21.629377 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe001d-dd56-4a29-ad06-7148e3a1450d admin admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:21.630105 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abe001d-dd56-4a29-ad06-7148e3a1450d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:21.632012 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abe001d-dd56-4a29-ad06-7148e3a1450d admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:21.652096 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1317/2634] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:30:21 2022] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:30:21.656837 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010fca5a-3f7a-4edb-b216-551950b6b335 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:21.668844 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010fca5a-3f7a-4edb-b216-551950b6b335 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:21.674226 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1702173-ffed-4794-a059-ee1669826f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:21.675023 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1702173-ffed-4794-a059-ee1669826f32 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:21.675303 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1702173-ffed-4794-a059-ee1669826f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:21.675575 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1702173-ffed-4794-a059-ee1669826f32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:21.676295 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1702173-ffed-4794-a059-ee1669826f32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:21.677929 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1702173-ffed-4794-a059-ee1669826f32 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:21.692137 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1318/2635] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:30:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:30:21.696572 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abe001d-dd56-4a29-ad06-7148e3a1450d admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:21.707799 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abe001d-dd56-4a29-ad06-7148e3a1450d admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:21.712405 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d21aedd-299d-47f7-88cc-257fc0b35b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:21.713060 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21aedd-299d-47f7-88cc-257fc0b35b50 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:21.713335 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21aedd-299d-47f7-88cc-257fc0b35b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:21.713638 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21aedd-299d-47f7-88cc-257fc0b35b50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:21.714356 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d21aedd-299d-47f7-88cc-257fc0b35b50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:21.715932 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d21aedd-299d-47f7-88cc-257fc0b35b50 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:21.729594 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1318/2636] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:30:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:30:21.730834 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1702173-ffed-4794-a059-ee1669826f32 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:21.745493 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1702173-ffed-4794-a059-ee1669826f32 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:21.750426 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9283613-a665-4e63-b66d-c6aa3c2498de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:21.751388 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9283613-a665-4e63-b66d-c6aa3c2498de admin admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:21.751730 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9283613-a665-4e63-b66d-c6aa3c2498de admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:21.752068 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9283613-a665-4e63-b66d-c6aa3c2498de admin admin] PATH_INFO: `/v3/projects/0e3ea2e3f9ea4b5e9c759054207cc455/users/73ff3888de4a4010a0ac35c5f7e14db3/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:21.766408 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9283613-a665-4e63-b66d-c6aa3c2498de admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e3ea2e3f9ea4b5e9c759054207cc455, user_id=73ff3888de4a4010a0ac35c5f7e14db3, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:21.769036 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9283613-a665-4e63-b66d-c6aa3c2498de admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:21.782348 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1319/2637] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:30:21 2022] PUT /identity/v3/projects/0e3ea2e3f9ea4b5e9c759054207cc455/users/73ff3888de4a4010a0ac35c5f7e14db3/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:30:21.793813 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ecdd93-a909-46e6-9aec-8bfdd4aa4ae7 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:21.794176 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ecdd93-a909-46e6-9aec-8bfdd4aa4ae7 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:21.795075 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ecdd93-a909-46e6-9aec-8bfdd4aa4ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:21.821779 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-14ecdd93-a909-46e6-9aec-8bfdd4aa4ae7 None None] MFA Rules not processed for user `73ff3888de4a4010a0ac35c5f7e14db3`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:30:21.822895 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-14ecdd93-a909-46e6-9aec-8bfdd4aa4ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:21.888017 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1319/2638] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:30:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:30:21.892604 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9283613-a665-4e63-b66d-c6aa3c2498de admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:21.955633 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9283613-a665-4e63-b66d-c6aa3c2498de admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:21.960219 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936c1300-36ff-401c-8420-5a313567433d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:21.960860 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c1300-36ff-401c-8420-5a313567433d admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:21.961136 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c1300-36ff-401c-8420-5a313567433d admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:21.961404 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c1300-36ff-401c-8420-5a313567433d admin admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:21.962111 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936c1300-36ff-401c-8420-5a313567433d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:21.963983 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936c1300-36ff-401c-8420-5a313567433d admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:21.989362 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1320/2639] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:30:21 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:30:21.993296 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ecdd93-a909-46e6-9aec-8bfdd4aa4ae7 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:22.007156 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ecdd93-a909-46e6-9aec-8bfdd4aa4ae7 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:22.062614 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1272db-8312-4418-93a8-b8230fcb1f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:22.063623 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1272db-8312-4418-93a8-b8230fcb1f25 admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:22.063970 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1272db-8312-4418-93a8-b8230fcb1f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:22.064339 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1272db-8312-4418-93a8-b8230fcb1f25 admin admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:22.065290 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1272db-8312-4418-93a8-b8230fcb1f25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:22.067402 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1272db-8312-4418-93a8-b8230fcb1f25 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:22.087617 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1320/2640] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:30:21 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:30:22.092337 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936c1300-36ff-401c-8420-5a313567433d admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:22.102175 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936c1300-36ff-401c-8420-5a313567433d admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:22.106673 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a66581-1714-47a4-ad55-5a783700c89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:22.107361 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a66581-1714-47a4-ad55-5a783700c89d admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:22.107677 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a66581-1714-47a4-ad55-5a783700c89d admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:22.107990 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a66581-1714-47a4-ad55-5a783700c89d admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:22.108830 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a66581-1714-47a4-ad55-5a783700c89d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:22.110573 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a66581-1714-47a4-ad55-5a783700c89d admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:22.121882 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1321/2641] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:30:22.126008 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1272db-8312-4418-93a8-b8230fcb1f25 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:22.135919 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1272db-8312-4418-93a8-b8230fcb1f25 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:22.143194 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07ce41b-65f9-41f4-a60b-1ab455183e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:22.143623 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ce41b-65f9-41f4-a60b-1ab455183e06 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:22.144565 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ce41b-65f9-41f4-a60b-1ab455183e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:22.144705 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ce41b-65f9-41f4-a60b-1ab455183e06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:22.145568 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07ce41b-65f9-41f4-a60b-1ab455183e06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:22.147449 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07ce41b-65f9-41f4-a60b-1ab455183e06 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:22.161505 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1321/2642] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:30:22.163370 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a66581-1714-47a4-ad55-5a783700c89d admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:22.173894 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a66581-1714-47a4-ad55-5a783700c89d admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:22.178809 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b68f6-992a-488f-89f7-7c43b83545d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:22.179694 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b68f6-992a-488f-89f7-7c43b83545d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:22.179969 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b68f6-992a-488f-89f7-7c43b83545d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:22.180240 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b68f6-992a-488f-89f7-7c43b83545d9 admin admin] PATH_INFO: `/v3/projects/1c9ea3c1b7e9473999f8630d3574f7a4/users/469850ebd6e3442b8a13e6a50eeccfa9/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:22.198783 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39b68f6-992a-488f-89f7-7c43b83545d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c9ea3c1b7e9473999f8630d3574f7a4, user_id=469850ebd6e3442b8a13e6a50eeccfa9, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:22.202252 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39b68f6-992a-488f-89f7-7c43b83545d9 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:22.217642 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1322/2643] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:30:22 2022] PUT /identity/v3/projects/1c9ea3c1b7e9473999f8630d3574f7a4/users/469850ebd6e3442b8a13e6a50eeccfa9/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:30:22.228179 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a040475-0576-41fd-ada7-1aa8dc1778b1 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:22.228736 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a040475-0576-41fd-ada7-1aa8dc1778b1 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:22.228736 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a040475-0576-41fd-ada7-1aa8dc1778b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:22.258655 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-8a040475-0576-41fd-ada7-1aa8dc1778b1 None None] MFA Rules not processed for user `469850ebd6e3442b8a13e6a50eeccfa9`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:30:22.259983 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-8a040475-0576-41fd-ada7-1aa8dc1778b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:22.337239 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1322/2644] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:30:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:30:22.341729 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b68f6-992a-488f-89f7-7c43b83545d9 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:22.402040 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b68f6-992a-488f-89f7-7c43b83545d9 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:22.406677 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7c318-005f-4e4b-ae56-bcbca595a1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:22.407318 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7c318-005f-4e4b-ae56-bcbca595a1bb admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:22.407595 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7c318-005f-4e4b-ae56-bcbca595a1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:22.407866 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7c318-005f-4e4b-ae56-bcbca595a1bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:22.408551 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f7c318-005f-4e4b-ae56-bcbca595a1bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:22.410480 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f7c318-005f-4e4b-ae56-bcbca595a1bb admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:22.435680 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1323/2645] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:30:22 2022] POST /identity/v3/projects => generated 387 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:30:22.439466 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a040475-0576-41fd-ada7-1aa8dc1778b1 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:22.450099 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a040475-0576-41fd-ada7-1aa8dc1778b1 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:22.505149 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae2488-8f72-4572-b49e-442d9c1f270a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:22.505965 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae2488-8f72-4572-b49e-442d9c1f270a admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:22.506237 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae2488-8f72-4572-b49e-442d9c1f270a admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:22.506504 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae2488-8f72-4572-b49e-442d9c1f270a admin admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:22.507242 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ae2488-8f72-4572-b49e-442d9c1f270a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:22.509164 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ae2488-8f72-4572-b49e-442d9c1f270a admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:22.529924 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1323/2646] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:30:22 2022] POST /identity/v3/users => generated 300 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:30:22.533854 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7c318-005f-4e4b-ae56-bcbca595a1bb admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:22.546353 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7c318-005f-4e4b-ae56-bcbca595a1bb admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:22.552264 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32fc704-de15-4fa4-b7dd-34e5e53150a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:22.552978 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32fc704-de15-4fa4-b7dd-34e5e53150a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:22.553260 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32fc704-de15-4fa4-b7dd-34e5e53150a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:22.553667 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32fc704-de15-4fa4-b7dd-34e5e53150a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:22.554611 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32fc704-de15-4fa4-b7dd-34e5e53150a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:22.557280 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32fc704-de15-4fa4-b7dd-34e5e53150a2 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:22.571927 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1324/2647] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:30:22.577675 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae2488-8f72-4572-b49e-442d9c1f270a admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:22.599499 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae2488-8f72-4572-b49e-442d9c1f270a admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:22.604118 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae5bcd1-9816-4ddc-95ea-8f038dfe2e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:22.605100 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5bcd1-9816-4ddc-95ea-8f038dfe2e73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:22.605384 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5bcd1-9816-4ddc-95ea-8f038dfe2e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:22.605720 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5bcd1-9816-4ddc-95ea-8f038dfe2e73 admin admin] PATH_INFO: `/v3/projects/101c0abc6fc448979601668368cd3534/users/77d6c4d3af5145eb9e1a62a2f00c489d/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:22.621169 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae5bcd1-9816-4ddc-95ea-8f038dfe2e73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=101c0abc6fc448979601668368cd3534, user_id=77d6c4d3af5145eb9e1a62a2f00c489d, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:22.624393 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae5bcd1-9816-4ddc-95ea-8f038dfe2e73 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:22.638997 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1324/2648] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:30:22 2022] PUT /identity/v3/projects/101c0abc6fc448979601668368cd3534/users/77d6c4d3af5145eb9e1a62a2f00c489d/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:30:22.644833 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32fc704-de15-4fa4-b7dd-34e5e53150a2 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:22.657589 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32fc704-de15-4fa4-b7dd-34e5e53150a2 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:22.719360 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a79ba17-d243-49b0-bd9a-6befcf181727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:22.720059 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79ba17-d243-49b0-bd9a-6befcf181727 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:22.720336 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79ba17-d243-49b0-bd9a-6befcf181727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:22.720605 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79ba17-d243-49b0-bd9a-6befcf181727 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:22.721324 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a79ba17-d243-49b0-bd9a-6befcf181727 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:22.722953 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a79ba17-d243-49b0-bd9a-6befcf181727 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:22.734071 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1325/2649] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:30:22.738412 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae5bcd1-9816-4ddc-95ea-8f038dfe2e73 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:22.750046 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae5bcd1-9816-4ddc-95ea-8f038dfe2e73 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:22.756560 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5359d9bb-56f9-4d45-be5e-0222c6e88a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:22.757712 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359d9bb-56f9-4d45-be5e-0222c6e88a77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:22.757990 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359d9bb-56f9-4d45-be5e-0222c6e88a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:22.758388 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359d9bb-56f9-4d45-be5e-0222c6e88a77 admin admin] PATH_INFO: `/v3/projects/101c0abc6fc448979601668368cd3534/users/77d6c4d3af5145eb9e1a62a2f00c489d/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:22.760940 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5359d9bb-56f9-4d45-be5e-0222c6e88a77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=101c0abc6fc448979601668368cd3534, user_id=77d6c4d3af5145eb9e1a62a2f00c489d, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:22.763861 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5359d9bb-56f9-4d45-be5e-0222c6e88a77 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:22.783794 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1325/2650] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:30:22 2022] PUT /identity/v3/projects/101c0abc6fc448979601668368cd3534/users/77d6c4d3af5145eb9e1a62a2f00c489d/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:30:22.786532 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a16ec-16da-40a4-adf5-dffc149895c1 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:22.786844 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a16ec-16da-40a4-adf5-dffc149895c1 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:22.787117 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871a16ec-16da-40a4-adf5-dffc149895c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:22.814518 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-871a16ec-16da-40a4-adf5-dffc149895c1 None None] MFA Rules not processed for user `77d6c4d3af5145eb9e1a62a2f00c489d`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:30:22.815716 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-871a16ec-16da-40a4-adf5-dffc149895c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:22.897344 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1326/2651] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:30:22 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:30:22.908937 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5359d9bb-56f9-4d45-be5e-0222c6e88a77 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:22.910898 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-5359d9bb-56f9-4d45-be5e-0222c6e88a77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:22.988001 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5359d9bb-56f9-4d45-be5e-0222c6e88a77 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:22.992228 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ae781-c692-4f6c-b98f-b876c9f18008 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:22.992875 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ae781-c692-4f6c-b98f-b876c9f18008 service cinder] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:22.993158 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ae781-c692-4f6c-b98f-b876c9f18008 service cinder] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:22.993431 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ae781-c692-4f6c-b98f-b876c9f18008 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:23.003643 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ae781-c692-4f6c-b98f-b876c9f18008 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:23.005275 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ae781-c692-4f6c-b98f-b876c9f18008 service cinder] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:23.017178 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1326/2652] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:30:22 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:30:23.555141 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a16ec-16da-40a4-adf5-dffc149895c1 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:23.556596 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-871a16ec-16da-40a4-adf5-dffc149895c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:23.570349 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871a16ec-16da-40a4-adf5-dffc149895c1 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:23.574983 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead4cb47-4416-416b-a18d-5cba0aebb7de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:23.575677 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4cb47-4416-416b-a18d-5cba0aebb7de service cinder] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:23.575957 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4cb47-4416-416b-a18d-5cba0aebb7de service cinder] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:23.576229 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4cb47-4416-416b-a18d-5cba0aebb7de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:23.642126 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead4cb47-4416-416b-a18d-5cba0aebb7de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:23.643402 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead4cb47-4416-416b-a18d-5cba0aebb7de service cinder] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:23.655111 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1327/2653] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:30:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:30:24.533519 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ae781-c692-4f6c-b98f-b876c9f18008 service cinder] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:24.535154 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-cc7ae781-c692-4f6c-b98f-b876c9f18008 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:24.599485 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ae781-c692-4f6c-b98f-b876c9f18008 service cinder] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:24.603958 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb222ae-d71f-4211-9f46-288ed3732118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:24.604834 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb222ae-d71f-4211-9f46-288ed3732118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:24.605094 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb222ae-d71f-4211-9f46-288ed3732118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:24.605365 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb222ae-d71f-4211-9f46-288ed3732118 admin admin] PATH_INFO: `/v3/users/43620937739e45d3bb7849f98d0e6cce` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:24.606593 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb222ae-d71f-4211-9f46-288ed3732118 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43620937739e45d3bb7849f98d0e6cce)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:24.608511 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb222ae-d71f-4211-9f46-288ed3732118 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:24.655865 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-bbb222ae-d71f-4211-9f46-288ed3732118 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43620937739e45d3bb7849f98d0e6cce'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:24.662575 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-bbb222ae-d71f-4211-9f46-288ed3732118 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43620937739e45d3bb7849f98d0e6cce'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:24.663251 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-bbb222ae-d71f-4211-9f46-288ed3732118 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43620937739e45d3bb7849f98d0e6cce'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:24.670273 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-bbb222ae-d71f-4211-9f46-288ed3732118 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43620937739e45d3bb7849f98d0e6cce'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:24.670802 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-bbb222ae-d71f-4211-9f46-288ed3732118 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43620937739e45d3bb7849f98d0e6cce'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:24.688040 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1327/2654] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:30:24 2022] DELETE /identity/v3/users/43620937739e45d3bb7849f98d0e6cce => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:30:24.852822 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead4cb47-4416-416b-a18d-5cba0aebb7de service cinder] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:24.864249 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead4cb47-4416-416b-a18d-5cba0aebb7de service cinder] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:24.918781 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e3448-35cb-40fd-89a8-780ccfe6b8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:24.920110 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e3448-35cb-40fd-89a8-780ccfe6b8dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:24.920426 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e3448-35cb-40fd-89a8-780ccfe6b8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:24.920645 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e3448-35cb-40fd-89a8-780ccfe6b8dd admin admin] PATH_INFO: `/v3/projects/379adfd2520a4d2dba04fca7fa3a1d95` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:24.921889 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6e3448-35cb-40fd-89a8-780ccfe6b8dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=379adfd2520a4d2dba04fca7fa3a1d95)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:24.923773 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6e3448-35cb-40fd-89a8-780ccfe6b8dd admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:24.968780 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-9a6e3448-35cb-40fd-89a8-780ccfe6b8dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '379adfd2520a4d2dba04fca7fa3a1d95', 'request_id': 'req-9a6e3448-35cb-40fd-89a8-780ccfe6b8dd'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:24.974926 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-9a6e3448-35cb-40fd-89a8-780ccfe6b8dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '379adfd2520a4d2dba04fca7fa3a1d95', 'request_id': 'req-9a6e3448-35cb-40fd-89a8-780ccfe6b8dd'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:24.982982 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-9a6e3448-35cb-40fd-89a8-780ccfe6b8dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '379adfd2520a4d2dba04fca7fa3a1d95', 'request_id': 'req-9a6e3448-35cb-40fd-89a8-780ccfe6b8dd'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:24.993529 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-9a6e3448-35cb-40fd-89a8-780ccfe6b8dd admin admin] The token cache is being invalidate because project 379adfd2520a4d2dba04fca7fa3a1d95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:30:24.993817 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-9a6e3448-35cb-40fd-89a8-780ccfe6b8dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:24.994441 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-9a6e3448-35cb-40fd-89a8-780ccfe6b8dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:24.996147 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1328/2655] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:30:24 2022] DELETE /identity/v3/projects/379adfd2520a4d2dba04fca7fa3a1d95 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:30:25.001240 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c1c4f-5cb4-4f81-be37-81426c879368 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:25.001576 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c1c4f-5cb4-4f81-be37-81426c879368 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:25.001857 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c1c4f-5cb4-4f81-be37-81426c879368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:25.021042 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-423c1c4f-5cb4-4f81-be37-81426c879368 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:30:25.022287 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-423c1c4f-5cb4-4f81-be37-81426c879368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:25.081517 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1328/2656] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:30:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:30:25.090435 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98085d03-27cd-4691-ba86-09febb36b9e5 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:25.090720 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98085d03-27cd-4691-ba86-09febb36b9e5 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:25.091054 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98085d03-27cd-4691-ba86-09febb36b9e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:25.110766 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-98085d03-27cd-4691-ba86-09febb36b9e5 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:30:25.113498 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-98085d03-27cd-4691-ba86-09febb36b9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:25.120904 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1329/2657] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:30:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:30:25.126243 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c1c4f-5cb4-4f81-be37-81426c879368 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:25.137397 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c1c4f-5cb4-4f81-be37-81426c879368 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:25.142360 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c56fd7-f2f2-4160-8112-c2ac5febc80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:25.143069 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c56fd7-f2f2-4160-8112-c2ac5febc80e admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:25.143303 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c56fd7-f2f2-4160-8112-c2ac5febc80e admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:25.143576 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c56fd7-f2f2-4160-8112-c2ac5febc80e admin admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:25.144311 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c56fd7-f2f2-4160-8112-c2ac5febc80e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:30:25.144615 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c56fd7-f2f2-4160-8112-c2ac5febc80e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:25.146264 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c56fd7-f2f2-4160-8112-c2ac5febc80e admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:25.159478 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1329/2658] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 17 18:30:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:30:25.164602 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98085d03-27cd-4691-ba86-09febb36b9e5 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:25.176843 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98085d03-27cd-4691-ba86-09febb36b9e5 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:25.181528 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e3dd6-4632-4b3c-9f4c-56fdef7583a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:25.182171 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e3dd6-4632-4b3c-9f4c-56fdef7583a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:25.182455 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e3dd6-4632-4b3c-9f4c-56fdef7583a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:25.182730 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e3dd6-4632-4b3c-9f4c-56fdef7583a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:25.183409 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675e3dd6-4632-4b3c-9f4c-56fdef7583a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:25.185295 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675e3dd6-4632-4b3c-9f4c-56fdef7583a1 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:25.209510 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1330/2659] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:30:25 2022] POST /identity/v3/projects => generated 405 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:30:25.213530 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c56fd7-f2f2-4160-8112-c2ac5febc80e admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:25.223899 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c56fd7-f2f2-4160-8112-c2ac5febc80e admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:25.286756 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32fce67-3bf1-4373-9f9b-8bfc1b8be100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:25.288242 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32fce67-3bf1-4373-9f9b-8bfc1b8be100 admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:25.288789 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32fce67-3bf1-4373-9f9b-8bfc1b8be100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:25.289290 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32fce67-3bf1-4373-9f9b-8bfc1b8be100 admin admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:25.290073 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32fce67-3bf1-4373-9f9b-8bfc1b8be100 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:25.292117 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32fce67-3bf1-4373-9f9b-8bfc1b8be100 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:25.319764 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1330/2660] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:30:25 2022] POST /identity/v3/users => generated 303 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:30:25.324161 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e3dd6-4632-4b3c-9f4c-56fdef7583a1 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:25.334695 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e3dd6-4632-4b3c-9f4c-56fdef7583a1 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:25.339185 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ec127-b6a3-4d56-a5a5-22a468dac7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:25.339837 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ec127-b6a3-4d56-a5a5-22a468dac7b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:25.340102 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ec127-b6a3-4d56-a5a5-22a468dac7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:25.340376 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ec127-b6a3-4d56-a5a5-22a468dac7b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:25.341634 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ec127-b6a3-4d56-a5a5-22a468dac7b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:25.343227 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ec127-b6a3-4d56-a5a5-22a468dac7b1 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:25.353292 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1331/2661] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:30:25.358058 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32fce67-3bf1-4373-9f9b-8bfc1b8be100 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:25.367658 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32fce67-3bf1-4373-9f9b-8bfc1b8be100 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:25.372176 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201d918d-3d7a-4be8-a21a-5d4537667d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:25.372814 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d918d-3d7a-4be8-a21a-5d4537667d52 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:25.373091 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d918d-3d7a-4be8-a21a-5d4537667d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:25.373363 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201d918d-3d7a-4be8-a21a-5d4537667d52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:25.374128 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201d918d-3d7a-4be8-a21a-5d4537667d52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:25.375706 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201d918d-3d7a-4be8-a21a-5d4537667d52 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:25.385316 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1331/2662] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:30:25.389218 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ec127-b6a3-4d56-a5a5-22a468dac7b1 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:25.398808 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ec127-b6a3-4d56-a5a5-22a468dac7b1 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:25.404009 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346b5cc5-ae30-40a8-b8bb-b3aa3400a75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:25.404860 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b5cc5-ae30-40a8-b8bb-b3aa3400a75b admin admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:25.405134 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b5cc5-ae30-40a8-b8bb-b3aa3400a75b admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:25.405401 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346b5cc5-ae30-40a8-b8bb-b3aa3400a75b admin admin] PATH_INFO: `/v3/projects/d1688bafa40147df941b5ee6798c6b88/users/8847387106394717943a0b7e9ef3466a/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:25.420288 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346b5cc5-ae30-40a8-b8bb-b3aa3400a75b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1688bafa40147df941b5ee6798c6b88, user_id=8847387106394717943a0b7e9ef3466a, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:25.422936 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346b5cc5-ae30-40a8-b8bb-b3aa3400a75b admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:25.438658 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1332/2663] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:30:25 2022] PUT /identity/v3/projects/d1688bafa40147df941b5ee6798c6b88/users/8847387106394717943a0b7e9ef3466a/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:30:25.440302 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c96ac-8591-430e-aa2e-6e1767c6fbbb None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:25.440592 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c96ac-8591-430e-aa2e-6e1767c6fbbb None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:25.440864 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c96ac-8591-430e-aa2e-6e1767c6fbbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:25.458742 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-d40c96ac-8591-430e-aa2e-6e1767c6fbbb None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:30:25.459931 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-d40c96ac-8591-430e-aa2e-6e1767c6fbbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:25.515764 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1332/2664] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:30:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:30:25.525256 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346b5cc5-ae30-40a8-b8bb-b3aa3400a75b admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:25.526953 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-346b5cc5-ae30-40a8-b8bb-b3aa3400a75b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:25.583649 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346b5cc5-ae30-40a8-b8bb-b3aa3400a75b admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:25.587318 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565cb341-596e-47ea-b471-ac4725a7809e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:25.587951 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565cb341-596e-47ea-b471-ac4725a7809e service neutron] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:25.588231 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565cb341-596e-47ea-b471-ac4725a7809e service neutron] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:25.588507 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565cb341-596e-47ea-b471-ac4725a7809e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:25.597897 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565cb341-596e-47ea-b471-ac4725a7809e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:25.599323 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565cb341-596e-47ea-b471-ac4725a7809e service neutron] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:25.608868 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1333/2665] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:30:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:30:26.227284 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736161b7-a7cf-4c5d-b8b5-0dad01f188b9 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:26.227847 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736161b7-a7cf-4c5d-b8b5-0dad01f188b9 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:26.227937 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736161b7-a7cf-4c5d-b8b5-0dad01f188b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:26.255986 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-736161b7-a7cf-4c5d-b8b5-0dad01f188b9 None None] MFA Rules not processed for user `8847387106394717943a0b7e9ef3466a`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:30:26.257386 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-736161b7-a7cf-4c5d-b8b5-0dad01f188b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:26.344458 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565cb341-596e-47ea-b471-ac4725a7809e service neutron] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:26.346295 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1333/2666] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:30:26 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:30:26.354164 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565cb341-596e-47ea-b471-ac4725a7809e service neutron] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:26.360114 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1435b540-56b6-4945-b926-c86e02a9c2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:26.360888 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435b540-56b6-4945-b926-c86e02a9c2e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:26.361169 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435b540-56b6-4945-b926-c86e02a9c2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:26.361441 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1435b540-56b6-4945-b926-c86e02a9c2e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:26.362261 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1435b540-56b6-4945-b926-c86e02a9c2e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:26.364561 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1435b540-56b6-4945-b926-c86e02a9c2e4 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:26.393647 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1334/2667] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:30:26 2022] POST /identity/v3/projects => generated 401 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:30:26.407548 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736161b7-a7cf-4c5d-b8b5-0dad01f188b9 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:26.429753 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736161b7-a7cf-4c5d-b8b5-0dad01f188b9 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:26.498660 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c3e77-7433-4385-9dc9-56de8a7879e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:26.499326 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c3e77-7433-4385-9dc9-56de8a7879e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:26.499607 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c3e77-7433-4385-9dc9-56de8a7879e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:26.499873 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c3e77-7433-4385-9dc9-56de8a7879e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:26.500554 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c3e77-7433-4385-9dc9-56de8a7879e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:26.502470 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47c3e77-7433-4385-9dc9-56de8a7879e7 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:26.521658 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1334/2668] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:30:26 2022] POST /identity/v3/users => generated 307 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:30:26.525666 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1435b540-56b6-4945-b926-c86e02a9c2e4 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:26.535520 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1435b540-56b6-4945-b926-c86e02a9c2e4 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:26.540000 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d088a4ee-fbce-4c37-b20b-60d3dcddd436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:26.540631 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088a4ee-fbce-4c37-b20b-60d3dcddd436 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:26.540906 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088a4ee-fbce-4c37-b20b-60d3dcddd436 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:26.541175 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088a4ee-fbce-4c37-b20b-60d3dcddd436 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:26.541923 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d088a4ee-fbce-4c37-b20b-60d3dcddd436 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:26.543506 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d088a4ee-fbce-4c37-b20b-60d3dcddd436 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:26.554054 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1335/2669] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:30:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:30:26.558116 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c3e77-7433-4385-9dc9-56de8a7879e7 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:26.568638 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c3e77-7433-4385-9dc9-56de8a7879e7 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:26.573280 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e45c5a-cea5-4271-9936-01cacbacf0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:26.574212 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e45c5a-cea5-4271-9936-01cacbacf0b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:26.574521 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e45c5a-cea5-4271-9936-01cacbacf0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:26.574793 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e45c5a-cea5-4271-9936-01cacbacf0b6 admin admin] PATH_INFO: `/v3/projects/4ecdab1ef4e4488db912ef7ff7aa6edf/users/2958fab76f4f464fb977b0f6c5b1c198/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:26.589897 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e45c5a-cea5-4271-9936-01cacbacf0b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ecdab1ef4e4488db912ef7ff7aa6edf, user_id=2958fab76f4f464fb977b0f6c5b1c198, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:26.592567 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e45c5a-cea5-4271-9936-01cacbacf0b6 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:26.604869 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1335/2670] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:30:26 2022] PUT /identity/v3/projects/4ecdab1ef4e4488db912ef7ff7aa6edf/users/2958fab76f4f464fb977b0f6c5b1c198/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:30:26.609345 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d088a4ee-fbce-4c37-b20b-60d3dcddd436 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:26.619310 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d088a4ee-fbce-4c37-b20b-60d3dcddd436 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:26.674032 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51691459-4076-4a1e-b6ff-22fd18348efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:26.674685 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51691459-4076-4a1e-b6ff-22fd18348efc admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:26.674966 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51691459-4076-4a1e-b6ff-22fd18348efc admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:26.675238 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51691459-4076-4a1e-b6ff-22fd18348efc admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:26.675959 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51691459-4076-4a1e-b6ff-22fd18348efc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:26.677580 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51691459-4076-4a1e-b6ff-22fd18348efc admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:26.687050 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1336/2671] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:30:26 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:30:26.691117 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e45c5a-cea5-4271-9936-01cacbacf0b6 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:26.701204 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e45c5a-cea5-4271-9936-01cacbacf0b6 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:26.706029 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575574ab-c65f-49a0-b5a8-0e729999ce28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:26.706902 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575574ab-c65f-49a0-b5a8-0e729999ce28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:26.707181 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575574ab-c65f-49a0-b5a8-0e729999ce28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:26.707453 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575574ab-c65f-49a0-b5a8-0e729999ce28 admin admin] PATH_INFO: `/v3/projects/4ecdab1ef4e4488db912ef7ff7aa6edf/users/2958fab76f4f464fb977b0f6c5b1c198/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:26.709391 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575574ab-c65f-49a0-b5a8-0e729999ce28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ecdab1ef4e4488db912ef7ff7aa6edf, user_id=2958fab76f4f464fb977b0f6c5b1c198, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:26.712036 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575574ab-c65f-49a0-b5a8-0e729999ce28 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:26.722629 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1336/2672] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:30:26 2022] PUT /identity/v3/projects/4ecdab1ef4e4488db912ef7ff7aa6edf/users/2958fab76f4f464fb977b0f6c5b1c198/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:30:27.298782 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e38569-00d8-46f1-92c5-116b0edbf72d None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:27.299071 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e38569-00d8-46f1-92c5-116b0edbf72d None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:27.299344 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e38569-00d8-46f1-92c5-116b0edbf72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:27.326443 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-95e38569-00d8-46f1-92c5-116b0edbf72d None None] MFA Rules not processed for user `2958fab76f4f464fb977b0f6c5b1c198`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:30:27.327645 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-95e38569-00d8-46f1-92c5-116b0edbf72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:27.396009 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1337/2673] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:30:27 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:30:27.672580 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575574ab-c65f-49a0-b5a8-0e729999ce28 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:27.674389 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-575574ab-c65f-49a0-b5a8-0e729999ce28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:27.733250 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575574ab-c65f-49a0-b5a8-0e729999ce28 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:27.736880 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848393e5-99cd-4d0b-a8a4-7ed1ca452cb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:27.737615 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848393e5-99cd-4d0b-a8a4-7ed1ca452cb8 service cinder] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:27.737897 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848393e5-99cd-4d0b-a8a4-7ed1ca452cb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:27.738170 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848393e5-99cd-4d0b-a8a4-7ed1ca452cb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:27.739991 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-848393e5-99cd-4d0b-a8a4-7ed1ca452cb8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:27.811322 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848393e5-99cd-4d0b-a8a4-7ed1ca452cb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:27.812797 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848393e5-99cd-4d0b-a8a4-7ed1ca452cb8 service cinder] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:27.822837 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1337/2674] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:30:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:30:28.454808 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e38569-00d8-46f1-92c5-116b0edbf72d None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:28.522471 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e38569-00d8-46f1-92c5-116b0edbf72d None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:28.526863 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ca3b6-dbdb-4bec-8b6e-9ed2833a5c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:28.527732 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ca3b6-dbdb-4bec-8b6e-9ed2833a5c4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:28.528007 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ca3b6-dbdb-4bec-8b6e-9ed2833a5c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:28.528795 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ca3b6-dbdb-4bec-8b6e-9ed2833a5c4b admin admin] PATH_INFO: `/v3/users/8847387106394717943a0b7e9ef3466a` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:28.530003 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4ca3b6-dbdb-4bec-8b6e-9ed2833a5c4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8847387106394717943a0b7e9ef3466a)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:28.531885 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4ca3b6-dbdb-4bec-8b6e-9ed2833a5c4b admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:28.579092 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-6c4ca3b6-dbdb-4bec-8b6e-9ed2833a5c4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8847387106394717943a0b7e9ef3466a'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:28.591431 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-6c4ca3b6-dbdb-4bec-8b6e-9ed2833a5c4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8847387106394717943a0b7e9ef3466a'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:28.592094 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-6c4ca3b6-dbdb-4bec-8b6e-9ed2833a5c4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8847387106394717943a0b7e9ef3466a'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:28.592690 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-6c4ca3b6-dbdb-4bec-8b6e-9ed2833a5c4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8847387106394717943a0b7e9ef3466a'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:28.599181 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-6c4ca3b6-dbdb-4bec-8b6e-9ed2833a5c4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8847387106394717943a0b7e9ef3466a'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:28.610312 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1338/2675] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:30:28 2022] DELETE /identity/v3/users/8847387106394717943a0b7e9ef3466a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:30:28.777027 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848393e5-99cd-4d0b-a8a4-7ed1ca452cb8 service cinder] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:28.792907 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848393e5-99cd-4d0b-a8a4-7ed1ca452cb8 service cinder] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:28.848817 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74d9578-5ec8-4bd5-8319-98707e770bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:28.849700 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d9578-5ec8-4bd5-8319-98707e770bc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:28.849978 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d9578-5ec8-4bd5-8319-98707e770bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:28.850248 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d9578-5ec8-4bd5-8319-98707e770bc3 admin admin] PATH_INFO: `/v3/projects/d1688bafa40147df941b5ee6798c6b88` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:28.851438 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74d9578-5ec8-4bd5-8319-98707e770bc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1688bafa40147df941b5ee6798c6b88)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:28.853328 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74d9578-5ec8-4bd5-8319-98707e770bc3 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:28.897084 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-c74d9578-5ec8-4bd5-8319-98707e770bc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1688bafa40147df941b5ee6798c6b88', 'request_id': 'req-c74d9578-5ec8-4bd5-8319-98707e770bc3'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:28.903035 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-c74d9578-5ec8-4bd5-8319-98707e770bc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1688bafa40147df941b5ee6798c6b88', 'request_id': 'req-c74d9578-5ec8-4bd5-8319-98707e770bc3'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:28.910596 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-c74d9578-5ec8-4bd5-8319-98707e770bc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1688bafa40147df941b5ee6798c6b88', 'request_id': 'req-c74d9578-5ec8-4bd5-8319-98707e770bc3'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:28.920495 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-c74d9578-5ec8-4bd5-8319-98707e770bc3 admin admin] The token cache is being invalidate because project d1688bafa40147df941b5ee6798c6b88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:30:28.920776 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-c74d9578-5ec8-4bd5-8319-98707e770bc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:28.921385 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-c74d9578-5ec8-4bd5-8319-98707e770bc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:28.922945 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1338/2676] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:30:28 2022] DELETE /identity/v3/projects/d1688bafa40147df941b5ee6798c6b88 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:30:28.926922 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ca3b6-dbdb-4bec-8b6e-9ed2833a5c4b admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:28.928295 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-6c4ca3b6-dbdb-4bec-8b6e-9ed2833a5c4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:28.941355 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ca3b6-dbdb-4bec-8b6e-9ed2833a5c4b admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:28.998628 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf3625-2f09-4304-bfa0-339d0ee63f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:28.999409 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf3625-2f09-4304-bfa0-339d0ee63f36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:28.999686 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf3625-2f09-4304-bfa0-339d0ee63f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:28.999957 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf3625-2f09-4304-bfa0-339d0ee63f36 admin admin] PATH_INFO: `/v3/users/2958fab76f4f464fb977b0f6c5b1c198` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:29.001117 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bf3625-2f09-4304-bfa0-339d0ee63f36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2958fab76f4f464fb977b0f6c5b1c198)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:29.003048 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bf3625-2f09-4304-bfa0-339d0ee63f36 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:29.045531 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-13bf3625-2f09-4304-bfa0-339d0ee63f36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2958fab76f4f464fb977b0f6c5b1c198'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:29.057068 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-13bf3625-2f09-4304-bfa0-339d0ee63f36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2958fab76f4f464fb977b0f6c5b1c198'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:29.057689 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-13bf3625-2f09-4304-bfa0-339d0ee63f36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2958fab76f4f464fb977b0f6c5b1c198'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:29.058314 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-13bf3625-2f09-4304-bfa0-339d0ee63f36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2958fab76f4f464fb977b0f6c5b1c198'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:29.066216 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-13bf3625-2f09-4304-bfa0-339d0ee63f36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2958fab76f4f464fb977b0f6c5b1c198'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:29.079569 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1339/2677] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:30:28 2022] DELETE /identity/v3/users/2958fab76f4f464fb977b0f6c5b1c198 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:30:29.246526 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74d9578-5ec8-4bd5-8319-98707e770bc3 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:29.248622 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-c74d9578-5ec8-4bd5-8319-98707e770bc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:29.261316 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74d9578-5ec8-4bd5-8319-98707e770bc3 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:29.322839 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f454b153-b060-45f7-9e26-c7c000637ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:29.323694 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454b153-b060-45f7-9e26-c7c000637ce0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:29.323977 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454b153-b060-45f7-9e26-c7c000637ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:29.324253 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454b153-b060-45f7-9e26-c7c000637ce0 admin admin] PATH_INFO: `/v3/projects/4ecdab1ef4e4488db912ef7ff7aa6edf` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:29.325452 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f454b153-b060-45f7-9e26-c7c000637ce0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ecdab1ef4e4488db912ef7ff7aa6edf)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:29.327360 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f454b153-b060-45f7-9e26-c7c000637ce0 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:29.371393 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-f454b153-b060-45f7-9e26-c7c000637ce0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ecdab1ef4e4488db912ef7ff7aa6edf', 'request_id': 'req-f454b153-b060-45f7-9e26-c7c000637ce0'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:29.377940 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-f454b153-b060-45f7-9e26-c7c000637ce0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ecdab1ef4e4488db912ef7ff7aa6edf', 'request_id': 'req-f454b153-b060-45f7-9e26-c7c000637ce0'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:29.384468 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-f454b153-b060-45f7-9e26-c7c000637ce0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ecdab1ef4e4488db912ef7ff7aa6edf', 'request_id': 'req-f454b153-b060-45f7-9e26-c7c000637ce0'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:29.394302 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-f454b153-b060-45f7-9e26-c7c000637ce0 admin admin] The token cache is being invalidate because project 4ecdab1ef4e4488db912ef7ff7aa6edf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:30:29.394586 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-f454b153-b060-45f7-9e26-c7c000637ce0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:29.395207 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-f454b153-b060-45f7-9e26-c7c000637ce0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:29.396726 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1339/2678] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:30:29 2022] DELETE /identity/v3/projects/4ecdab1ef4e4488db912ef7ff7aa6edf => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:30:29.401700 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4195c5-39bd-4984-be12-5d73bcefd74b None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:29.401985 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4195c5-39bd-4984-be12-5d73bcefd74b None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:29.402257 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4195c5-39bd-4984-be12-5d73bcefd74b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:29.420009 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-2a4195c5-39bd-4984-be12-5d73bcefd74b None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:30:29.421598 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-2a4195c5-39bd-4984-be12-5d73bcefd74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:29.478672 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1340/2679] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:30:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:30:29.486961 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317cca54-632d-4ca5-b69d-9ca259ee67b6 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:29.487251 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317cca54-632d-4ca5-b69d-9ca259ee67b6 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:29.487530 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317cca54-632d-4ca5-b69d-9ca259ee67b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:29.505996 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-317cca54-632d-4ca5-b69d-9ca259ee67b6 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:30:29.507874 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-317cca54-632d-4ca5-b69d-9ca259ee67b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:29.516230 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1340/2680] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:30:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:30:29.521155 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4195c5-39bd-4984-be12-5d73bcefd74b None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:29.534848 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4195c5-39bd-4984-be12-5d73bcefd74b None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:29.538223 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf903b-27fd-4b08-84a0-dcbf526d6024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:29.538909 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf903b-27fd-4b08-84a0-dcbf526d6024 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:29.539185 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf903b-27fd-4b08-84a0-dcbf526d6024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:29.539455 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacf903b-27fd-4b08-84a0-dcbf526d6024 admin admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:29.540180 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacf903b-27fd-4b08-84a0-dcbf526d6024 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:30:29.540483 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacf903b-27fd-4b08-84a0-dcbf526d6024 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:29.542122 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacf903b-27fd-4b08-84a0-dcbf526d6024 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:29.557856 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1341/2681] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 17 18:30:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:30:29.558961 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317cca54-632d-4ca5-b69d-9ca259ee67b6 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:29.568601 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317cca54-632d-4ca5-b69d-9ca259ee67b6 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:29.573255 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d14b15-5ff8-423a-893a-cd5f7928c212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:29.573927 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d14b15-5ff8-423a-893a-cd5f7928c212 admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:29.574204 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d14b15-5ff8-423a-893a-cd5f7928c212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:29.574476 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d14b15-5ff8-423a-893a-cd5f7928c212 admin admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:29.575183 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d14b15-5ff8-423a-893a-cd5f7928c212 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:29.577642 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d14b15-5ff8-423a-893a-cd5f7928c212 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:29.602297 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1341/2682] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:30:29 2022] POST /identity/v3/projects => generated 365 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:30:29.606378 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf903b-27fd-4b08-84a0-dcbf526d6024 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:29.617682 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacf903b-27fd-4b08-84a0-dcbf526d6024 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:29.677521 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f6dd3d-6085-464b-8622-7a5509e7bb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:29.678189 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6dd3d-6085-464b-8622-7a5509e7bb7c admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:29.678526 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6dd3d-6085-464b-8622-7a5509e7bb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:29.678805 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6dd3d-6085-464b-8622-7a5509e7bb7c admin admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:29.679646 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f6dd3d-6085-464b-8622-7a5509e7bb7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:29.681776 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f6dd3d-6085-464b-8622-7a5509e7bb7c admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:29.703112 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1342/2683] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:30:29 2022] POST /identity/v3/users => generated 283 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:30:29.707260 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d14b15-5ff8-423a-893a-cd5f7928c212 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:29.719659 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d14b15-5ff8-423a-893a-cd5f7928c212 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:29.726274 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da81fa-8c71-4a95-ac1c-fb71aa83f2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:29.726969 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da81fa-8c71-4a95-ac1c-fb71aa83f2ac admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:29.727272 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da81fa-8c71-4a95-ac1c-fb71aa83f2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:29.727545 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da81fa-8c71-4a95-ac1c-fb71aa83f2ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:29.728444 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6da81fa-8c71-4a95-ac1c-fb71aa83f2ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:29.730083 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6da81fa-8c71-4a95-ac1c-fb71aa83f2ac admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:29.741693 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1342/2684] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:30:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:30:29.745611 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f6dd3d-6085-464b-8622-7a5509e7bb7c admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:29.755224 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f6dd3d-6085-464b-8622-7a5509e7bb7c admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:29.760351 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab597ce4-b3d9-4dfc-a3fc-15eaeca41bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:29.760950 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab597ce4-b3d9-4dfc-a3fc-15eaeca41bb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:29.761251 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab597ce4-b3d9-4dfc-a3fc-15eaeca41bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:29.761554 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab597ce4-b3d9-4dfc-a3fc-15eaeca41bb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:29.762281 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab597ce4-b3d9-4dfc-a3fc-15eaeca41bb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:29.763874 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab597ce4-b3d9-4dfc-a3fc-15eaeca41bb0 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:29.773687 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1343/2685] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:30:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:30:29.777733 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da81fa-8c71-4a95-ac1c-fb71aa83f2ac admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:29.787746 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da81fa-8c71-4a95-ac1c-fb71aa83f2ac admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:29.792910 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d2f69a-dec7-4c93-9ae8-3d6a06a5446d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:29.793801 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2f69a-dec7-4c93-9ae8-3d6a06a5446d admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:29.794706 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2f69a-dec7-4c93-9ae8-3d6a06a5446d admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:29.794917 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2f69a-dec7-4c93-9ae8-3d6a06a5446d admin admin] PATH_INFO: `/v3/projects/3e28460556d446f5ac495a3093be49be/users/337f98930a05422f8d178f124e9d962c/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:29.810665 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d2f69a-dec7-4c93-9ae8-3d6a06a5446d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e28460556d446f5ac495a3093be49be, user_id=337f98930a05422f8d178f124e9d962c, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:29.813714 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d2f69a-dec7-4c93-9ae8-3d6a06a5446d admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:29.832467 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1343/2686] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:30:29 2022] PUT /identity/v3/projects/3e28460556d446f5ac495a3093be49be/users/337f98930a05422f8d178f124e9d962c/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:30:29.840383 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c2c5c-e83b-47d3-a39c-e09e5bff6f2c None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:29.840732 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c2c5c-e83b-47d3-a39c-e09e5bff6f2c None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:29.841638 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c2c5c-e83b-47d3-a39c-e09e5bff6f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:29.873058 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-379c2c5c-e83b-47d3-a39c-e09e5bff6f2c None None] MFA Rules not processed for user `337f98930a05422f8d178f124e9d962c`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:30:29.879966 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-379c2c5c-e83b-47d3-a39c-e09e5bff6f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:29.923675 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d2f69a-dec7-4c93-9ae8-3d6a06a5446d admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:29.925432 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-82d2f69a-dec7-4c93-9ae8-3d6a06a5446d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:29.938629 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1344/2687] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:30:29 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:30:29.943046 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c2c5c-e83b-47d3-a39c-e09e5bff6f2c None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:30.000870 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d2f69a-dec7-4c93-9ae8-3d6a06a5446d admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:30.002361 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c2c5c-e83b-47d3-a39c-e09e5bff6f2c None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:30.005428 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205bd4c6-df14-4d02-b499-6d1709359973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:30.006327 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205bd4c6-df14-4d02-b499-6d1709359973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:30.006602 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205bd4c6-df14-4d02-b499-6d1709359973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:30.006867 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205bd4c6-df14-4d02-b499-6d1709359973 admin admin] PATH_INFO: `/v3/users/73ff3888de4a4010a0ac35c5f7e14db3` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:30.007081 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba75dd-154e-4a89-bfdc-ee8d83e24c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:30.007735 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba75dd-154e-4a89-bfdc-ee8d83e24c67 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:30.008015 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba75dd-154e-4a89-bfdc-ee8d83e24c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:30.008125 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205bd4c6-df14-4d02-b499-6d1709359973 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73ff3888de4a4010a0ac35c5f7e14db3)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:30.008287 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba75dd-154e-4a89-bfdc-ee8d83e24c67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:30.008977 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba75dd-154e-4a89-bfdc-ee8d83e24c67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:30.010014 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205bd4c6-df14-4d02-b499-6d1709359973 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:30.010946 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba75dd-154e-4a89-bfdc-ee8d83e24c67 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:30.042507 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1345/2688] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:30:29 2022] POST /identity/v3/projects => generated 363 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:30:30.049364 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba75dd-154e-4a89-bfdc-ee8d83e24c67 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:30.062635 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-205bd4c6-df14-4d02-b499-6d1709359973 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73ff3888de4a4010a0ac35c5f7e14db3'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:30.069530 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-205bd4c6-df14-4d02-b499-6d1709359973 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73ff3888de4a4010a0ac35c5f7e14db3'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:30.070205 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-205bd4c6-df14-4d02-b499-6d1709359973 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73ff3888de4a4010a0ac35c5f7e14db3'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:30.078697 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-205bd4c6-df14-4d02-b499-6d1709359973 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73ff3888de4a4010a0ac35c5f7e14db3'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:30.079448 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-205bd4c6-df14-4d02-b499-6d1709359973 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73ff3888de4a4010a0ac35c5f7e14db3'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:30.097030 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1344/2689] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:30:29 2022] DELETE /identity/v3/users/73ff3888de4a4010a0ac35c5f7e14db3 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:30:30.101096 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cbcd23-b162-415f-ac7f-e9c6d6a5b29f None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:30.101381 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cbcd23-b162-415f-ac7f-e9c6d6a5b29f None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:30.101691 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cbcd23-b162-415f-ac7f-e9c6d6a5b29f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:30.115377 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba75dd-154e-4a89-bfdc-ee8d83e24c67 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:30.118326 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-c7cbcd23-b162-415f-ac7f-e9c6d6a5b29f None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:30:30.119510 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-c7cbcd23-b162-415f-ac7f-e9c6d6a5b29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:30.170500 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d25b93-d29a-4b14-a56a-ed04bebf1f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:30.171169 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d25b93-d29a-4b14-a56a-ed04bebf1f6d admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:30.171623 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d25b93-d29a-4b14-a56a-ed04bebf1f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:30.171882 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d25b93-d29a-4b14-a56a-ed04bebf1f6d admin admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:30.172553 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d25b93-d29a-4b14-a56a-ed04bebf1f6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:30.174505 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d25b93-d29a-4b14-a56a-ed04bebf1f6d admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:30.176451 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1345/2690] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:30:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:30:30.186452 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cbcd23-b162-415f-ac7f-e9c6d6a5b29f None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:30.188034 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-c7cbcd23-b162-415f-ac7f-e9c6d6a5b29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:30.195103 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1346/2691] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:30:30 2022] POST /identity/v3/users => generated 288 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:30:30.198789 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d25b93-d29a-4b14-a56a-ed04bebf1f6d admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:30.200840 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-b8d25b93-d29a-4b14-a56a-ed04bebf1f6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:30.212214 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d25b93-d29a-4b14-a56a-ed04bebf1f6d admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:30.217253 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87352d3e-27ff-4ca7-86ec-d3a7748b24f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:30.217941 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87352d3e-27ff-4ca7-86ec-d3a7748b24f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:30.218220 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87352d3e-27ff-4ca7-86ec-d3a7748b24f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:30.218491 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87352d3e-27ff-4ca7-86ec-d3a7748b24f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:30.219198 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87352d3e-27ff-4ca7-86ec-d3a7748b24f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:30.220766 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87352d3e-27ff-4ca7-86ec-d3a7748b24f9 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:30.230737 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1347/2692] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:30:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:30:30.235333 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87352d3e-27ff-4ca7-86ec-d3a7748b24f9 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:30.244642 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87352d3e-27ff-4ca7-86ec-d3a7748b24f9 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:30.246497 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cbcd23-b162-415f-ac7f-e9c6d6a5b29f None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:30.249201 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a116712a-3241-47b7-82db-79abe059d6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:30.250092 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116712a-3241-47b7-82db-79abe059d6cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:30.250225 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02bb9b9-fdd2-49fe-8a20-114ba96e5896 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:30.250365 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116712a-3241-47b7-82db-79abe059d6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:30.250620 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116712a-3241-47b7-82db-79abe059d6cf admin admin] PATH_INFO: `/v3/projects/d607aa4d6752439db22081ed213e48d6/users/e04c6eb64aed471e8b08dc7ed97525b5/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:30.250789 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02bb9b9-fdd2-49fe-8a20-114ba96e5896 service neutron] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:30.251067 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02bb9b9-fdd2-49fe-8a20-114ba96e5896 service neutron] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:30.251397 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02bb9b9-fdd2-49fe-8a20-114ba96e5896 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:30.260380 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02bb9b9-fdd2-49fe-8a20-114ba96e5896 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:30.261908 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02bb9b9-fdd2-49fe-8a20-114ba96e5896 service neutron] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:30.265795 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a116712a-3241-47b7-82db-79abe059d6cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d607aa4d6752439db22081ed213e48d6, user_id=e04c6eb64aed471e8b08dc7ed97525b5, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:30.268368 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a116712a-3241-47b7-82db-79abe059d6cf admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:30.272129 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1346/2693] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:30:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:30:30.282761 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1348/2694] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:30:30 2022] PUT /identity/v3/projects/d607aa4d6752439db22081ed213e48d6/users/e04c6eb64aed471e8b08dc7ed97525b5/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:30:30.286450 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02bb9b9-fdd2-49fe-8a20-114ba96e5896 service neutron] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:30.296052 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02bb9b9-fdd2-49fe-8a20-114ba96e5896 service neutron] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:30.361963 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a593a9a8-c0b0-46cd-94b2-ce1e00e4ad19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:30.363067 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593a9a8-c0b0-46cd-94b2-ce1e00e4ad19 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:30.363348 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593a9a8-c0b0-46cd-94b2-ce1e00e4ad19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:30.363617 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593a9a8-c0b0-46cd-94b2-ce1e00e4ad19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:30.364380 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a593a9a8-c0b0-46cd-94b2-ce1e00e4ad19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:30.366285 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a593a9a8-c0b0-46cd-94b2-ce1e00e4ad19 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:30.381201 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1347/2695] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:30:30 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:30:30.382376 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a116712a-3241-47b7-82db-79abe059d6cf admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:30.392931 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a116712a-3241-47b7-82db-79abe059d6cf admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:30.397815 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f7c3c4-352c-4f4f-a110-12b60ff54dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:30.398675 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f7c3c4-352c-4f4f-a110-12b60ff54dae admin admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:30.398951 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f7c3c4-352c-4f4f-a110-12b60ff54dae admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:30.399217 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f7c3c4-352c-4f4f-a110-12b60ff54dae admin admin] PATH_INFO: `/v3/projects/d607aa4d6752439db22081ed213e48d6/users/e04c6eb64aed471e8b08dc7ed97525b5/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:30.401140 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f7c3c4-352c-4f4f-a110-12b60ff54dae admin admin] RBAC: Authorizing `identity:create_grant(project_id=d607aa4d6752439db22081ed213e48d6, user_id=e04c6eb64aed471e8b08dc7ed97525b5, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:30.404416 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f7c3c4-352c-4f4f-a110-12b60ff54dae admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:30.418651 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1349/2696] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:30:30 2022] PUT /identity/v3/projects/d607aa4d6752439db22081ed213e48d6/users/e04c6eb64aed471e8b08dc7ed97525b5/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:30:30.430202 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472b816-93da-4ec0-9f8a-0a2826925dc5 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:30.430488 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472b816-93da-4ec0-9f8a-0a2826925dc5 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:30.430756 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5472b816-93da-4ec0-9f8a-0a2826925dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:30.458529 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-5472b816-93da-4ec0-9f8a-0a2826925dc5 None None] MFA Rules not processed for user `e04c6eb64aed471e8b08dc7ed97525b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:30:30.459811 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-5472b816-93da-4ec0-9f8a-0a2826925dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:30.533633 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1348/2697] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:30:30 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:30:30.541128 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f7c3c4-352c-4f4f-a110-12b60ff54dae admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:30.542978 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-06f7c3c4-352c-4f4f-a110-12b60ff54dae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:30.546103 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5472b816-93da-4ec0-9f8a-0a2826925dc5 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:30.547433 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-5472b816-93da-4ec0-9f8a-0a2826925dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:30.607610 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f7c3c4-352c-4f4f-a110-12b60ff54dae admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:30.611793 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ce6d10-83e3-4256-bf8e-be112e11e6fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:30.612824 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce6d10-83e3-4256-bf8e-be112e11e6fd service cinder] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:30.613246 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce6d10-83e3-4256-bf8e-be112e11e6fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:30.613550 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce6d10-83e3-4256-bf8e-be112e11e6fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:30.615817 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5472b816-93da-4ec0-9f8a-0a2826925dc5 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:30.621857 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46933c50-c8af-4467-9a3b-4cc3debc889a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:30.623972 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46933c50-c8af-4467-9a3b-4cc3debc889a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:30.624251 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46933c50-c8af-4467-9a3b-4cc3debc889a admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:30.624780 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46933c50-c8af-4467-9a3b-4cc3debc889a admin admin] PATH_INFO: `/v3/projects/0e3ea2e3f9ea4b5e9c759054207cc455` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:30.627906 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ce6d10-83e3-4256-bf8e-be112e11e6fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:30.628204 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46933c50-c8af-4467-9a3b-4cc3debc889a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e3ea2e3f9ea4b5e9c759054207cc455)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:30.630179 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46933c50-c8af-4467-9a3b-4cc3debc889a admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:30.630306 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ce6d10-83e3-4256-bf8e-be112e11e6fd service cinder] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:30.641302 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1350/2698] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:30:30 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:30:30.684124 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-46933c50-c8af-4467-9a3b-4cc3debc889a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e3ea2e3f9ea4b5e9c759054207cc455', 'request_id': 'req-46933c50-c8af-4467-9a3b-4cc3debc889a'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:30.691089 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-46933c50-c8af-4467-9a3b-4cc3debc889a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e3ea2e3f9ea4b5e9c759054207cc455', 'request_id': 'req-46933c50-c8af-4467-9a3b-4cc3debc889a'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:30.699097 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-46933c50-c8af-4467-9a3b-4cc3debc889a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e3ea2e3f9ea4b5e9c759054207cc455', 'request_id': 'req-46933c50-c8af-4467-9a3b-4cc3debc889a'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:30.710460 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-46933c50-c8af-4467-9a3b-4cc3debc889a admin admin] The token cache is being invalidate because project 0e3ea2e3f9ea4b5e9c759054207cc455 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:30:30.710749 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-46933c50-c8af-4467-9a3b-4cc3debc889a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:30.711741 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-46933c50-c8af-4467-9a3b-4cc3debc889a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:30.713495 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1349/2699] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:30:30 2022] DELETE /identity/v3/projects/0e3ea2e3f9ea4b5e9c759054207cc455 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:30:30.717226 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ce6d10-83e3-4256-bf8e-be112e11e6fd service cinder] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:30.719292 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46933c50-c8af-4467-9a3b-4cc3debc889a admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:30.720604 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-46933c50-c8af-4467-9a3b-4cc3debc889a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:30.727778 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ce6d10-83e3-4256-bf8e-be112e11e6fd service cinder] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:30.776327 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46933c50-c8af-4467-9a3b-4cc3debc889a admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:30.780431 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2807df3e-d6ca-4ee2-9741-5333378bcb3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:30.781071 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807df3e-d6ca-4ee2-9741-5333378bcb3c service cinder] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:30.781346 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807df3e-d6ca-4ee2-9741-5333378bcb3c service cinder] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:30.781647 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807df3e-d6ca-4ee2-9741-5333378bcb3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:30.782556 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fcdbd6-3147-4e14-87f2-d36c13cc3c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:30.783404 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-2807df3e-d6ca-4ee2-9741-5333378bcb3c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:30.783555 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fcdbd6-3147-4e14-87f2-d36c13cc3c4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:30.783790 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fcdbd6-3147-4e14-87f2-d36c13cc3c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:30.783964 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fcdbd6-3147-4e14-87f2-d36c13cc3c4b admin admin] PATH_INFO: `/v3/users/469850ebd6e3442b8a13e6a50eeccfa9` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:30.785107 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fcdbd6-3147-4e14-87f2-d36c13cc3c4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=469850ebd6e3442b8a13e6a50eeccfa9)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:30.787043 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fcdbd6-3147-4e14-87f2-d36c13cc3c4b admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:30.833893 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-d4fcdbd6-3147-4e14-87f2-d36c13cc3c4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '469850ebd6e3442b8a13e6a50eeccfa9'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:30.844072 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2807df3e-d6ca-4ee2-9741-5333378bcb3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:30.845620 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2807df3e-d6ca-4ee2-9741-5333378bcb3c service cinder] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:30.847854 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-d4fcdbd6-3147-4e14-87f2-d36c13cc3c4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '469850ebd6e3442b8a13e6a50eeccfa9'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:30.848598 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-d4fcdbd6-3147-4e14-87f2-d36c13cc3c4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '469850ebd6e3442b8a13e6a50eeccfa9'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:30.849209 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-d4fcdbd6-3147-4e14-87f2-d36c13cc3c4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '469850ebd6e3442b8a13e6a50eeccfa9'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:30.854872 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1350/2700] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:30:30 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:30:30.857533 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-d4fcdbd6-3147-4e14-87f2-d36c13cc3c4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '469850ebd6e3442b8a13e6a50eeccfa9'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:30.874156 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1351/2701] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:30:30 2022] DELETE /identity/v3/users/469850ebd6e3442b8a13e6a50eeccfa9 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:30:31.182251 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2807df3e-d6ca-4ee2-9741-5333378bcb3c service cinder] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:31.184564 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-2807df3e-d6ca-4ee2-9741-5333378bcb3c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:31.201131 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2807df3e-d6ca-4ee2-9741-5333378bcb3c service cinder] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:31.273604 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a0268-6ad1-40b0-a706-63e75070d25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:31.274497 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a0268-6ad1-40b0-a706-63e75070d25b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:31.274778 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a0268-6ad1-40b0-a706-63e75070d25b admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:31.275329 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a0268-6ad1-40b0-a706-63e75070d25b admin admin] PATH_INFO: `/v3/projects/1c9ea3c1b7e9473999f8630d3574f7a4` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:31.276396 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968a0268-6ad1-40b0-a706-63e75070d25b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c9ea3c1b7e9473999f8630d3574f7a4)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:31.278931 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968a0268-6ad1-40b0-a706-63e75070d25b admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:31.328799 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-968a0268-6ad1-40b0-a706-63e75070d25b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c9ea3c1b7e9473999f8630d3574f7a4', 'request_id': 'req-968a0268-6ad1-40b0-a706-63e75070d25b'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:31.334950 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-968a0268-6ad1-40b0-a706-63e75070d25b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c9ea3c1b7e9473999f8630d3574f7a4', 'request_id': 'req-968a0268-6ad1-40b0-a706-63e75070d25b'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:31.342819 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-968a0268-6ad1-40b0-a706-63e75070d25b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c9ea3c1b7e9473999f8630d3574f7a4', 'request_id': 'req-968a0268-6ad1-40b0-a706-63e75070d25b'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:31.353496 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-968a0268-6ad1-40b0-a706-63e75070d25b admin admin] The token cache is being invalidate because project 1c9ea3c1b7e9473999f8630d3574f7a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:30:31.353722 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-968a0268-6ad1-40b0-a706-63e75070d25b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:31.354349 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-968a0268-6ad1-40b0-a706-63e75070d25b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:31.355887 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1351/2702] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:30:31 2022] DELETE /identity/v3/projects/1c9ea3c1b7e9473999f8630d3574f7a4 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:30:31.360529 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fcdbd6-3147-4e14-87f2-d36c13cc3c4b admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:31.362042 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-d4fcdbd6-3147-4e14-87f2-d36c13cc3c4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:31.377754 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fcdbd6-3147-4e14-87f2-d36c13cc3c4b admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:31.433522 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cc2061-6220-4c6f-8b40-33519510ef1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:31.434387 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc2061-6220-4c6f-8b40-33519510ef1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:31.434667 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc2061-6220-4c6f-8b40-33519510ef1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:31.434975 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc2061-6220-4c6f-8b40-33519510ef1e admin admin] PATH_INFO: `/v3/users/77d6c4d3af5145eb9e1a62a2f00c489d` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:31.436109 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cc2061-6220-4c6f-8b40-33519510ef1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=77d6c4d3af5145eb9e1a62a2f00c489d)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:31.438156 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cc2061-6220-4c6f-8b40-33519510ef1e admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:31.485924 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-22cc2061-6220-4c6f-8b40-33519510ef1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77d6c4d3af5145eb9e1a62a2f00c489d'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:31.497438 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-22cc2061-6220-4c6f-8b40-33519510ef1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77d6c4d3af5145eb9e1a62a2f00c489d'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:31.498124 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-22cc2061-6220-4c6f-8b40-33519510ef1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77d6c4d3af5145eb9e1a62a2f00c489d'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:31.498718 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-22cc2061-6220-4c6f-8b40-33519510ef1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77d6c4d3af5145eb9e1a62a2f00c489d'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:31.505378 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-22cc2061-6220-4c6f-8b40-33519510ef1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77d6c4d3af5145eb9e1a62a2f00c489d'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:31.519276 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1352/2703] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:30:31 2022] DELETE /identity/v3/users/77d6c4d3af5145eb9e1a62a2f00c489d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:30:31.801278 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a0268-6ad1-40b0-a706-63e75070d25b admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:31.802784 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-968a0268-6ad1-40b0-a706-63e75070d25b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:31.819638 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a0268-6ad1-40b0-a706-63e75070d25b admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:31.889588 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b82bad-b855-47b8-a900-96cf6c561c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:31.890536 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b82bad-b855-47b8-a900-96cf6c561c9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:31.890820 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b82bad-b855-47b8-a900-96cf6c561c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:31.891090 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b82bad-b855-47b8-a900-96cf6c561c9d admin admin] PATH_INFO: `/v3/projects/101c0abc6fc448979601668368cd3534` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:31.892292 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b82bad-b855-47b8-a900-96cf6c561c9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=101c0abc6fc448979601668368cd3534)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:31.894250 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b82bad-b855-47b8-a900-96cf6c561c9d admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:31.940151 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-d1b82bad-b855-47b8-a900-96cf6c561c9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '101c0abc6fc448979601668368cd3534', 'request_id': 'req-d1b82bad-b855-47b8-a900-96cf6c561c9d'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:31.946843 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-d1b82bad-b855-47b8-a900-96cf6c561c9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '101c0abc6fc448979601668368cd3534', 'request_id': 'req-d1b82bad-b855-47b8-a900-96cf6c561c9d'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:31.955366 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-d1b82bad-b855-47b8-a900-96cf6c561c9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '101c0abc6fc448979601668368cd3534', 'request_id': 'req-d1b82bad-b855-47b8-a900-96cf6c561c9d'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:31.967139 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-d1b82bad-b855-47b8-a900-96cf6c561c9d admin admin] The token cache is being invalidate because project 101c0abc6fc448979601668368cd3534 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:30:31.967427 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-d1b82bad-b855-47b8-a900-96cf6c561c9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:31.968125 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-d1b82bad-b855-47b8-a900-96cf6c561c9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:31.969952 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1352/2704] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:30:31 2022] DELETE /identity/v3/projects/101c0abc6fc448979601668368cd3534 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:30:31.975679 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69aaf6-9a9d-4c52-bc64-2a7f24aec168 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:31.976160 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69aaf6-9a9d-4c52-bc64-2a7f24aec168 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:31.976267 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69aaf6-9a9d-4c52-bc64-2a7f24aec168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:31.994411 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-be69aaf6-9a9d-4c52-bc64-2a7f24aec168 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:30:31.995614 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-be69aaf6-9a9d-4c52-bc64-2a7f24aec168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:32.059183 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1353/2705] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:30:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:30:32.068191 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df7242-4f66-4c9e-8bb3-6eb6932257a4 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:32.068447 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df7242-4f66-4c9e-8bb3-6eb6932257a4 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:32.068724 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df7242-4f66-4c9e-8bb3-6eb6932257a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:32.087888 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-99df7242-4f66-4c9e-8bb3-6eb6932257a4 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:30:32.089098 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-99df7242-4f66-4c9e-8bb3-6eb6932257a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:32.097592 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1353/2706] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:30:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:30:32.101992 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69aaf6-9a9d-4c52-bc64-2a7f24aec168 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:32.111791 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69aaf6-9a9d-4c52-bc64-2a7f24aec168 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:32.117579 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22f7139-9c1f-4189-a027-512819440855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:32.118237 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f7139-9c1f-4189-a027-512819440855 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:32.118683 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f7139-9c1f-4189-a027-512819440855 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:32.118962 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22f7139-9c1f-4189-a027-512819440855 admin admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:32.120311 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22f7139-9c1f-4189-a027-512819440855 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:30:32.120843 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22f7139-9c1f-4189-a027-512819440855 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:32.123018 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22f7139-9c1f-4189-a027-512819440855 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:32.137529 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1354/2707] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 17 18:30:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:30:32.141444 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99df7242-4f66-4c9e-8bb3-6eb6932257a4 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:32.152053 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99df7242-4f66-4c9e-8bb3-6eb6932257a4 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:32.158354 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35966e2f-dddf-457a-9590-3f0dd4436d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:32.160038 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35966e2f-dddf-457a-9590-3f0dd4436d5d admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:32.160038 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35966e2f-dddf-457a-9590-3f0dd4436d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:32.160038 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35966e2f-dddf-457a-9590-3f0dd4436d5d admin admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:32.161726 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35966e2f-dddf-457a-9590-3f0dd4436d5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:32.163776 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35966e2f-dddf-457a-9590-3f0dd4436d5d admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:32.192747 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1354/2708] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:30:32 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:30:32.196998 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22f7139-9c1f-4189-a027-512819440855 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:32.210277 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22f7139-9c1f-4189-a027-512819440855 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:32.277855 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfefd5b1-f66c-425f-bc43-ea070e4815a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:32.278807 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfefd5b1-f66c-425f-bc43-ea070e4815a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:32.279093 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfefd5b1-f66c-425f-bc43-ea070e4815a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:32.279398 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfefd5b1-f66c-425f-bc43-ea070e4815a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:32.280087 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfefd5b1-f66c-425f-bc43-ea070e4815a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:32.282019 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfefd5b1-f66c-425f-bc43-ea070e4815a8 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:32.303631 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1355/2709] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:30:32 2022] POST /identity/v3/users => generated 289 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:30:32.307915 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35966e2f-dddf-457a-9590-3f0dd4436d5d admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:32.319663 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35966e2f-dddf-457a-9590-3f0dd4436d5d admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:32.331246 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d707e-c99e-44d5-8fb2-22c54742ce7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:32.333313 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d707e-c99e-44d5-8fb2-22c54742ce7e admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:32.333968 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d707e-c99e-44d5-8fb2-22c54742ce7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:32.334310 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d707e-c99e-44d5-8fb2-22c54742ce7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:32.335119 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d707e-c99e-44d5-8fb2-22c54742ce7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:32.338997 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d707e-c99e-44d5-8fb2-22c54742ce7e admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:32.352256 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1355/2710] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:30:32.357999 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfefd5b1-f66c-425f-bc43-ea070e4815a8 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:32.369678 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfefd5b1-f66c-425f-bc43-ea070e4815a8 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:32.381959 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d084f25f-bbc4-4dc3-981e-d4b3428bcb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:32.382702 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084f25f-bbc4-4dc3-981e-d4b3428bcb18 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:32.383076 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084f25f-bbc4-4dc3-981e-d4b3428bcb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:32.383406 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084f25f-bbc4-4dc3-981e-d4b3428bcb18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:32.384408 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d084f25f-bbc4-4dc3-981e-d4b3428bcb18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:32.387387 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d084f25f-bbc4-4dc3-981e-d4b3428bcb18 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:32.401341 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1356/2711] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:30:32.405545 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d707e-c99e-44d5-8fb2-22c54742ce7e admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:32.416743 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d707e-c99e-44d5-8fb2-22c54742ce7e admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:32.426763 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc706d6-7d55-496f-a35a-729b73a4a9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:32.427658 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc706d6-7d55-496f-a35a-729b73a4a9a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:32.427935 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc706d6-7d55-496f-a35a-729b73a4a9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:32.428204 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc706d6-7d55-496f-a35a-729b73a4a9a5 admin admin] PATH_INFO: `/v3/projects/62668af976ef44dc82554e6303faa24d/users/f5eed2e09b2b467ca8a979e8c140ea3b/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:32.450885 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc706d6-7d55-496f-a35a-729b73a4a9a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62668af976ef44dc82554e6303faa24d, user_id=f5eed2e09b2b467ca8a979e8c140ea3b, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:32.453927 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc706d6-7d55-496f-a35a-729b73a4a9a5 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:32.468015 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1356/2712] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:30:32 2022] PUT /identity/v3/projects/62668af976ef44dc82554e6303faa24d/users/f5eed2e09b2b467ca8a979e8c140ea3b/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:30:32.480317 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375fa25b-67d9-40d6-96ec-75f7ae4823b2 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:32.480607 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375fa25b-67d9-40d6-96ec-75f7ae4823b2 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:32.480888 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375fa25b-67d9-40d6-96ec-75f7ae4823b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:32.509262 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-375fa25b-67d9-40d6-96ec-75f7ae4823b2 None None] MFA Rules not processed for user `f5eed2e09b2b467ca8a979e8c140ea3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:30:32.510617 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-375fa25b-67d9-40d6-96ec-75f7ae4823b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:32.576843 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1357/2713] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:30:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:30:32.581835 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc706d6-7d55-496f-a35a-729b73a4a9a5 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:32.644031 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc706d6-7d55-496f-a35a-729b73a4a9a5 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:32.648598 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a77d4c9-e84f-406c-b8ec-dec2ccc08a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:32.649249 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77d4c9-e84f-406c-b8ec-dec2ccc08a7b admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:32.649559 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77d4c9-e84f-406c-b8ec-dec2ccc08a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:32.649834 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77d4c9-e84f-406c-b8ec-dec2ccc08a7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:32.650520 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a77d4c9-e84f-406c-b8ec-dec2ccc08a7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:32.652538 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a77d4c9-e84f-406c-b8ec-dec2ccc08a7b admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:32.681572 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1357/2714] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:30:32 2022] POST /identity/v3/projects => generated 375 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:30:32.683165 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375fa25b-67d9-40d6-96ec-75f7ae4823b2 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:32.693843 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375fa25b-67d9-40d6-96ec-75f7ae4823b2 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:32.751110 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37738fa1-224a-477a-a1c1-90d3cd5bde04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:32.751784 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37738fa1-224a-477a-a1c1-90d3cd5bde04 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:32.752065 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37738fa1-224a-477a-a1c1-90d3cd5bde04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:32.752341 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37738fa1-224a-477a-a1c1-90d3cd5bde04 admin admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:32.753036 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37738fa1-224a-477a-a1c1-90d3cd5bde04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:32.755022 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37738fa1-224a-477a-a1c1-90d3cd5bde04 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:32.775044 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1358/2715] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:30:32 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:30:32.779729 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a77d4c9-e84f-406c-b8ec-dec2ccc08a7b admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:32.790277 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a77d4c9-e84f-406c-b8ec-dec2ccc08a7b admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:32.796251 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247add07-719c-4ca0-be77-c02f0027e97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:32.796914 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247add07-719c-4ca0-be77-c02f0027e97c admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:32.797198 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247add07-719c-4ca0-be77-c02f0027e97c admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:32.797561 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247add07-719c-4ca0-be77-c02f0027e97c admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:32.798296 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247add07-719c-4ca0-be77-c02f0027e97c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:32.799886 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247add07-719c-4ca0-be77-c02f0027e97c admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:32.810828 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1358/2716] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:30:32.814952 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37738fa1-224a-477a-a1c1-90d3cd5bde04 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:32.826815 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37738fa1-224a-477a-a1c1-90d3cd5bde04 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:32.832261 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f8111-1875-4e0d-a71a-f52966c8672d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:32.833022 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f8111-1875-4e0d-a71a-f52966c8672d admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:32.833362 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f8111-1875-4e0d-a71a-f52966c8672d admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:32.833664 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f8111-1875-4e0d-a71a-f52966c8672d admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:32.834505 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02f8111-1875-4e0d-a71a-f52966c8672d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:32.836187 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02f8111-1875-4e0d-a71a-f52966c8672d admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:32.847423 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1359/2717] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:30:32.852069 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247add07-719c-4ca0-be77-c02f0027e97c admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:32.862913 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247add07-719c-4ca0-be77-c02f0027e97c admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:32.869236 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1bddc8-ef3e-4da7-9bdc-fa08f550b90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:32.870224 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1bddc8-ef3e-4da7-9bdc-fa08f550b90b admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:32.870595 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1bddc8-ef3e-4da7-9bdc-fa08f550b90b admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:32.870872 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1bddc8-ef3e-4da7-9bdc-fa08f550b90b admin admin] PATH_INFO: `/v3/projects/c9bdde99ff6c4a56ab835f1d4fe00ff5/users/cfae4d8818eb4d3e8099219f229277d8/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:32.887112 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1bddc8-ef3e-4da7-9bdc-fa08f550b90b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9bdde99ff6c4a56ab835f1d4fe00ff5, user_id=cfae4d8818eb4d3e8099219f229277d8, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:32.889911 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1bddc8-ef3e-4da7-9bdc-fa08f550b90b admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:32.904927 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1359/2718] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:30:32 2022] PUT /identity/v3/projects/c9bdde99ff6c4a56ab835f1d4fe00ff5/users/cfae4d8818eb4d3e8099219f229277d8/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:30:32.915123 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e123b28-a95c-45ec-836e-abd0f062d718 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:32.915417 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e123b28-a95c-45ec-836e-abd0f062d718 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:32.915696 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e123b28-a95c-45ec-836e-abd0f062d718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:32.944160 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-6e123b28-a95c-45ec-836e-abd0f062d718 None None] MFA Rules not processed for user `cfae4d8818eb4d3e8099219f229277d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:30:32.945377 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-6e123b28-a95c-45ec-836e-abd0f062d718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:33.012831 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1360/2719] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:30:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:30:33.017443 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1bddc8-ef3e-4da7-9bdc-fa08f550b90b admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:33.083985 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1bddc8-ef3e-4da7-9bdc-fa08f550b90b admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:33.089419 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab44732-be0e-450e-bfe9-0c02ba10f848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:33.090183 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab44732-be0e-450e-bfe9-0c02ba10f848 admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:33.090499 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab44732-be0e-450e-bfe9-0c02ba10f848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:33.091581 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab44732-be0e-450e-bfe9-0c02ba10f848 admin admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:33.092025 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab44732-be0e-450e-bfe9-0c02ba10f848 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:33.093952 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab44732-be0e-450e-bfe9-0c02ba10f848 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:33.120236 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1360/2720] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:30:33 2022] POST /identity/v3/projects => generated 377 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:30:33.124366 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e123b28-a95c-45ec-836e-abd0f062d718 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:33.135714 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e123b28-a95c-45ec-836e-abd0f062d718 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:33.192911 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b24b3-f326-4755-8ed2-029ea8f627cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:33.193566 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b24b3-f326-4755-8ed2-029ea8f627cf admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:33.193849 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b24b3-f326-4755-8ed2-029ea8f627cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:33.194119 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b24b3-f326-4755-8ed2-029ea8f627cf admin admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:33.194820 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2b24b3-f326-4755-8ed2-029ea8f627cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:33.196729 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2b24b3-f326-4755-8ed2-029ea8f627cf admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:33.219396 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1361/2721] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:30:33 2022] POST /identity/v3/users => generated 295 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:30:33.223400 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab44732-be0e-450e-bfe9-0c02ba10f848 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:33.234042 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab44732-be0e-450e-bfe9-0c02ba10f848 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:33.239040 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5153ac-80bb-46ca-8c84-b0619c167429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:33.240036 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5153ac-80bb-46ca-8c84-b0619c167429 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:33.240320 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5153ac-80bb-46ca-8c84-b0619c167429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:33.240596 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5153ac-80bb-46ca-8c84-b0619c167429 admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:33.241323 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5153ac-80bb-46ca-8c84-b0619c167429 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:33.242985 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5153ac-80bb-46ca-8c84-b0619c167429 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:33.254001 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1361/2722] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:30:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:30:33.258280 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b24b3-f326-4755-8ed2-029ea8f627cf admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:33.269050 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b24b3-f326-4755-8ed2-029ea8f627cf admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:33.274091 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3777f1-5e49-4a8e-a8e5-c034d09cff53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:33.275073 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3777f1-5e49-4a8e-a8e5-c034d09cff53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:33.275488 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3777f1-5e49-4a8e-a8e5-c034d09cff53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:33.275726 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3777f1-5e49-4a8e-a8e5-c034d09cff53 admin admin] PATH_INFO: `/v3/projects/dea4f1990cbb455383cb4230cf65584a/users/be1ed50028cb4c0f922b83ec0e07cf34/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:33.292154 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3777f1-5e49-4a8e-a8e5-c034d09cff53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dea4f1990cbb455383cb4230cf65584a, user_id=be1ed50028cb4c0f922b83ec0e07cf34, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:33.295031 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3777f1-5e49-4a8e-a8e5-c034d09cff53 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:33.308335 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1362/2723] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:30:33 2022] PUT /identity/v3/projects/dea4f1990cbb455383cb4230cf65584a/users/be1ed50028cb4c0f922b83ec0e07cf34/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:30:33.312137 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5153ac-80bb-46ca-8c84-b0619c167429 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:33.322699 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5153ac-80bb-46ca-8c84-b0619c167429 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:33.380738 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6453b0eb-7419-40ef-8c18-ca84c1a59a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:33.381487 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453b0eb-7419-40ef-8c18-ca84c1a59a7e admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:33.381846 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453b0eb-7419-40ef-8c18-ca84c1a59a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:33.382194 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6453b0eb-7419-40ef-8c18-ca84c1a59a7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:33.382993 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6453b0eb-7419-40ef-8c18-ca84c1a59a7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:33.384627 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6453b0eb-7419-40ef-8c18-ca84c1a59a7e admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:33.395311 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1362/2724] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:30:33 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:30:33.399651 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3777f1-5e49-4a8e-a8e5-c034d09cff53 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:33.410712 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3777f1-5e49-4a8e-a8e5-c034d09cff53 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:33.415487 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde1d71-db4a-4c14-832f-a3f46735a258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:33.416356 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde1d71-db4a-4c14-832f-a3f46735a258 admin admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:33.416636 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde1d71-db4a-4c14-832f-a3f46735a258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:33.416915 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde1d71-db4a-4c14-832f-a3f46735a258 admin admin] PATH_INFO: `/v3/projects/dea4f1990cbb455383cb4230cf65584a/users/be1ed50028cb4c0f922b83ec0e07cf34/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:33.418992 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfde1d71-db4a-4c14-832f-a3f46735a258 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dea4f1990cbb455383cb4230cf65584a, user_id=be1ed50028cb4c0f922b83ec0e07cf34, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:33.421665 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfde1d71-db4a-4c14-832f-a3f46735a258 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:33.431913 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1363/2725] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:30:33 2022] PUT /identity/v3/projects/dea4f1990cbb455383cb4230cf65584a/users/be1ed50028cb4c0f922b83ec0e07cf34/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:30:33.444480 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be63d7-0b88-4efc-b57e-55110e1a4554 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:33.444772 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be63d7-0b88-4efc-b57e-55110e1a4554 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:33.444984 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be63d7-0b88-4efc-b57e-55110e1a4554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:33.479572 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-13be63d7-0b88-4efc-b57e-55110e1a4554 None None] MFA Rules not processed for user `be1ed50028cb4c0f922b83ec0e07cf34`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:30:33.480774 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-13be63d7-0b88-4efc-b57e-55110e1a4554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:33.558162 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1363/2726] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:30:33 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:30:33.570993 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde1d71-db4a-4c14-832f-a3f46735a258 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:33.572807 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-cfde1d71-db4a-4c14-832f-a3f46735a258 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:33.637350 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde1d71-db4a-4c14-832f-a3f46735a258 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:33.650181 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021207d-f456-41b3-b73a-3b7a4a9fcece service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:33.650840 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021207d-f456-41b3-b73a-3b7a4a9fcece service cinder] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:33.651199 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021207d-f456-41b3-b73a-3b7a4a9fcece service cinder] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:33.651945 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021207d-f456-41b3-b73a-3b7a4a9fcece service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:33.666782 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b021207d-f456-41b3-b73a-3b7a4a9fcece service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:33.668379 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b021207d-f456-41b3-b73a-3b7a4a9fcece service cinder] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:33.690877 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1364/2727] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:30:33 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:30:33.728595 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be63d7-0b88-4efc-b57e-55110e1a4554 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:33.743751 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be63d7-0b88-4efc-b57e-55110e1a4554 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:33.748192 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7bc3b3-c78b-4891-82e1-63fe3f5d25cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:33.748876 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7bc3b3-c78b-4891-82e1-63fe3f5d25cf service cinder] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:33.749126 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7bc3b3-c78b-4891-82e1-63fe3f5d25cf service cinder] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:33.749402 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7bc3b3-c78b-4891-82e1-63fe3f5d25cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:33.818084 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7bc3b3-c78b-4891-82e1-63fe3f5d25cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:33.819349 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7bc3b3-c78b-4891-82e1-63fe3f5d25cf service cinder] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:33.830016 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1364/2728] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:30:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:30:39.832444 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021207d-f456-41b3-b73a-3b7a4a9fcece service cinder] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:39.834320 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-b021207d-f456-41b3-b73a-3b7a4a9fcece service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:39.932683 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021207d-f456-41b3-b73a-3b7a4a9fcece service cinder] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:39.937936 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20be11f1-c38a-4a61-88d0-2e20f13b6471 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ddf11ac3e14d03b1159868b3b73fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:39.938573 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be11f1-c38a-4a61-88d0-2e20f13b6471 service placement] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:39.938857 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be11f1-c38a-4a61-88d0-2e20f13b6471 service placement] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:39.939132 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be11f1-c38a-4a61-88d0-2e20f13b6471 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:39.940898 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-20be11f1-c38a-4a61-88d0-2e20f13b6471 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:39.954607 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20be11f1-c38a-4a61-88d0-2e20f13b6471 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:39.956322 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20be11f1-c38a-4a61-88d0-2e20f13b6471 service placement] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:39.968218 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1365/2729] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:30:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:30:40.922025 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7bc3b3-c78b-4891-82e1-63fe3f5d25cf service cinder] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:40.984331 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7bc3b3-c78b-4891-82e1-63fe3f5d25cf service cinder] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:40.989086 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3baa8f-1d42-45e1-89e8-0d92058b140e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:40.989998 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3baa8f-1d42-45e1-89e8-0d92058b140e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:40.990288 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3baa8f-1d42-45e1-89e8-0d92058b140e admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:40.990583 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3baa8f-1d42-45e1-89e8-0d92058b140e admin admin] PATH_INFO: `/v3/users/f5eed2e09b2b467ca8a979e8c140ea3b` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:40.991897 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3baa8f-1d42-45e1-89e8-0d92058b140e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5eed2e09b2b467ca8a979e8c140ea3b)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:40.993896 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3baa8f-1d42-45e1-89e8-0d92058b140e admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:41.048240 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-1d3baa8f-1d42-45e1-89e8-0d92058b140e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5eed2e09b2b467ca8a979e8c140ea3b'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:41.055025 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-1d3baa8f-1d42-45e1-89e8-0d92058b140e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5eed2e09b2b467ca8a979e8c140ea3b'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:41.055684 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-1d3baa8f-1d42-45e1-89e8-0d92058b140e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5eed2e09b2b467ca8a979e8c140ea3b'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:41.064097 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-1d3baa8f-1d42-45e1-89e8-0d92058b140e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5eed2e09b2b467ca8a979e8c140ea3b'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:41.064725 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-1d3baa8f-1d42-45e1-89e8-0d92058b140e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5eed2e09b2b467ca8a979e8c140ea3b'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:41.082418 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1365/2730] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:30:40 2022] DELETE /identity/v3/users/f5eed2e09b2b467ca8a979e8c140ea3b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:30:41.086898 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfaf7e2-6a9a-4849-9a8d-830e6b0c1b1a None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:41.087365 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfaf7e2-6a9a-4849-9a8d-830e6b0c1b1a None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:41.087572 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfaf7e2-6a9a-4849-9a8d-830e6b0c1b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:41.104482 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-5dfaf7e2-6a9a-4849-9a8d-830e6b0c1b1a None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:30:41.105718 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-5dfaf7e2-6a9a-4849-9a8d-830e6b0c1b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:41.162050 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1366/2731] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:30:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:30:41.172368 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3baa8f-1d42-45e1-89e8-0d92058b140e admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:41.173819 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-1d3baa8f-1d42-45e1-89e8-0d92058b140e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:41.233098 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3baa8f-1d42-45e1-89e8-0d92058b140e admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:41.237057 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d3d2f-e0f4-4e12-94a5-492652fb2348 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:41.237818 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d3d2f-e0f4-4e12-94a5-492652fb2348 service neutron] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:41.238087 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d3d2f-e0f4-4e12-94a5-492652fb2348 service neutron] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:41.238360 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d3d2f-e0f4-4e12-94a5-492652fb2348 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:41.248192 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d3d2f-e0f4-4e12-94a5-492652fb2348 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:41.249699 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0d3d2f-e0f4-4e12-94a5-492652fb2348 service neutron] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:41.259233 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1366/2732] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:30:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:30:41.595839 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfaf7e2-6a9a-4849-9a8d-830e6b0c1b1a None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:41.597333 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-5dfaf7e2-6a9a-4849-9a8d-830e6b0c1b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:41.609092 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfaf7e2-6a9a-4849-9a8d-830e6b0c1b1a None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:41.614152 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e6c57-8069-4452-9415-1c9e60e1f6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:41.615113 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e6c57-8069-4452-9415-1c9e60e1f6d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:41.615394 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e6c57-8069-4452-9415-1c9e60e1f6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:41.615665 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e6c57-8069-4452-9415-1c9e60e1f6d5 admin admin] PATH_INFO: `/v3/projects/62668af976ef44dc82554e6303faa24d` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:41.617625 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83e6c57-8069-4452-9415-1c9e60e1f6d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62668af976ef44dc82554e6303faa24d)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:41.619799 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83e6c57-8069-4452-9415-1c9e60e1f6d5 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:41.671356 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-f83e6c57-8069-4452-9415-1c9e60e1f6d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62668af976ef44dc82554e6303faa24d', 'request_id': 'req-f83e6c57-8069-4452-9415-1c9e60e1f6d5'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:41.677396 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-f83e6c57-8069-4452-9415-1c9e60e1f6d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62668af976ef44dc82554e6303faa24d', 'request_id': 'req-f83e6c57-8069-4452-9415-1c9e60e1f6d5'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:41.685779 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-f83e6c57-8069-4452-9415-1c9e60e1f6d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62668af976ef44dc82554e6303faa24d', 'request_id': 'req-f83e6c57-8069-4452-9415-1c9e60e1f6d5'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:41.697136 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-f83e6c57-8069-4452-9415-1c9e60e1f6d5 admin admin] The token cache is being invalidate because project 62668af976ef44dc82554e6303faa24d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:30:41.697417 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-f83e6c57-8069-4452-9415-1c9e60e1f6d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:41.698133 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-f83e6c57-8069-4452-9415-1c9e60e1f6d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:41.699690 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1367/2733] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:30:41 2022] DELETE /identity/v3/projects/62668af976ef44dc82554e6303faa24d => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:30:41.704425 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d3d2f-e0f4-4e12-94a5-492652fb2348 service neutron] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:41.714727 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d3d2f-e0f4-4e12-94a5-492652fb2348 service neutron] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:41.770214 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82168c4-064d-49e2-a316-2eca1be97399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:41.771058 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82168c4-064d-49e2-a316-2eca1be97399 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:41.771337 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82168c4-064d-49e2-a316-2eca1be97399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:41.771606 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82168c4-064d-49e2-a316-2eca1be97399 admin admin] PATH_INFO: `/v3/users/cfae4d8818eb4d3e8099219f229277d8` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:41.772907 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82168c4-064d-49e2-a316-2eca1be97399 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfae4d8818eb4d3e8099219f229277d8)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:41.774863 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82168c4-064d-49e2-a316-2eca1be97399 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:41.819118 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-b82168c4-064d-49e2-a316-2eca1be97399 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfae4d8818eb4d3e8099219f229277d8'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:41.825880 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-b82168c4-064d-49e2-a316-2eca1be97399 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfae4d8818eb4d3e8099219f229277d8'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:41.826550 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-b82168c4-064d-49e2-a316-2eca1be97399 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfae4d8818eb4d3e8099219f229277d8'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:41.839323 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-b82168c4-064d-49e2-a316-2eca1be97399 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfae4d8818eb4d3e8099219f229277d8'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:41.839980 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-b82168c4-064d-49e2-a316-2eca1be97399 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfae4d8818eb4d3e8099219f229277d8'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:41.858649 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1367/2734] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:30:41 2022] DELETE /identity/v3/users/cfae4d8818eb4d3e8099219f229277d8 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:30:42.127284 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e6c57-8069-4452-9415-1c9e60e1f6d5 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:42.129317 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-f83e6c57-8069-4452-9415-1c9e60e1f6d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:42.147909 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e6c57-8069-4452-9415-1c9e60e1f6d5 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:42.205838 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3094fcb2-99e0-4d2d-9872-c45792f04be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:42.206694 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094fcb2-99e0-4d2d-9872-c45792f04be0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:42.206993 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094fcb2-99e0-4d2d-9872-c45792f04be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:42.207323 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3094fcb2-99e0-4d2d-9872-c45792f04be0 admin admin] PATH_INFO: `/v3/projects/c9bdde99ff6c4a56ab835f1d4fe00ff5` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:42.208675 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3094fcb2-99e0-4d2d-9872-c45792f04be0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9bdde99ff6c4a56ab835f1d4fe00ff5)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:42.210612 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3094fcb2-99e0-4d2d-9872-c45792f04be0 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:42.235290 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82168c4-064d-49e2-a316-2eca1be97399 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:42.236830 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-b82168c4-064d-49e2-a316-2eca1be97399 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:42.249615 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82168c4-064d-49e2-a316-2eca1be97399 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:42.256318 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-3094fcb2-99e0-4d2d-9872-c45792f04be0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9bdde99ff6c4a56ab835f1d4fe00ff5', 'request_id': 'req-3094fcb2-99e0-4d2d-9872-c45792f04be0'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:42.262235 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-3094fcb2-99e0-4d2d-9872-c45792f04be0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9bdde99ff6c4a56ab835f1d4fe00ff5', 'request_id': 'req-3094fcb2-99e0-4d2d-9872-c45792f04be0'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:42.270640 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-3094fcb2-99e0-4d2d-9872-c45792f04be0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9bdde99ff6c4a56ab835f1d4fe00ff5', 'request_id': 'req-3094fcb2-99e0-4d2d-9872-c45792f04be0'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:42.282488 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-3094fcb2-99e0-4d2d-9872-c45792f04be0 admin admin] The token cache is being invalidate because project c9bdde99ff6c4a56ab835f1d4fe00ff5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:30:42.282771 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-3094fcb2-99e0-4d2d-9872-c45792f04be0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:42.283456 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-3094fcb2-99e0-4d2d-9872-c45792f04be0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:42.284995 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1368/2735] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:30:42 2022] DELETE /identity/v3/projects/c9bdde99ff6c4a56ab835f1d4fe00ff5 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:30:42.288817 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3094fcb2-99e0-4d2d-9872-c45792f04be0 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:42.290238 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-3094fcb2-99e0-4d2d-9872-c45792f04be0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:42.307936 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45cbf07-029d-49f4-a4c5-e399c0436e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:42.308805 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45cbf07-029d-49f4-a4c5-e399c0436e4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:42.309084 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45cbf07-029d-49f4-a4c5-e399c0436e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:42.309378 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45cbf07-029d-49f4-a4c5-e399c0436e4e admin admin] PATH_INFO: `/v3/users/337f98930a05422f8d178f124e9d962c` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:42.310635 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45cbf07-029d-49f4-a4c5-e399c0436e4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=337f98930a05422f8d178f124e9d962c)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:42.312540 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45cbf07-029d-49f4-a4c5-e399c0436e4e admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:42.353113 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3094fcb2-99e0-4d2d-9872-c45792f04be0 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:42.357968 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db592015-c05e-4f10-a3ba-8f201dc9127f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:42.358830 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db592015-c05e-4f10-a3ba-8f201dc9127f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:42.359107 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db592015-c05e-4f10-a3ba-8f201dc9127f admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:42.359384 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db592015-c05e-4f10-a3ba-8f201dc9127f admin admin] PATH_INFO: `/v3/users/be1ed50028cb4c0f922b83ec0e07cf34` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:42.360426 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-d45cbf07-029d-49f4-a4c5-e399c0436e4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '337f98930a05422f8d178f124e9d962c'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:42.360604 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db592015-c05e-4f10-a3ba-8f201dc9127f admin admin] RBAC: Authorizing `identity:delete_user(user_id=be1ed50028cb4c0f922b83ec0e07cf34)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:42.362525 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db592015-c05e-4f10-a3ba-8f201dc9127f admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:42.367292 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-d45cbf07-029d-49f4-a4c5-e399c0436e4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '337f98930a05422f8d178f124e9d962c'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:42.367879 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-d45cbf07-029d-49f4-a4c5-e399c0436e4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '337f98930a05422f8d178f124e9d962c'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:42.375950 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-d45cbf07-029d-49f4-a4c5-e399c0436e4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '337f98930a05422f8d178f124e9d962c'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:42.376567 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-d45cbf07-029d-49f4-a4c5-e399c0436e4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '337f98930a05422f8d178f124e9d962c'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:42.395878 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1368/2736] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:30:42 2022] DELETE /identity/v3/users/337f98930a05422f8d178f124e9d962c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:30:42.400371 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642a2ad-f636-4ca3-bbb5-0363251d5d3d None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:42.400687 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642a2ad-f636-4ca3-bbb5-0363251d5d3d None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:42.400991 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642a2ad-f636-4ca3-bbb5-0363251d5d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:42.408684 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-db592015-c05e-4f10-a3ba-8f201dc9127f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be1ed50028cb4c0f922b83ec0e07cf34'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:42.418780 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-3642a2ad-f636-4ca3-bbb5-0363251d5d3d None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:30:42.419978 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-3642a2ad-f636-4ca3-bbb5-0363251d5d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:42.420119 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-db592015-c05e-4f10-a3ba-8f201dc9127f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be1ed50028cb4c0f922b83ec0e07cf34'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:42.420823 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-db592015-c05e-4f10-a3ba-8f201dc9127f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be1ed50028cb4c0f922b83ec0e07cf34'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:42.421452 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-db592015-c05e-4f10-a3ba-8f201dc9127f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be1ed50028cb4c0f922b83ec0e07cf34'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:42.428052 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-db592015-c05e-4f10-a3ba-8f201dc9127f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be1ed50028cb4c0f922b83ec0e07cf34'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:42.440453 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1369/2737] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:30:42 2022] DELETE /identity/v3/users/be1ed50028cb4c0f922b83ec0e07cf34 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:30:42.479241 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1369/2738] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:30:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:30:42.489504 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db592015-c05e-4f10-a3ba-8f201dc9127f admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:42.490924 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-db592015-c05e-4f10-a3ba-8f201dc9127f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:42.551458 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db592015-c05e-4f10-a3ba-8f201dc9127f admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:42.554783 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df486b-e31c-4f07-9ee0-840f5ead2868 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:42.555417 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df486b-e31c-4f07-9ee0-840f5ead2868 service neutron] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:42.555692 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df486b-e31c-4f07-9ee0-840f5ead2868 service neutron] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:42.555957 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df486b-e31c-4f07-9ee0-840f5ead2868 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:42.616499 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69df486b-e31c-4f07-9ee0-840f5ead2868 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:42.618034 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69df486b-e31c-4f07-9ee0-840f5ead2868 service neutron] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:42.627778 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1370/2739] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:30:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:30:42.759004 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642a2ad-f636-4ca3-bbb5-0363251d5d3d None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:42.760431 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-3642a2ad-f636-4ca3-bbb5-0363251d5d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:42.772512 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642a2ad-f636-4ca3-bbb5-0363251d5d3d None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:42.780811 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec5c32-4d87-4890-b437-7c89b2d4bff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:42.781894 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec5c32-4d87-4890-b437-7c89b2d4bff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:42.782344 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec5c32-4d87-4890-b437-7c89b2d4bff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:42.782762 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec5c32-4d87-4890-b437-7c89b2d4bff0 admin admin] PATH_INFO: `/v3/projects/dea4f1990cbb455383cb4230cf65584a` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:42.784809 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec5c32-4d87-4890-b437-7c89b2d4bff0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dea4f1990cbb455383cb4230cf65584a)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:42.787053 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec5c32-4d87-4890-b437-7c89b2d4bff0 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:42.843230 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-d2ec5c32-4d87-4890-b437-7c89b2d4bff0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dea4f1990cbb455383cb4230cf65584a', 'request_id': 'req-d2ec5c32-4d87-4890-b437-7c89b2d4bff0'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:42.853365 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-d2ec5c32-4d87-4890-b437-7c89b2d4bff0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dea4f1990cbb455383cb4230cf65584a', 'request_id': 'req-d2ec5c32-4d87-4890-b437-7c89b2d4bff0'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:42.862069 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-d2ec5c32-4d87-4890-b437-7c89b2d4bff0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dea4f1990cbb455383cb4230cf65584a', 'request_id': 'req-d2ec5c32-4d87-4890-b437-7c89b2d4bff0'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:42.873617 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-d2ec5c32-4d87-4890-b437-7c89b2d4bff0 admin admin] The token cache is being invalidate because project dea4f1990cbb455383cb4230cf65584a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:30:42.873835 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-d2ec5c32-4d87-4890-b437-7c89b2d4bff0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:42.874570 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-d2ec5c32-4d87-4890-b437-7c89b2d4bff0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:42.876218 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1370/2740] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:30:42 2022] DELETE /identity/v3/projects/dea4f1990cbb455383cb4230cf65584a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:30:42.882739 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdbb587-0922-44ef-9cb8-f96024b6c5a0 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:42.883074 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdbb587-0922-44ef-9cb8-f96024b6c5a0 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:42.883350 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdbb587-0922-44ef-9cb8-f96024b6c5a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:42.900799 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-5bdbb587-0922-44ef-9cb8-f96024b6c5a0 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:30:42.902106 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-5bdbb587-0922-44ef-9cb8-f96024b6c5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:42.961204 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1371/2741] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:30:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:30:42.968855 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec5c32-4d87-4890-b437-7c89b2d4bff0 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:42.969356 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d9d12-c167-4a91-b099-a26691db8358 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:42.969784 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d9d12-c167-4a91-b099-a26691db8358 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:42.970127 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d9d12-c167-4a91-b099-a26691db8358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:42.977489 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-d2ec5c32-4d87-4890-b437-7c89b2d4bff0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:42.989251 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec5c32-4d87-4890-b437-7c89b2d4bff0 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:42.990322 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-5e8d9d12-c167-4a91-b099-a26691db8358 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:30:42.991516 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-5e8d9d12-c167-4a91-b099-a26691db8358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:42.995471 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1475713f-ab52-41e6-a7f8-16860e13d3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:42.996357 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475713f-ab52-41e6-a7f8-16860e13d3d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:42.996633 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475713f-ab52-41e6-a7f8-16860e13d3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:42.997683 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475713f-ab52-41e6-a7f8-16860e13d3d9 admin admin] PATH_INFO: `/v3/projects/3e28460556d446f5ac495a3093be49be` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:42.998900 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1475713f-ab52-41e6-a7f8-16860e13d3d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e28460556d446f5ac495a3093be49be)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:43.000004 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1372/2742] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:30:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:30:43.000959 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1475713f-ab52-41e6-a7f8-16860e13d3d9 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:43.003859 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d9d12-c167-4a91-b099-a26691db8358 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:43.012664 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d9d12-c167-4a91-b099-a26691db8358 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:43.017419 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cd2791-758c-48a3-b181-a9a9d7f2d89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:43.018096 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd2791-758c-48a3-b181-a9a9d7f2d89b admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:43.018369 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd2791-758c-48a3-b181-a9a9d7f2d89b admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:43.018636 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cd2791-758c-48a3-b181-a9a9d7f2d89b admin admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:43.019352 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cd2791-758c-48a3-b181-a9a9d7f2d89b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:30:43.019648 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cd2791-758c-48a3-b181-a9a9d7f2d89b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:43.021223 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cd2791-758c-48a3-b181-a9a9d7f2d89b admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:43.033283 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1373/2743] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 17 18:30:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:30:43.037711 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cd2791-758c-48a3-b181-a9a9d7f2d89b admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:43.047665 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cd2791-758c-48a3-b181-a9a9d7f2d89b admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:43.048201 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-1475713f-ab52-41e6-a7f8-16860e13d3d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e28460556d446f5ac495a3093be49be', 'request_id': 'req-1475713f-ab52-41e6-a7f8-16860e13d3d9'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:43.054667 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-1475713f-ab52-41e6-a7f8-16860e13d3d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e28460556d446f5ac495a3093be49be', 'request_id': 'req-1475713f-ab52-41e6-a7f8-16860e13d3d9'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:43.062938 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-1475713f-ab52-41e6-a7f8-16860e13d3d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e28460556d446f5ac495a3093be49be', 'request_id': 'req-1475713f-ab52-41e6-a7f8-16860e13d3d9'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:43.073142 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-1475713f-ab52-41e6-a7f8-16860e13d3d9 admin admin] The token cache is being invalidate because project 3e28460556d446f5ac495a3093be49be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:30:43.073481 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-1475713f-ab52-41e6-a7f8-16860e13d3d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:43.074117 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-1475713f-ab52-41e6-a7f8-16860e13d3d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:43.076074 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1371/2744] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:30:42 2022] DELETE /identity/v3/projects/3e28460556d446f5ac495a3093be49be => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:30:43.079976 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1475713f-ab52-41e6-a7f8-16860e13d3d9 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:43.081238 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-1475713f-ab52-41e6-a7f8-16860e13d3d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:43.107392 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d28ef6-5945-4543-9cb1-6ce7bc4464d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:43.108040 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d28ef6-5945-4543-9cb1-6ce7bc4464d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:43.108323 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d28ef6-5945-4543-9cb1-6ce7bc4464d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:43.108595 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d28ef6-5945-4543-9cb1-6ce7bc4464d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:43.109276 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d28ef6-5945-4543-9cb1-6ce7bc4464d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:43.111190 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d28ef6-5945-4543-9cb1-6ce7bc4464d4 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:43.136471 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1374/2745] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:30:43 2022] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:30:43.140610 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d28ef6-5945-4543-9cb1-6ce7bc4464d4 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:43.142206 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-a9d28ef6-5945-4543-9cb1-6ce7bc4464d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:43.143661 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1475713f-ab52-41e6-a7f8-16860e13d3d9 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:43.198711 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a11108-7a95-43c2-a4ca-d79e7f3b6047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:43.199585 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a11108-7a95-43c2-a4ca-d79e7f3b6047 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:43.199864 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a11108-7a95-43c2-a4ca-d79e7f3b6047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:43.200743 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a11108-7a95-43c2-a4ca-d79e7f3b6047 admin admin] PATH_INFO: `/v3/users/e04c6eb64aed471e8b08dc7ed97525b5` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:43.201970 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a11108-7a95-43c2-a4ca-d79e7f3b6047 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e04c6eb64aed471e8b08dc7ed97525b5)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:43.203767 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d28ef6-5945-4543-9cb1-6ce7bc4464d4 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:43.204219 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a11108-7a95-43c2-a4ca-d79e7f3b6047 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:43.208490 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e72cc-e1cc-4e83-aedd-dc86f3cbf174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:43.209152 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e72cc-e1cc-4e83-aedd-dc86f3cbf174 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:43.209430 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e72cc-e1cc-4e83-aedd-dc86f3cbf174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:43.209728 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e72cc-e1cc-4e83-aedd-dc86f3cbf174 admin admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:43.210411 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e72cc-e1cc-4e83-aedd-dc86f3cbf174 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:43.212514 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e72cc-e1cc-4e83-aedd-dc86f3cbf174 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:43.232741 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1375/2746] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:30:43 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:30:43.237510 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e72cc-e1cc-4e83-aedd-dc86f3cbf174 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:43.247719 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e72cc-e1cc-4e83-aedd-dc86f3cbf174 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:43.251060 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-c0a11108-7a95-43c2-a4ca-d79e7f3b6047 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e04c6eb64aed471e8b08dc7ed97525b5'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:43.252298 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eeb387-cd1a-499f-9707-97868fc0116d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:43.252930 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eeb387-cd1a-499f-9707-97868fc0116d admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:43.253210 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eeb387-cd1a-499f-9707-97868fc0116d admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:43.253508 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eeb387-cd1a-499f-9707-97868fc0116d admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:43.254255 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eeb387-cd1a-499f-9707-97868fc0116d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:43.255834 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eeb387-cd1a-499f-9707-97868fc0116d admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:43.257732 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-c0a11108-7a95-43c2-a4ca-d79e7f3b6047 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e04c6eb64aed471e8b08dc7ed97525b5'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:43.258442 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-c0a11108-7a95-43c2-a4ca-d79e7f3b6047 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e04c6eb64aed471e8b08dc7ed97525b5'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:43.266067 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-c0a11108-7a95-43c2-a4ca-d79e7f3b6047 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e04c6eb64aed471e8b08dc7ed97525b5'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:43.266711 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-c0a11108-7a95-43c2-a4ca-d79e7f3b6047 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e04c6eb64aed471e8b08dc7ed97525b5'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:43.266855 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1376/2747] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:30:43.270821 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eeb387-cd1a-499f-9707-97868fc0116d admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:43.272521 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-f7eeb387-cd1a-499f-9707-97868fc0116d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:43.286586 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1372/2748] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:30:43 2022] DELETE /identity/v3/users/e04c6eb64aed471e8b08dc7ed97525b5 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:30:43.286844 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eeb387-cd1a-499f-9707-97868fc0116d admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:43.343062 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a08cd43-9d4c-4493-97e7-326537b99564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:43.343737 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08cd43-9d4c-4493-97e7-326537b99564 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:43.344017 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08cd43-9d4c-4493-97e7-326537b99564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:43.344290 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a08cd43-9d4c-4493-97e7-326537b99564 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:43.345025 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a08cd43-9d4c-4493-97e7-326537b99564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:43.346692 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a08cd43-9d4c-4493-97e7-326537b99564 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:43.363350 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1377/2749] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:30:43.364702 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a11108-7a95-43c2-a4ca-d79e7f3b6047 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:43.377652 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a11108-7a95-43c2-a4ca-d79e7f3b6047 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:43.382621 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0415602d-e92b-44ea-865c-a46d9f1c0517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:43.383579 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415602d-e92b-44ea-865c-a46d9f1c0517 admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:43.383863 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415602d-e92b-44ea-865c-a46d9f1c0517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:43.384138 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415602d-e92b-44ea-865c-a46d9f1c0517 admin admin] PATH_INFO: `/v3/projects/83639fe26ee84f3dbc28a6a1b1f6a602/users/9d2ccdd8ad7748958c99fbfde01450bb/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:43.406771 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0415602d-e92b-44ea-865c-a46d9f1c0517 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83639fe26ee84f3dbc28a6a1b1f6a602, user_id=9d2ccdd8ad7748958c99fbfde01450bb, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:43.409406 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0415602d-e92b-44ea-865c-a46d9f1c0517 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:43.428017 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1373/2750] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:30:43 2022] PUT /identity/v3/projects/83639fe26ee84f3dbc28a6a1b1f6a602/users/9d2ccdd8ad7748958c99fbfde01450bb/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:30:43.448166 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4157a860-9d1f-403a-b5e8-3a5661efcd5b None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:43.448675 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4157a860-9d1f-403a-b5e8-3a5661efcd5b None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:43.449359 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4157a860-9d1f-403a-b5e8-3a5661efcd5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:43.485611 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-4157a860-9d1f-403a-b5e8-3a5661efcd5b None None] MFA Rules not processed for user `9d2ccdd8ad7748958c99fbfde01450bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:30:43.486820 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-4157a860-9d1f-403a-b5e8-3a5661efcd5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:43.560405 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1378/2751] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:30:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:30:43.566001 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0415602d-e92b-44ea-865c-a46d9f1c0517 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:43.583109 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4157a860-9d1f-403a-b5e8-3a5661efcd5b None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:43.584488 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-4157a860-9d1f-403a-b5e8-3a5661efcd5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:43.630951 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0415602d-e92b-44ea-865c-a46d9f1c0517 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:43.635615 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd29ddf-2441-4b39-a60e-d41a17968d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:43.636265 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd29ddf-2441-4b39-a60e-d41a17968d9e admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:43.636545 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd29ddf-2441-4b39-a60e-d41a17968d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:43.636820 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd29ddf-2441-4b39-a60e-d41a17968d9e admin admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:43.638103 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd29ddf-2441-4b39-a60e-d41a17968d9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:43.639936 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd29ddf-2441-4b39-a60e-d41a17968d9e admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:43.655946 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4157a860-9d1f-403a-b5e8-3a5661efcd5b None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:43.660536 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde4f74-43aa-421a-a52b-3d0da900c51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:43.661387 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde4f74-43aa-421a-a52b-3d0da900c51a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:43.661694 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde4f74-43aa-421a-a52b-3d0da900c51a admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:43.662087 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde4f74-43aa-421a-a52b-3d0da900c51a admin admin] PATH_INFO: `/v3/projects/d607aa4d6752439db22081ed213e48d6` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:43.663267 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bde4f74-43aa-421a-a52b-3d0da900c51a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d607aa4d6752439db22081ed213e48d6)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:43.664452 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1374/2752] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:30:43 2022] POST /identity/v3/projects => generated 371 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:30:43.665173 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bde4f74-43aa-421a-a52b-3d0da900c51a admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:43.668402 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd29ddf-2441-4b39-a60e-d41a17968d9e admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:43.714082 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-0bde4f74-43aa-421a-a52b-3d0da900c51a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd607aa4d6752439db22081ed213e48d6', 'request_id': 'req-0bde4f74-43aa-421a-a52b-3d0da900c51a'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:43.720285 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-0bde4f74-43aa-421a-a52b-3d0da900c51a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd607aa4d6752439db22081ed213e48d6', 'request_id': 'req-0bde4f74-43aa-421a-a52b-3d0da900c51a'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:43.727573 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-0bde4f74-43aa-421a-a52b-3d0da900c51a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd607aa4d6752439db22081ed213e48d6', 'request_id': 'req-0bde4f74-43aa-421a-a52b-3d0da900c51a'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:43.730233 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd29ddf-2441-4b39-a60e-d41a17968d9e admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:43.738579 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-0bde4f74-43aa-421a-a52b-3d0da900c51a admin admin] The token cache is being invalidate because project d607aa4d6752439db22081ed213e48d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:30:43.738863 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-0bde4f74-43aa-421a-a52b-3d0da900c51a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:43.739509 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-0bde4f74-43aa-421a-a52b-3d0da900c51a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:43.741123 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1379/2753] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:30:43 2022] DELETE /identity/v3/projects/d607aa4d6752439db22081ed213e48d6 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:30:43.747773 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f5394d-3830-4505-863f-4dcb45bedd1d None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:43.748254 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f5394d-3830-4505-863f-4dcb45bedd1d None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:43.748725 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f5394d-3830-4505-863f-4dcb45bedd1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:43.769886 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-d8f5394d-3830-4505-863f-4dcb45bedd1d None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:30:43.771915 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-d8f5394d-3830-4505-863f-4dcb45bedd1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:43.789552 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e78c3-2151-4f8a-9b86-935b7d2fdf7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:43.790223 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e78c3-2151-4f8a-9b86-935b7d2fdf7e admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:43.790527 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e78c3-2151-4f8a-9b86-935b7d2fdf7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:43.790799 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e78c3-2151-4f8a-9b86-935b7d2fdf7e admin admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:43.791506 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2e78c3-2151-4f8a-9b86-935b7d2fdf7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:43.793557 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2e78c3-2151-4f8a-9b86-935b7d2fdf7e admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:43.816760 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1375/2754] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:30:43 2022] POST /identity/v3/users => generated 292 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:30:43.818183 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e78c3-2151-4f8a-9b86-935b7d2fdf7e admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:43.819786 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-7d2e78c3-2151-4f8a-9b86-935b7d2fdf7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:43.831547 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2e78c3-2151-4f8a-9b86-935b7d2fdf7e admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:43.836442 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90765b4-3008-4edc-b50c-190fbce90208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:43.837055 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90765b4-3008-4edc-b50c-190fbce90208 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:43.837336 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90765b4-3008-4edc-b50c-190fbce90208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:43.837648 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90765b4-3008-4edc-b50c-190fbce90208 admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:43.838378 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90765b4-3008-4edc-b50c-190fbce90208 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:43.839957 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90765b4-3008-4edc-b50c-190fbce90208 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:43.840646 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1380/2755] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:30:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:30:43.848454 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c67729-28fd-4590-a310-f63c06678af4 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:43.848749 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c67729-28fd-4590-a310-f63c06678af4 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:43.849021 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c67729-28fd-4590-a310-f63c06678af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:43.853208 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1376/2756] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:30:43.854110 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90765b4-3008-4edc-b50c-190fbce90208 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:43.865388 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90765b4-3008-4edc-b50c-190fbce90208 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:43.867830 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-13c67729-28fd-4590-a310-f63c06678af4 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:30:43.869023 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-13c67729-28fd-4590-a310-f63c06678af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:43.870143 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c32db1-efc7-4cfe-a9f7-86c3afb51cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:43.871011 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c32db1-efc7-4cfe-a9f7-86c3afb51cb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:43.871292 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c32db1-efc7-4cfe-a9f7-86c3afb51cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:43.871566 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c32db1-efc7-4cfe-a9f7-86c3afb51cb0 admin admin] PATH_INFO: `/v3/projects/9becbd66e497483bb1c1021f109c5151/users/2a7a8ca85d874a10b654bb48f939a88c/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:43.877766 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1381/2757] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:30:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:30:43.881769 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c67729-28fd-4590-a310-f63c06678af4 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:43.887085 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c32db1-efc7-4cfe-a9f7-86c3afb51cb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9becbd66e497483bb1c1021f109c5151, user_id=2a7a8ca85d874a10b654bb48f939a88c, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:43.890098 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c32db1-efc7-4cfe-a9f7-86c3afb51cb0 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:43.890914 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c67729-28fd-4590-a310-f63c06678af4 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:43.895976 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dcc195-a430-4abb-982f-eb46235f3ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:43.896738 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dcc195-a430-4abb-982f-eb46235f3ff2 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:43.897021 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dcc195-a430-4abb-982f-eb46235f3ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:43.897299 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dcc195-a430-4abb-982f-eb46235f3ff2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:43.898157 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dcc195-a430-4abb-982f-eb46235f3ff2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:30:43.898464 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dcc195-a430-4abb-982f-eb46235f3ff2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:43.900036 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dcc195-a430-4abb-982f-eb46235f3ff2 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:43.905805 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1377/2758] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:30:43 2022] PUT /identity/v3/projects/9becbd66e497483bb1c1021f109c5151/users/2a7a8ca85d874a10b654bb48f939a88c/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:30:43.906814 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c32db1-efc7-4cfe-a9f7-86c3afb51cb0 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:43.917165 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1382/2759] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 17 18:30:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:30:43.918384 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dcc195-a430-4abb-982f-eb46235f3ff2 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:43.928464 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dcc195-a430-4abb-982f-eb46235f3ff2 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:43.969749 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c32db1-efc7-4cfe-a9f7-86c3afb51cb0 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:43.974383 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e683837-ef8a-47cb-9f3d-f84e7890c9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:43.975138 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e683837-ef8a-47cb-9f3d-f84e7890c9da admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:43.975421 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e683837-ef8a-47cb-9f3d-f84e7890c9da admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:43.975696 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e683837-ef8a-47cb-9f3d-f84e7890c9da admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:43.976417 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e683837-ef8a-47cb-9f3d-f84e7890c9da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:43.978040 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e683837-ef8a-47cb-9f3d-f84e7890c9da admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:43.984583 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c4103f-be44-44d5-84dc-e887f6b87cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:43.985237 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c4103f-be44-44d5-84dc-e887f6b87cc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:43.985556 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c4103f-be44-44d5-84dc-e887f6b87cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:43.985833 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c4103f-be44-44d5-84dc-e887f6b87cc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:43.986515 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c4103f-be44-44d5-84dc-e887f6b87cc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:43.988242 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1378/2760] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:30:43 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:30:43.988421 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c4103f-be44-44d5-84dc-e887f6b87cc5 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:43.992382 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e683837-ef8a-47cb-9f3d-f84e7890c9da admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:44.001820 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e683837-ef8a-47cb-9f3d-f84e7890c9da admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:44.006855 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abdcf0f-a5e0-4f79-b356-5f3a51da2364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:44.007857 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abdcf0f-a5e0-4f79-b356-5f3a51da2364 admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:44.008136 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abdcf0f-a5e0-4f79-b356-5f3a51da2364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:44.008416 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abdcf0f-a5e0-4f79-b356-5f3a51da2364 admin admin] PATH_INFO: `/v3/projects/9becbd66e497483bb1c1021f109c5151/users/2a7a8ca85d874a10b654bb48f939a88c/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:44.010424 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abdcf0f-a5e0-4f79-b356-5f3a51da2364 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9becbd66e497483bb1c1021f109c5151, user_id=2a7a8ca85d874a10b654bb48f939a88c, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:44.013039 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abdcf0f-a5e0-4f79-b356-5f3a51da2364 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:44.017863 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1383/2761] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:30:43 2022] POST /identity/v3/projects => generated 367 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:30:44.018814 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c4103f-be44-44d5-84dc-e887f6b87cc5 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:44.023594 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1379/2762] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:30:43 2022] PUT /identity/v3/projects/9becbd66e497483bb1c1021f109c5151/users/2a7a8ca85d874a10b654bb48f939a88c/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:30:44.034889 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1443a-3531-40d2-a045-c992d0109140 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:44.035180 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1443a-3531-40d2-a045-c992d0109140 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:44.035458 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1443a-3531-40d2-a045-c992d0109140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:44.062605 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-ced1443a-3531-40d2-a045-c992d0109140 None None] MFA Rules not processed for user `2a7a8ca85d874a10b654bb48f939a88c`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:30:44.063879 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-ced1443a-3531-40d2-a045-c992d0109140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:44.078591 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c4103f-be44-44d5-84dc-e887f6b87cc5 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:44.134239 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf519d-ac93-4c3c-b534-00011e0ad7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:44.134900 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf519d-ac93-4c3c-b534-00011e0ad7c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:44.135175 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf519d-ac93-4c3c-b534-00011e0ad7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:44.135442 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf519d-ac93-4c3c-b534-00011e0ad7c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:44.136117 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cf519d-ac93-4c3c-b534-00011e0ad7c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:44.137968 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1380/2763] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:30:44 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:30:44.138180 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cf519d-ac93-4c3c-b534-00011e0ad7c1 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:44.149149 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced1443a-3531-40d2-a045-c992d0109140 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:44.150839 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-ced1443a-3531-40d2-a045-c992d0109140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:44.158653 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1384/2764] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:30:44 2022] POST /identity/v3/users => generated 284 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:30:44.162570 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf519d-ac93-4c3c-b534-00011e0ad7c1 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:44.172275 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf519d-ac93-4c3c-b534-00011e0ad7c1 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:44.176996 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc08f4ed-300d-47e2-81b7-fc2f937d27ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:44.177648 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08f4ed-300d-47e2-81b7-fc2f937d27ed admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:44.177926 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08f4ed-300d-47e2-81b7-fc2f937d27ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:44.178199 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08f4ed-300d-47e2-81b7-fc2f937d27ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:44.178909 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc08f4ed-300d-47e2-81b7-fc2f937d27ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:44.180488 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc08f4ed-300d-47e2-81b7-fc2f937d27ed admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:44.190125 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1385/2765] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:30:44.194133 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc08f4ed-300d-47e2-81b7-fc2f937d27ed admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:44.203461 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc08f4ed-300d-47e2-81b7-fc2f937d27ed admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:44.207905 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6017ae16-b35b-4d77-a94a-fc71aa1f9a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:44.208338 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced1443a-3531-40d2-a045-c992d0109140 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:44.208522 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6017ae16-b35b-4d77-a94a-fc71aa1f9a87 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:44.208798 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6017ae16-b35b-4d77-a94a-fc71aa1f9a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:44.209069 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6017ae16-b35b-4d77-a94a-fc71aa1f9a87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:44.209803 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6017ae16-b35b-4d77-a94a-fc71aa1f9a87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:44.211358 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6017ae16-b35b-4d77-a94a-fc71aa1f9a87 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:44.212043 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf49ac-f885-4a6c-a525-f2ade295364c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:44.212679 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf49ac-f885-4a6c-a525-f2ade295364c service cinder] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:44.212958 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf49ac-f885-4a6c-a525-f2ade295364c service cinder] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:44.213231 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf49ac-f885-4a6c-a525-f2ade295364c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:44.215067 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-7cbf49ac-f885-4a6c-a525-f2ade295364c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:44.221987 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1386/2766] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:30:44.225938 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6017ae16-b35b-4d77-a94a-fc71aa1f9a87 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:44.235693 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6017ae16-b35b-4d77-a94a-fc71aa1f9a87 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:44.240217 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47470e55-3f78-411b-b76b-9147536a4ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:44.241058 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47470e55-3f78-411b-b76b-9147536a4ef7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:44.241337 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47470e55-3f78-411b-b76b-9147536a4ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:44.241648 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47470e55-3f78-411b-b76b-9147536a4ef7 admin admin] PATH_INFO: `/v3/projects/11c378c5dc804e608ac85eb5615648f5/users/f5460c7bb50a4cf9b8eb6e522a372afe/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:44.255375 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47470e55-3f78-411b-b76b-9147536a4ef7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11c378c5dc804e608ac85eb5615648f5, user_id=f5460c7bb50a4cf9b8eb6e522a372afe, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:44.258023 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47470e55-3f78-411b-b76b-9147536a4ef7 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:44.271158 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1387/2767] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:30:44 2022] PUT /identity/v3/projects/11c378c5dc804e608ac85eb5615648f5/users/f5460c7bb50a4cf9b8eb6e522a372afe/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:30:44.272758 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbf49ac-f885-4a6c-a525-f2ade295364c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:44.274455 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbf49ac-f885-4a6c-a525-f2ade295364c service cinder] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:44.283143 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e0d80-ae9b-4513-985e-7267ff0eb92d None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:44.283430 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e0d80-ae9b-4513-985e-7267ff0eb92d None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:44.283730 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99e0d80-ae9b-4513-985e-7267ff0eb92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:44.284636 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1381/2768] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:30:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:30:44.309369 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-f99e0d80-ae9b-4513-985e-7267ff0eb92d None None] MFA Rules not processed for user `f5460c7bb50a4cf9b8eb6e522a372afe`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:30:44.310589 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-f99e0d80-ae9b-4513-985e-7267ff0eb92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:44.372148 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1388/2769] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:30:44 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:30:44.376810 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf49ac-f885-4a6c-a525-f2ade295364c service cinder] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:44.387355 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf49ac-f885-4a6c-a525-f2ade295364c service cinder] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:44.446281 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2011df87-4f98-4f45-b25b-31432e196c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:44.446939 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011df87-4f98-4f45-b25b-31432e196c6d admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:44.447225 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011df87-4f98-4f45-b25b-31432e196c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:44.447499 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011df87-4f98-4f45-b25b-31432e196c6d admin admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:44.448193 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2011df87-4f98-4f45-b25b-31432e196c6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:44.450655 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2011df87-4f98-4f45-b25b-31432e196c6d admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:44.477787 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1382/2770] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:30:44 2022] POST /identity/v3/projects => generated 369 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:30:44.482591 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e0d80-ae9b-4513-985e-7267ff0eb92d None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:44.494224 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99e0d80-ae9b-4513-985e-7267ff0eb92d None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:44.557394 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db055a78-b5e2-428e-8759-2b7c893dd27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:44.558097 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db055a78-b5e2-428e-8759-2b7c893dd27b admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:44.558374 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db055a78-b5e2-428e-8759-2b7c893dd27b admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:44.558643 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db055a78-b5e2-428e-8759-2b7c893dd27b admin admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:44.559647 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db055a78-b5e2-428e-8759-2b7c893dd27b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:44.561415 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db055a78-b5e2-428e-8759-2b7c893dd27b admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:44.582571 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1389/2771] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:30:44 2022] POST /identity/v3/users => generated 291 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:30:44.586698 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2011df87-4f98-4f45-b25b-31432e196c6d admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:44.598180 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2011df87-4f98-4f45-b25b-31432e196c6d admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:44.604469 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a53ac5-637d-4562-9999-ec888dd195f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:44.605216 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a53ac5-637d-4562-9999-ec888dd195f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:44.605603 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a53ac5-637d-4562-9999-ec888dd195f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:44.605953 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a53ac5-637d-4562-9999-ec888dd195f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:44.606853 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a53ac5-637d-4562-9999-ec888dd195f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:44.608452 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a53ac5-637d-4562-9999-ec888dd195f6 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:44.620604 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1383/2772] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:30:44.624760 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db055a78-b5e2-428e-8759-2b7c893dd27b admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:44.634324 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db055a78-b5e2-428e-8759-2b7c893dd27b admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:44.639378 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d5c37-6681-43ab-869d-2b6192f643ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:44.640232 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d5c37-6681-43ab-869d-2b6192f643ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:44.640506 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d5c37-6681-43ab-869d-2b6192f643ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:44.640775 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d5c37-6681-43ab-869d-2b6192f643ce admin admin] PATH_INFO: `/v3/projects/7e41ffc4097f41d9a9aecf4b58794035/users/99681b530a1c47ff8568646d37760416/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:44.655233 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d5c37-6681-43ab-869d-2b6192f643ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e41ffc4097f41d9a9aecf4b58794035, user_id=99681b530a1c47ff8568646d37760416, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:44.657893 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d5c37-6681-43ab-869d-2b6192f643ce admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:44.669872 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1390/2773] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:30:44 2022] PUT /identity/v3/projects/7e41ffc4097f41d9a9aecf4b58794035/users/99681b530a1c47ff8568646d37760416/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:30:44.673773 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a53ac5-637d-4562-9999-ec888dd195f6 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:44.683910 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a53ac5-637d-4562-9999-ec888dd195f6 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:44.738039 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105b8adc-9e8e-4989-b610-1a1b24babf00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:44.738696 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b8adc-9e8e-4989-b610-1a1b24babf00 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:44.738978 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b8adc-9e8e-4989-b610-1a1b24babf00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:44.739251 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b8adc-9e8e-4989-b610-1a1b24babf00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:44.739973 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105b8adc-9e8e-4989-b610-1a1b24babf00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:44.741581 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105b8adc-9e8e-4989-b610-1a1b24babf00 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:44.751420 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1384/2774] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:30:44 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:30:44.755464 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d5c37-6681-43ab-869d-2b6192f643ce admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:44.766142 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d5c37-6681-43ab-869d-2b6192f643ce admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:44.770596 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8be693-3d1a-41ee-93a5-c550fbb2ea1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:44.771449 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8be693-3d1a-41ee-93a5-c550fbb2ea1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:44.771722 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8be693-3d1a-41ee-93a5-c550fbb2ea1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:44.771985 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8be693-3d1a-41ee-93a5-c550fbb2ea1d admin admin] PATH_INFO: `/v3/projects/7e41ffc4097f41d9a9aecf4b58794035/users/99681b530a1c47ff8568646d37760416/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:44.773925 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8be693-3d1a-41ee-93a5-c550fbb2ea1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e41ffc4097f41d9a9aecf4b58794035, user_id=99681b530a1c47ff8568646d37760416, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:44.776534 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8be693-3d1a-41ee-93a5-c550fbb2ea1d admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:44.786568 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1391/2775] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:30:44 2022] PUT /identity/v3/projects/7e41ffc4097f41d9a9aecf4b58794035/users/99681b530a1c47ff8568646d37760416/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:30:44.797396 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b697fa2-33eb-4aeb-8a65-47bf0b15ee18 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:44.797726 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b697fa2-33eb-4aeb-8a65-47bf0b15ee18 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:44.798005 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b697fa2-33eb-4aeb-8a65-47bf0b15ee18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:44.823581 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-3b697fa2-33eb-4aeb-8a65-47bf0b15ee18 None None] MFA Rules not processed for user `99681b530a1c47ff8568646d37760416`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:30:44.824761 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-3b697fa2-33eb-4aeb-8a65-47bf0b15ee18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:44.891728 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1385/2776] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:30:44 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:30:44.902926 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8be693-3d1a-41ee-93a5-c550fbb2ea1d admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:44.956240 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8be693-3d1a-41ee-93a5-c550fbb2ea1d admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:44.959804 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7526846d-910b-42a7-832b-bb87d338913f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:44.960689 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526846d-910b-42a7-832b-bb87d338913f service cinder] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:44.960689 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526846d-910b-42a7-832b-bb87d338913f service cinder] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:44.960952 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7526846d-910b-42a7-832b-bb87d338913f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:44.970004 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7526846d-910b-42a7-832b-bb87d338913f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:44.971463 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7526846d-910b-42a7-832b-bb87d338913f service cinder] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:44.980941 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1392/2777] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:30:44 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:30:46.315003 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b697fa2-33eb-4aeb-8a65-47bf0b15ee18 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:46.382091 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b697fa2-33eb-4aeb-8a65-47bf0b15ee18 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:46.386571 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd0921-e579-45f1-8df7-8f68afb5b53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:46.388086 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd0921-e579-45f1-8df7-8f68afb5b53f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:46.388346 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd0921-e579-45f1-8df7-8f68afb5b53f admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:46.388614 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd0921-e579-45f1-8df7-8f68afb5b53f admin admin] PATH_INFO: `/v3/users/f5460c7bb50a4cf9b8eb6e522a372afe` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:46.389830 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecd0921-e579-45f1-8df7-8f68afb5b53f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5460c7bb50a4cf9b8eb6e522a372afe)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:46.391727 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecd0921-e579-45f1-8df7-8f68afb5b53f admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:46.435614 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-fecd0921-e579-45f1-8df7-8f68afb5b53f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5460c7bb50a4cf9b8eb6e522a372afe'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:46.442193 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-fecd0921-e579-45f1-8df7-8f68afb5b53f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5460c7bb50a4cf9b8eb6e522a372afe'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:46.442842 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-fecd0921-e579-45f1-8df7-8f68afb5b53f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5460c7bb50a4cf9b8eb6e522a372afe'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:46.449663 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-fecd0921-e579-45f1-8df7-8f68afb5b53f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5460c7bb50a4cf9b8eb6e522a372afe'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:46.450905 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-fecd0921-e579-45f1-8df7-8f68afb5b53f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5460c7bb50a4cf9b8eb6e522a372afe'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:46.467800 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1386/2778] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:30:46 2022] DELETE /identity/v3/users/f5460c7bb50a4cf9b8eb6e522a372afe => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:30:46.472362 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f403a54a-fbea-4712-a7b2-b0a4989670bd None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:46.472843 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f403a54a-fbea-4712-a7b2-b0a4989670bd None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:46.472963 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f403a54a-fbea-4712-a7b2-b0a4989670bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:46.490344 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-f403a54a-fbea-4712-a7b2-b0a4989670bd None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:30:46.491464 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-f403a54a-fbea-4712-a7b2-b0a4989670bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:46.547252 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1393/2779] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:30:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:30:46.556731 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd0921-e579-45f1-8df7-8f68afb5b53f admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:46.558121 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-fecd0921-e579-45f1-8df7-8f68afb5b53f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:46.613531 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd0921-e579-45f1-8df7-8f68afb5b53f admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:46.617075 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d7c182-d3f8-4c15-a300-85edca8a2ee0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:46.617724 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7c182-d3f8-4c15-a300-85edca8a2ee0 service neutron] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:46.618003 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7c182-d3f8-4c15-a300-85edca8a2ee0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:46.618279 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7c182-d3f8-4c15-a300-85edca8a2ee0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:46.627542 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d7c182-d3f8-4c15-a300-85edca8a2ee0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:46.628952 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d7c182-d3f8-4c15-a300-85edca8a2ee0 service neutron] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:46.638071 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1387/2780] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:30:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:30:46.842436 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f403a54a-fbea-4712-a7b2-b0a4989670bd None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:46.843891 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-f403a54a-fbea-4712-a7b2-b0a4989670bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:46.855738 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f403a54a-fbea-4712-a7b2-b0a4989670bd None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:46.861246 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d8662-5c13-47b5-ba1e-ac914d2adc6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:46.862137 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d8662-5c13-47b5-ba1e-ac914d2adc6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:46.862413 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d8662-5c13-47b5-ba1e-ac914d2adc6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:46.862685 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d8662-5c13-47b5-ba1e-ac914d2adc6c admin admin] PATH_INFO: `/v3/users/9d2ccdd8ad7748958c99fbfde01450bb` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:46.863869 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d8662-5c13-47b5-ba1e-ac914d2adc6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d2ccdd8ad7748958c99fbfde01450bb)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:46.865818 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d8662-5c13-47b5-ba1e-ac914d2adc6c admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:46.914143 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-ef0d8662-5c13-47b5-ba1e-ac914d2adc6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d2ccdd8ad7748958c99fbfde01450bb'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:46.926697 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d7c182-d3f8-4c15-a300-85edca8a2ee0 service neutron] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:46.927538 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-ef0d8662-5c13-47b5-ba1e-ac914d2adc6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d2ccdd8ad7748958c99fbfde01450bb'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:46.928225 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-64d7c182-d3f8-4c15-a300-85edca8a2ee0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:46.928342 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-ef0d8662-5c13-47b5-ba1e-ac914d2adc6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d2ccdd8ad7748958c99fbfde01450bb'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:46.928840 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-ef0d8662-5c13-47b5-ba1e-ac914d2adc6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d2ccdd8ad7748958c99fbfde01450bb'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:46.938338 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-ef0d8662-5c13-47b5-ba1e-ac914d2adc6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d2ccdd8ad7748958c99fbfde01450bb'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:46.942920 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d7c182-d3f8-4c15-a300-85edca8a2ee0 service neutron] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:46.948264 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d73a20-0173-4ea8-acc1-011b95feb5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:46.949177 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d73a20-0173-4ea8-acc1-011b95feb5f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:46.949635 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d73a20-0173-4ea8-acc1-011b95feb5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:46.949919 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d73a20-0173-4ea8-acc1-011b95feb5f5 admin admin] PATH_INFO: `/v3/projects/11c378c5dc804e608ac85eb5615648f5` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:46.951394 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d73a20-0173-4ea8-acc1-011b95feb5f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11c378c5dc804e608ac85eb5615648f5)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:46.953646 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d73a20-0173-4ea8-acc1-011b95feb5f5 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:46.953738 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1394/2781] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:30:46 2022] DELETE /identity/v3/users/9d2ccdd8ad7748958c99fbfde01450bb => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:30:46.957651 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6246dfe-d5dd-49be-b84b-be7c38c33778 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:46.957932 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6246dfe-d5dd-49be-b84b-be7c38c33778 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:46.958206 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6246dfe-d5dd-49be-b84b-be7c38c33778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:46.976154 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-e6246dfe-d5dd-49be-b84b-be7c38c33778 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:30:46.977384 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-e6246dfe-d5dd-49be-b84b-be7c38c33778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:47.007192 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-c2d73a20-0173-4ea8-acc1-011b95feb5f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11c378c5dc804e608ac85eb5615648f5', 'request_id': 'req-c2d73a20-0173-4ea8-acc1-011b95feb5f5'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:47.013958 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-c2d73a20-0173-4ea8-acc1-011b95feb5f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11c378c5dc804e608ac85eb5615648f5', 'request_id': 'req-c2d73a20-0173-4ea8-acc1-011b95feb5f5'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:47.021564 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-c2d73a20-0173-4ea8-acc1-011b95feb5f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11c378c5dc804e608ac85eb5615648f5', 'request_id': 'req-c2d73a20-0173-4ea8-acc1-011b95feb5f5'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:47.033296 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-c2d73a20-0173-4ea8-acc1-011b95feb5f5 admin admin] The token cache is being invalidate because project 11c378c5dc804e608ac85eb5615648f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:30:47.033605 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-c2d73a20-0173-4ea8-acc1-011b95feb5f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:47.034338 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-c2d73a20-0173-4ea8-acc1-011b95feb5f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:47.035909 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1388/2782] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:30:46 2022] DELETE /identity/v3/projects/11c378c5dc804e608ac85eb5615648f5 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:30:47.038631 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1395/2783] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:30:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:30:47.041878 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d73a20-0173-4ea8-acc1-011b95feb5f5 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:47.041878 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-c2d73a20-0173-4ea8-acc1-011b95feb5f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:47.048543 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6246dfe-d5dd-49be-b84b-be7c38c33778 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:47.049899 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-e6246dfe-d5dd-49be-b84b-be7c38c33778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:47.104019 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6246dfe-d5dd-49be-b84b-be7c38c33778 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:47.105313 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d73a20-0173-4ea8-acc1-011b95feb5f5 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:47.110518 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a7186a-7b0e-400d-ad2e-06b290e03deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:47.111379 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7186a-7b0e-400d-ad2e-06b290e03deb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:47.111657 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7186a-7b0e-400d-ad2e-06b290e03deb admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:47.111929 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7186a-7b0e-400d-ad2e-06b290e03deb admin admin] PATH_INFO: `/v3/users/99681b530a1c47ff8568646d37760416` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:47.113336 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a7186a-7b0e-400d-ad2e-06b290e03deb admin admin] RBAC: Authorizing `identity:delete_user(user_id=99681b530a1c47ff8568646d37760416)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:47.115283 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a7186a-7b0e-400d-ad2e-06b290e03deb admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:47.150764 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70eb32-a6dc-457d-87f2-0a9998b0ddde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:47.151404 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70eb32-a6dc-457d-87f2-0a9998b0ddde service neutron] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:47.151681 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70eb32-a6dc-457d-87f2-0a9998b0ddde service neutron] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:47.151950 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70eb32-a6dc-457d-87f2-0a9998b0ddde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:47.154368 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-ce70eb32-a6dc-457d-87f2-0a9998b0ddde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:47.159817 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-93a7186a-7b0e-400d-ad2e-06b290e03deb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99681b530a1c47ff8568646d37760416'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:47.166083 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce70eb32-a6dc-457d-87f2-0a9998b0ddde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:47.166655 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-93a7186a-7b0e-400d-ad2e-06b290e03deb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99681b530a1c47ff8568646d37760416'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:47.167317 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-93a7186a-7b0e-400d-ad2e-06b290e03deb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99681b530a1c47ff8568646d37760416'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:47.167525 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce70eb32-a6dc-457d-87f2-0a9998b0ddde service neutron] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:47.175783 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-93a7186a-7b0e-400d-ad2e-06b290e03deb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99681b530a1c47ff8568646d37760416'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:47.176423 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-93a7186a-7b0e-400d-ad2e-06b290e03deb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99681b530a1c47ff8568646d37760416'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:47.178277 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1396/2784] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:30:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:30:47.194239 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1389/2785] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:30:47 2022] DELETE /identity/v3/users/99681b530a1c47ff8568646d37760416 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:30:47.447367 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70eb32-a6dc-457d-87f2-0a9998b0ddde service neutron] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:47.448880 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-ce70eb32-a6dc-457d-87f2-0a9998b0ddde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:47.467131 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a7186a-7b0e-400d-ad2e-06b290e03deb admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:47.470711 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70eb32-a6dc-457d-87f2-0a9998b0ddde service neutron] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:47.474142 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-93a7186a-7b0e-400d-ad2e-06b290e03deb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:47.535642 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbec6a6-75e3-4a22-955f-47b9d892a456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:47.536392 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbec6a6-75e3-4a22-955f-47b9d892a456 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:47.536666 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbec6a6-75e3-4a22-955f-47b9d892a456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:47.536931 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbec6a6-75e3-4a22-955f-47b9d892a456 admin admin] PATH_INFO: `/v3/projects/83639fe26ee84f3dbc28a6a1b1f6a602` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:47.538122 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbec6a6-75e3-4a22-955f-47b9d892a456 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83639fe26ee84f3dbc28a6a1b1f6a602)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:47.540003 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbec6a6-75e3-4a22-955f-47b9d892a456 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:47.548387 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a7186a-7b0e-400d-ad2e-06b290e03deb admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:47.552882 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c10e7a-f739-4647-95b8-2c148d1790e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:47.553760 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c10e7a-f739-4647-95b8-2c148d1790e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:47.554036 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c10e7a-f739-4647-95b8-2c148d1790e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:47.554306 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c10e7a-f739-4647-95b8-2c148d1790e0 admin admin] PATH_INFO: `/v3/projects/7e41ffc4097f41d9a9aecf4b58794035` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:47.555487 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c10e7a-f739-4647-95b8-2c148d1790e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e41ffc4097f41d9a9aecf4b58794035)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:47.557385 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c10e7a-f739-4647-95b8-2c148d1790e0 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:47.586039 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-cdbec6a6-75e3-4a22-955f-47b9d892a456 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83639fe26ee84f3dbc28a6a1b1f6a602', 'request_id': 'req-cdbec6a6-75e3-4a22-955f-47b9d892a456'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:47.592883 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-cdbec6a6-75e3-4a22-955f-47b9d892a456 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83639fe26ee84f3dbc28a6a1b1f6a602', 'request_id': 'req-cdbec6a6-75e3-4a22-955f-47b9d892a456'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:47.600223 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-cdbec6a6-75e3-4a22-955f-47b9d892a456 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83639fe26ee84f3dbc28a6a1b1f6a602', 'request_id': 'req-cdbec6a6-75e3-4a22-955f-47b9d892a456'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:47.604936 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-76c10e7a-f739-4647-95b8-2c148d1790e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e41ffc4097f41d9a9aecf4b58794035', 'request_id': 'req-76c10e7a-f739-4647-95b8-2c148d1790e0'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:47.610149 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-cdbec6a6-75e3-4a22-955f-47b9d892a456 admin admin] The token cache is being invalidate because project 83639fe26ee84f3dbc28a6a1b1f6a602 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:30:47.610428 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-cdbec6a6-75e3-4a22-955f-47b9d892a456 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:47.611056 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-cdbec6a6-75e3-4a22-955f-47b9d892a456 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:47.611220 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-76c10e7a-f739-4647-95b8-2c148d1790e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e41ffc4097f41d9a9aecf4b58794035', 'request_id': 'req-76c10e7a-f739-4647-95b8-2c148d1790e0'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:47.612626 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1397/2786] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:30:47 2022] DELETE /identity/v3/projects/83639fe26ee84f3dbc28a6a1b1f6a602 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:30:47.617133 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbec6a6-75e3-4a22-955f-47b9d892a456 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:47.618790 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-cdbec6a6-75e3-4a22-955f-47b9d892a456 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:47.618984 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-76c10e7a-f739-4647-95b8-2c148d1790e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e41ffc4097f41d9a9aecf4b58794035', 'request_id': 'req-76c10e7a-f739-4647-95b8-2c148d1790e0'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:47.629217 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-76c10e7a-f739-4647-95b8-2c148d1790e0 admin admin] The token cache is being invalidate because project 7e41ffc4097f41d9a9aecf4b58794035 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:30:47.629542 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-76c10e7a-f739-4647-95b8-2c148d1790e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:47.630186 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-76c10e7a-f739-4647-95b8-2c148d1790e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:47.631719 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1390/2787] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:30:47 2022] DELETE /identity/v3/projects/7e41ffc4097f41d9a9aecf4b58794035 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:30:47.637176 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a5613-b980-4358-a293-eacd24ce6662 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:47.638030 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a5613-b980-4358-a293-eacd24ce6662 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:47.638304 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445a5613-b980-4358-a293-eacd24ce6662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:47.679906 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbec6a6-75e3-4a22-955f-47b9d892a456 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:47.684890 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-445a5613-b980-4358-a293-eacd24ce6662 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:30:47.686271 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-445a5613-b980-4358-a293-eacd24ce6662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:47.734795 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8236aa82-59c4-41d7-aafb-bf0794ff728a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:47.736290 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236aa82-59c4-41d7-aafb-bf0794ff728a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:47.736572 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236aa82-59c4-41d7-aafb-bf0794ff728a admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:47.736845 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236aa82-59c4-41d7-aafb-bf0794ff728a admin admin] PATH_INFO: `/v3/users/2a7a8ca85d874a10b654bb48f939a88c` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:47.738042 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8236aa82-59c4-41d7-aafb-bf0794ff728a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a7a8ca85d874a10b654bb48f939a88c)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:47.739940 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8236aa82-59c4-41d7-aafb-bf0794ff728a admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:47.742593 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1391/2788] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:30:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:30:47.750890 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d08464-0c67-45aa-9c7d-893a14def5ae None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:47.751179 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d08464-0c67-45aa-9c7d-893a14def5ae None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:47.751454 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d08464-0c67-45aa-9c7d-893a14def5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:47.769971 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-73d08464-0c67-45aa-9c7d-893a14def5ae None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:30:47.771204 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-73d08464-0c67-45aa-9c7d-893a14def5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:47.779368 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1392/2789] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:30:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:30:47.783586 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d08464-0c67-45aa-9c7d-893a14def5ae None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:47.789872 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-8236aa82-59c4-41d7-aafb-bf0794ff728a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a7a8ca85d874a10b654bb48f939a88c'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:47.792300 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d08464-0c67-45aa-9c7d-893a14def5ae None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:47.796896 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b5951-495f-4624-9af3-b106e7418d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:47.797571 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b5951-495f-4624-9af3-b106e7418d5d admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:47.797833 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b5951-495f-4624-9af3-b106e7418d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:47.798103 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b5951-495f-4624-9af3-b106e7418d5d admin admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:47.798814 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72b5951-495f-4624-9af3-b106e7418d5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:30:47.799141 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72b5951-495f-4624-9af3-b106e7418d5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:47.800720 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72b5951-495f-4624-9af3-b106e7418d5d admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:47.801678 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-8236aa82-59c4-41d7-aafb-bf0794ff728a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a7a8ca85d874a10b654bb48f939a88c'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:47.802356 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-8236aa82-59c4-41d7-aafb-bf0794ff728a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a7a8ca85d874a10b654bb48f939a88c'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:47.803165 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-8236aa82-59c4-41d7-aafb-bf0794ff728a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a7a8ca85d874a10b654bb48f939a88c'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:47.810241 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-8236aa82-59c4-41d7-aafb-bf0794ff728a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a7a8ca85d874a10b654bb48f939a88c'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:47.812479 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1393/2790] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 17 18:30:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:30:47.816640 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b5951-495f-4624-9af3-b106e7418d5d admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:47.818324 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-b72b5951-495f-4624-9af3-b106e7418d5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:47.827382 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1398/2791] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:30:47 2022] DELETE /identity/v3/users/2a7a8ca85d874a10b654bb48f939a88c => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:30:47.831807 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b5951-495f-4624-9af3-b106e7418d5d admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:47.889953 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10adda-6792-47e5-9f71-6f6034fb82be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:47.890632 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10adda-6792-47e5-9f71-6f6034fb82be admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:47.890897 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10adda-6792-47e5-9f71-6f6034fb82be admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:47.891159 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec10adda-6792-47e5-9f71-6f6034fb82be admin admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:47.892096 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec10adda-6792-47e5-9f71-6f6034fb82be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:47.894262 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec10adda-6792-47e5-9f71-6f6034fb82be admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:47.920541 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1394/2792] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:30:47 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:30:47.925611 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8236aa82-59c4-41d7-aafb-bf0794ff728a admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:47.935972 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8236aa82-59c4-41d7-aafb-bf0794ff728a admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:47.999522 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f00dd-51e2-453b-bdd2-45e5b6a868f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:48.000191 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f00dd-51e2-453b-bdd2-45e5b6a868f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:48.000466 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f00dd-51e2-453b-bdd2-45e5b6a868f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:48.000733 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f00dd-51e2-453b-bdd2-45e5b6a868f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:48.001410 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028f00dd-51e2-453b-bdd2-45e5b6a868f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:48.003352 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028f00dd-51e2-453b-bdd2-45e5b6a868f1 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:48.025790 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1399/2793] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:30:47 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:30:48.029836 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10adda-6792-47e5-9f71-6f6034fb82be admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:48.040171 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec10adda-6792-47e5-9f71-6f6034fb82be admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:48.045210 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b48b17-3b39-4996-88af-aefca03cb6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:48.045890 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b48b17-3b39-4996-88af-aefca03cb6d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:48.046173 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b48b17-3b39-4996-88af-aefca03cb6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:48.046454 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b48b17-3b39-4996-88af-aefca03cb6d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:48.047175 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b48b17-3b39-4996-88af-aefca03cb6d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:48.048767 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b48b17-3b39-4996-88af-aefca03cb6d0 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:48.059877 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1395/2794] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:30:48.063807 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f00dd-51e2-453b-bdd2-45e5b6a868f1 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:48.073416 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f00dd-51e2-453b-bdd2-45e5b6a868f1 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:48.078416 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702e2e7-0ab0-459b-8e77-b8bad5ed0932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:48.079473 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702e2e7-0ab0-459b-8e77-b8bad5ed0932 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:48.079754 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702e2e7-0ab0-459b-8e77-b8bad5ed0932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:48.080027 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702e2e7-0ab0-459b-8e77-b8bad5ed0932 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:48.080787 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e702e2e7-0ab0-459b-8e77-b8bad5ed0932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:48.082426 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e702e2e7-0ab0-459b-8e77-b8bad5ed0932 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:48.093499 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1400/2795] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:30:48.096873 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b48b17-3b39-4996-88af-aefca03cb6d0 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:48.106734 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702e2e7-0ab0-459b-8e77-b8bad5ed0932 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:48.107905 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b48b17-3b39-4996-88af-aefca03cb6d0 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:48.108537 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-e702e2e7-0ab0-459b-8e77-b8bad5ed0932 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:48.117985 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e254338-020a-4189-b784-576ae3d14779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:48.118878 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e254338-020a-4189-b784-576ae3d14779 admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:48.119287 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e254338-020a-4189-b784-576ae3d14779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:48.119863 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e254338-020a-4189-b784-576ae3d14779 admin admin] PATH_INFO: `/v3/projects/bca68836b7df466cbd066f05faaa6db1/users/c676cb6822ba4c9493cc5f00cd709b2a/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:48.122373 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702e2e7-0ab0-459b-8e77-b8bad5ed0932 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:48.128152 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d93ebe2-b8b9-4332-87e2-0e6fa11d2f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:48.129005 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93ebe2-b8b9-4332-87e2-0e6fa11d2f62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:48.129286 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93ebe2-b8b9-4332-87e2-0e6fa11d2f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:48.129584 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93ebe2-b8b9-4332-87e2-0e6fa11d2f62 admin admin] PATH_INFO: `/v3/projects/9becbd66e497483bb1c1021f109c5151` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:48.130860 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d93ebe2-b8b9-4332-87e2-0e6fa11d2f62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9becbd66e497483bb1c1021f109c5151)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:48.132841 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d93ebe2-b8b9-4332-87e2-0e6fa11d2f62 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:48.135559 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e254338-020a-4189-b784-576ae3d14779 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bca68836b7df466cbd066f05faaa6db1, user_id=c676cb6822ba4c9493cc5f00cd709b2a, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:48.138176 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e254338-020a-4189-b784-576ae3d14779 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:48.151881 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1396/2796] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:30:48 2022] PUT /identity/v3/projects/bca68836b7df466cbd066f05faaa6db1/users/c676cb6822ba4c9493cc5f00cd709b2a/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:30:48.163603 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3cf9f-c6d7-4122-ad3c-b0a4811f9720 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:48.163960 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3cf9f-c6d7-4122-ad3c-b0a4811f9720 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:48.164300 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3cf9f-c6d7-4122-ad3c-b0a4811f9720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:48.180391 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-5d93ebe2-b8b9-4332-87e2-0e6fa11d2f62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9becbd66e497483bb1c1021f109c5151', 'request_id': 'req-5d93ebe2-b8b9-4332-87e2-0e6fa11d2f62'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:48.187529 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-5d93ebe2-b8b9-4332-87e2-0e6fa11d2f62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9becbd66e497483bb1c1021f109c5151', 'request_id': 'req-5d93ebe2-b8b9-4332-87e2-0e6fa11d2f62'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:48.191653 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-25a3cf9f-c6d7-4122-ad3c-b0a4811f9720 None None] MFA Rules not processed for user `c676cb6822ba4c9493cc5f00cd709b2a`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:30:48.192878 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-25a3cf9f-c6d7-4122-ad3c-b0a4811f9720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:48.195818 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-5d93ebe2-b8b9-4332-87e2-0e6fa11d2f62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9becbd66e497483bb1c1021f109c5151', 'request_id': 'req-5d93ebe2-b8b9-4332-87e2-0e6fa11d2f62'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:48.206567 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-5d93ebe2-b8b9-4332-87e2-0e6fa11d2f62 admin admin] The token cache is being invalidate because project 9becbd66e497483bb1c1021f109c5151 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:30:48.206880 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-5d93ebe2-b8b9-4332-87e2-0e6fa11d2f62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:48.207572 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-5d93ebe2-b8b9-4332-87e2-0e6fa11d2f62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:48.209199 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1401/2797] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:30:48 2022] DELETE /identity/v3/projects/9becbd66e497483bb1c1021f109c5151 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:30:48.214459 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ce8ed-0b43-474f-979c-1197d37648e0 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:48.214741 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ce8ed-0b43-474f-979c-1197d37648e0 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:48.215034 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ce8ed-0b43-474f-979c-1197d37648e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:48.232845 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-c16ce8ed-0b43-474f-979c-1197d37648e0 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:30:48.234186 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-c16ce8ed-0b43-474f-979c-1197d37648e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:48.256437 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1397/2798] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:30:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:30:48.260789 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a3cf9f-c6d7-4122-ad3c-b0a4811f9720 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:48.262125 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-25a3cf9f-c6d7-4122-ad3c-b0a4811f9720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:48.291709 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1402/2799] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:30:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:30:48.299729 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f7694-4e59-4562-871f-98f4e90d0724 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:48.300015 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f7694-4e59-4562-871f-98f4e90d0724 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:48.300291 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f7694-4e59-4562-871f-98f4e90d0724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:48.317864 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-6c9f7694-4e59-4562-871f-98f4e90d0724 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:30:48.319034 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-6c9f7694-4e59-4562-871f-98f4e90d0724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:48.326734 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1403/2800] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:30:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:30:48.329880 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a3cf9f-c6d7-4122-ad3c-b0a4811f9720 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:48.331084 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f7694-4e59-4562-871f-98f4e90d0724 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:48.334804 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96040171-2ae8-464f-b871-48a447151192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:48.335455 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96040171-2ae8-464f-b871-48a447151192 admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:48.336470 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96040171-2ae8-464f-b871-48a447151192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:48.336470 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96040171-2ae8-464f-b871-48a447151192 admin admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:48.336665 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96040171-2ae8-464f-b871-48a447151192 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:48.338573 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96040171-2ae8-464f-b871-48a447151192 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:48.339988 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f7694-4e59-4562-871f-98f4e90d0724 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:48.345086 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c6025b-ed71-4d93-b2fa-81180bcc48cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:48.346043 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6025b-ed71-4d93-b2fa-81180bcc48cb admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:48.346043 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6025b-ed71-4d93-b2fa-81180bcc48cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:48.346258 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6025b-ed71-4d93-b2fa-81180bcc48cb admin admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:48.347072 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c6025b-ed71-4d93-b2fa-81180bcc48cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:30:48.347274 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c6025b-ed71-4d93-b2fa-81180bcc48cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:48.348906 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c6025b-ed71-4d93-b2fa-81180bcc48cb admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:48.361781 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1404/2801] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 17 18:30:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:30:48.365945 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c6025b-ed71-4d93-b2fa-81180bcc48cb admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:48.367310 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1398/2802] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:30:48 2022] POST /identity/v3/projects => generated 387 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:30:48.371001 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96040171-2ae8-464f-b871-48a447151192 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:48.375799 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c6025b-ed71-4d93-b2fa-81180bcc48cb admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:48.429746 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96040171-2ae8-464f-b871-48a447151192 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:48.430009 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53afdd25-da85-4887-950d-17af30ae78bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:48.430530 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53afdd25-da85-4887-950d-17af30ae78bd admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:48.430816 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53afdd25-da85-4887-950d-17af30ae78bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:48.431195 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53afdd25-da85-4887-950d-17af30ae78bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:48.431883 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53afdd25-da85-4887-950d-17af30ae78bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:48.433814 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53afdd25-da85-4887-950d-17af30ae78bd admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:48.435055 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1f2c8-af08-4f36-a2f9-70019aa9289c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:48.435712 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1f2c8-af08-4f36-a2f9-70019aa9289c admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:48.436022 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1f2c8-af08-4f36-a2f9-70019aa9289c admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:48.436300 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1f2c8-af08-4f36-a2f9-70019aa9289c admin admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:48.436982 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c1f2c8-af08-4f36-a2f9-70019aa9289c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:48.438908 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c1f2c8-af08-4f36-a2f9-70019aa9289c admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:48.459749 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1399/2803] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:30:48 2022] POST /identity/v3/users => generated 300 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:30:48.460661 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1405/2804] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:30:48 2022] POST /identity/v3/projects => generated 371 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:30:48.463637 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1f2c8-af08-4f36-a2f9-70019aa9289c admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:48.464343 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53afdd25-da85-4887-950d-17af30ae78bd admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:48.473146 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1f2c8-af08-4f36-a2f9-70019aa9289c admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:48.528565 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c059c5cb-54bf-4691-be5c-48b761162459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:48.529258 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059c5cb-54bf-4691-be5c-48b761162459 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:48.529443 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53afdd25-da85-4887-950d-17af30ae78bd admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:48.529577 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059c5cb-54bf-4691-be5c-48b761162459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:48.529838 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059c5cb-54bf-4691-be5c-48b761162459 admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:48.530576 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c059c5cb-54bf-4691-be5c-48b761162459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:48.532181 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c059c5cb-54bf-4691-be5c-48b761162459 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:48.534057 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ce87c-1d94-4564-ae3d-050d1b196967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:48.534699 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ce87c-1d94-4564-ae3d-050d1b196967 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:48.534975 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ce87c-1d94-4564-ae3d-050d1b196967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:48.535242 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ce87c-1d94-4564-ae3d-050d1b196967 admin admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:48.535931 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84ce87c-1d94-4564-ae3d-050d1b196967 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:48.538001 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84ce87c-1d94-4564-ae3d-050d1b196967 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:48.542238 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1400/2805] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:30:48.546413 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c059c5cb-54bf-4691-be5c-48b761162459 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:48.555655 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c059c5cb-54bf-4691-be5c-48b761162459 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:48.561483 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1406/2806] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:30:48 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:30:48.561647 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be3f5d-9deb-4a75-8673-78533afdc9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:48.561647 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be3f5d-9deb-4a75-8673-78533afdc9c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:48.561832 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be3f5d-9deb-4a75-8673-78533afdc9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:48.562061 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be3f5d-9deb-4a75-8673-78533afdc9c0 admin admin] PATH_INFO: `/v3/projects/95bf45d183e24d6ab51cb23c2b8e0b91/users/62759938ccce450789397321d5ea8562/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:48.562467 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ce87c-1d94-4564-ae3d-050d1b196967 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:48.571876 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ce87c-1d94-4564-ae3d-050d1b196967 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:48.576856 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90be3f5d-9deb-4a75-8673-78533afdc9c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95bf45d183e24d6ab51cb23c2b8e0b91, user_id=62759938ccce450789397321d5ea8562, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:48.577253 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009fda39-275b-41db-8039-3239b59d41e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:48.577927 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009fda39-275b-41db-8039-3239b59d41e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:48.578467 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009fda39-275b-41db-8039-3239b59d41e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:48.578743 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009fda39-275b-41db-8039-3239b59d41e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:48.579449 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009fda39-275b-41db-8039-3239b59d41e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:48.579777 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90be3f5d-9deb-4a75-8673-78533afdc9c0 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:48.581066 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009fda39-275b-41db-8039-3239b59d41e3 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:48.591002 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1407/2807] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:30:48.592033 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1401/2808] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:30:48 2022] PUT /identity/v3/projects/95bf45d183e24d6ab51cb23c2b8e0b91/users/62759938ccce450789397321d5ea8562/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:30:48.595200 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009fda39-275b-41db-8039-3239b59d41e3 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:48.595721 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be3f5d-9deb-4a75-8673-78533afdc9c0 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:48.604896 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009fda39-275b-41db-8039-3239b59d41e3 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:48.656453 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be3f5d-9deb-4a75-8673-78533afdc9c0 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:48.657968 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62828fc6-91b4-496d-bb2c-34891a13d37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:48.658723 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62828fc6-91b4-496d-bb2c-34891a13d37b admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:48.658999 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62828fc6-91b4-496d-bb2c-34891a13d37b admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:48.659270 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62828fc6-91b4-496d-bb2c-34891a13d37b admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:48.659981 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62828fc6-91b4-496d-bb2c-34891a13d37b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:48.661304 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a976f49-fc22-4e2e-ae28-2082921ec4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:48.661594 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62828fc6-91b4-496d-bb2c-34891a13d37b admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:48.661986 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a976f49-fc22-4e2e-ae28-2082921ec4ca admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:48.662270 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a976f49-fc22-4e2e-ae28-2082921ec4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:48.662555 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a976f49-fc22-4e2e-ae28-2082921ec4ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:48.663336 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a976f49-fc22-4e2e-ae28-2082921ec4ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:48.665142 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a976f49-fc22-4e2e-ae28-2082921ec4ca admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:48.671071 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1408/2809] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:30:48.677776 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1402/2810] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:30:48.677950 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62828fc6-91b4-496d-bb2c-34891a13d37b admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:48.678694 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a976f49-fc22-4e2e-ae28-2082921ec4ca admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:48.686182 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62828fc6-91b4-496d-bb2c-34891a13d37b admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:48.688201 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a976f49-fc22-4e2e-ae28-2082921ec4ca admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:48.690790 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8183d306-abcb-4d47-a4ec-ba370e670c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:48.691643 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183d306-abcb-4d47-a4ec-ba370e670c6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:48.691922 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183d306-abcb-4d47-a4ec-ba370e670c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:48.692195 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183d306-abcb-4d47-a4ec-ba370e670c6c admin admin] PATH_INFO: `/v3/projects/aeffb9525ab24cefafa2971221ec61de/users/9b4b2a3a7a5446869aaafb2a4f80a600/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:48.692657 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba5cce-c620-447b-bb2e-101b44d7aa70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:48.693989 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba5cce-c620-447b-bb2e-101b44d7aa70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:48.694264 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba5cce-c620-447b-bb2e-101b44d7aa70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:48.694535 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba5cce-c620-447b-bb2e-101b44d7aa70 admin admin] PATH_INFO: `/v3/projects/95bf45d183e24d6ab51cb23c2b8e0b91/users/62759938ccce450789397321d5ea8562/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:48.696500 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ba5cce-c620-447b-bb2e-101b44d7aa70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95bf45d183e24d6ab51cb23c2b8e0b91, user_id=62759938ccce450789397321d5ea8562, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:48.699157 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ba5cce-c620-447b-bb2e-101b44d7aa70 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:48.707366 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8183d306-abcb-4d47-a4ec-ba370e670c6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=aeffb9525ab24cefafa2971221ec61de, user_id=9b4b2a3a7a5446869aaafb2a4f80a600, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:48.710012 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8183d306-abcb-4d47-a4ec-ba370e670c6c admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:48.710141 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1403/2811] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:30:48 2022] PUT /identity/v3/projects/95bf45d183e24d6ab51cb23c2b8e0b91/users/62759938ccce450789397321d5ea8562/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:30:48.720187 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52223833-1d18-41eb-93db-3d14f7808f53 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:48.720469 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52223833-1d18-41eb-93db-3d14f7808f53 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:48.720743 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52223833-1d18-41eb-93db-3d14f7808f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:48.722521 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1409/2812] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:30:48 2022] PUT /identity/v3/projects/aeffb9525ab24cefafa2971221ec61de/users/9b4b2a3a7a5446869aaafb2a4f80a600/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:30:48.732445 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6174f04d-8401-4611-8b23-8ec3aa0cb756 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:48.732725 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6174f04d-8401-4611-8b23-8ec3aa0cb756 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:48.732994 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6174f04d-8401-4611-8b23-8ec3aa0cb756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:48.746105 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-52223833-1d18-41eb-93db-3d14f7808f53 None None] MFA Rules not processed for user `62759938ccce450789397321d5ea8562`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:30:48.747824 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-52223833-1d18-41eb-93db-3d14f7808f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:48.759137 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-6174f04d-8401-4611-8b23-8ec3aa0cb756 None None] MFA Rules not processed for user `9b4b2a3a7a5446869aaafb2a4f80a600`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:30:48.760301 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-6174f04d-8401-4611-8b23-8ec3aa0cb756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:48.817543 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1404/2813] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:30:48 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:30:48.824995 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52223833-1d18-41eb-93db-3d14f7808f53 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:48.825187 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1410/2814] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:30:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:30:48.826525 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-52223833-1d18-41eb-93db-3d14f7808f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:48.840669 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6174f04d-8401-4611-8b23-8ec3aa0cb756 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:48.842039 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-6174f04d-8401-4611-8b23-8ec3aa0cb756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:48.882005 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52223833-1d18-41eb-93db-3d14f7808f53 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:48.885604 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5428c-2376-4823-bb79-39e1b5570776 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:48.886270 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5428c-2376-4823-bb79-39e1b5570776 service cinder] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:48.886549 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5428c-2376-4823-bb79-39e1b5570776 service cinder] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:48.886820 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5428c-2376-4823-bb79-39e1b5570776 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:48.895597 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe5428c-2376-4823-bb79-39e1b5570776 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:48.896139 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6174f04d-8401-4611-8b23-8ec3aa0cb756 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:48.897023 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe5428c-2376-4823-bb79-39e1b5570776 service cinder] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:48.899719 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758517b-e4a6-45df-87ec-106f12bd7ce2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:48.900343 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758517b-e4a6-45df-87ec-106f12bd7ce2 service cinder] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:48.900619 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758517b-e4a6-45df-87ec-106f12bd7ce2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:48.900889 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758517b-e4a6-45df-87ec-106f12bd7ce2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:48.906431 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1405/2815] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:30:48 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:30:48.909340 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4758517b-e4a6-45df-87ec-106f12bd7ce2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:48.910784 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4758517b-e4a6-45df-87ec-106f12bd7ce2 service cinder] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:48.920223 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1411/2816] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:30:48 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:30:49.454179 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5428c-2376-4823-bb79-39e1b5570776 service cinder] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:49.513984 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5428c-2376-4823-bb79-39e1b5570776 service cinder] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:49.518487 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a574eab-0b13-466c-a666-8db5b68d743f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:49.519339 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a574eab-0b13-466c-a666-8db5b68d743f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:49.519618 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a574eab-0b13-466c-a666-8db5b68d743f admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:49.519891 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a574eab-0b13-466c-a666-8db5b68d743f admin admin] PATH_INFO: `/v3/users/c676cb6822ba4c9493cc5f00cd709b2a` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:49.521062 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a574eab-0b13-466c-a666-8db5b68d743f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c676cb6822ba4c9493cc5f00cd709b2a)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:49.523018 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a574eab-0b13-466c-a666-8db5b68d743f admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:49.567648 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-8a574eab-0b13-466c-a666-8db5b68d743f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c676cb6822ba4c9493cc5f00cd709b2a'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:49.574243 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-8a574eab-0b13-466c-a666-8db5b68d743f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c676cb6822ba4c9493cc5f00cd709b2a'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:49.575388 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-8a574eab-0b13-466c-a666-8db5b68d743f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c676cb6822ba4c9493cc5f00cd709b2a'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:49.582515 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-8a574eab-0b13-466c-a666-8db5b68d743f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c676cb6822ba4c9493cc5f00cd709b2a'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:49.583118 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-8a574eab-0b13-466c-a666-8db5b68d743f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c676cb6822ba4c9493cc5f00cd709b2a'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:49.600537 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1406/2817] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:30:49 2022] DELETE /identity/v3/users/c676cb6822ba4c9493cc5f00cd709b2a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:30:49.605073 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e345c-965d-473a-b7b4-9910e499b4b1 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:49.605564 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e345c-965d-473a-b7b4-9910e499b4b1 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:49.605661 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e345c-965d-473a-b7b4-9910e499b4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:49.622313 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-355e345c-965d-473a-b7b4-9910e499b4b1 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:30:49.623431 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-355e345c-965d-473a-b7b4-9910e499b4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:49.679783 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1412/2818] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:30:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:30:49.689399 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a574eab-0b13-466c-a666-8db5b68d743f admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:49.690809 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-8a574eab-0b13-466c-a666-8db5b68d743f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:49.746763 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a574eab-0b13-466c-a666-8db5b68d743f admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:49.750336 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d3a390-4e8d-41dd-b683-b401dd45433a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:49.750961 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d3a390-4e8d-41dd-b683-b401dd45433a service neutron] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:49.751238 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d3a390-4e8d-41dd-b683-b401dd45433a service neutron] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:49.751511 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d3a390-4e8d-41dd-b683-b401dd45433a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:49.760179 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d3a390-4e8d-41dd-b683-b401dd45433a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:49.761620 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d3a390-4e8d-41dd-b683-b401dd45433a service neutron] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:49.771094 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1407/2819] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:30:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:30:50.048292 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e345c-965d-473a-b7b4-9910e499b4b1 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:50.049863 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-355e345c-965d-473a-b7b4-9910e499b4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:50.062729 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e345c-965d-473a-b7b4-9910e499b4b1 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:50.067415 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f6c08-a472-4c31-b1a1-4c8fcbfec714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:50.068784 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f6c08-a472-4c31-b1a1-4c8fcbfec714 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:50.069230 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f6c08-a472-4c31-b1a1-4c8fcbfec714 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:50.069539 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f6c08-a472-4c31-b1a1-4c8fcbfec714 admin admin] PATH_INFO: `/v3/projects/bca68836b7df466cbd066f05faaa6db1` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:50.070797 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8f6c08-a472-4c31-b1a1-4c8fcbfec714 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bca68836b7df466cbd066f05faaa6db1)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:50.072728 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8f6c08-a472-4c31-b1a1-4c8fcbfec714 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:50.118078 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-3a8f6c08-a472-4c31-b1a1-4c8fcbfec714 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bca68836b7df466cbd066f05faaa6db1', 'request_id': 'req-3a8f6c08-a472-4c31-b1a1-4c8fcbfec714'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:50.124424 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-3a8f6c08-a472-4c31-b1a1-4c8fcbfec714 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bca68836b7df466cbd066f05faaa6db1', 'request_id': 'req-3a8f6c08-a472-4c31-b1a1-4c8fcbfec714'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:50.131456 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-3a8f6c08-a472-4c31-b1a1-4c8fcbfec714 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bca68836b7df466cbd066f05faaa6db1', 'request_id': 'req-3a8f6c08-a472-4c31-b1a1-4c8fcbfec714'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:50.142720 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-3a8f6c08-a472-4c31-b1a1-4c8fcbfec714 admin admin] The token cache is being invalidate because project bca68836b7df466cbd066f05faaa6db1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:30:50.143005 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-3a8f6c08-a472-4c31-b1a1-4c8fcbfec714 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:50.143609 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-3a8f6c08-a472-4c31-b1a1-4c8fcbfec714 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:50.145130 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1413/2820] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:30:50 2022] DELETE /identity/v3/projects/bca68836b7df466cbd066f05faaa6db1 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:30:50.149079 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d3a390-4e8d-41dd-b683-b401dd45433a service neutron] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:50.158867 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d3a390-4e8d-41dd-b683-b401dd45433a service neutron] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:50.213488 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f59e9d-758f-4f3d-93de-43b27ee1dad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:50.214351 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f59e9d-758f-4f3d-93de-43b27ee1dad4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:50.214625 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f59e9d-758f-4f3d-93de-43b27ee1dad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:50.216217 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f59e9d-758f-4f3d-93de-43b27ee1dad4 admin admin] PATH_INFO: `/v3/users/62759938ccce450789397321d5ea8562` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:50.216217 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f59e9d-758f-4f3d-93de-43b27ee1dad4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62759938ccce450789397321d5ea8562)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:50.218490 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f59e9d-758f-4f3d-93de-43b27ee1dad4 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:50.263763 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-07f59e9d-758f-4f3d-93de-43b27ee1dad4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62759938ccce450789397321d5ea8562'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:50.270790 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-07f59e9d-758f-4f3d-93de-43b27ee1dad4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62759938ccce450789397321d5ea8562'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:50.271456 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-07f59e9d-758f-4f3d-93de-43b27ee1dad4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62759938ccce450789397321d5ea8562'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:50.279929 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-07f59e9d-758f-4f3d-93de-43b27ee1dad4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62759938ccce450789397321d5ea8562'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:50.280691 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-07f59e9d-758f-4f3d-93de-43b27ee1dad4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62759938ccce450789397321d5ea8562'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:50.299273 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1408/2821] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:30:50 2022] DELETE /identity/v3/users/62759938ccce450789397321d5ea8562 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:30:50.566413 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f6c08-a472-4c31-b1a1-4c8fcbfec714 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:50.568013 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-3a8f6c08-a472-4c31-b1a1-4c8fcbfec714 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:50.583213 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f6c08-a472-4c31-b1a1-4c8fcbfec714 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:50.646391 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7a95c4-cdec-4c59-8bcb-9267d7c06998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:50.647144 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a95c4-cdec-4c59-8bcb-9267d7c06998 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:50.647421 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a95c4-cdec-4c59-8bcb-9267d7c06998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:50.647688 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7a95c4-cdec-4c59-8bcb-9267d7c06998 admin admin] PATH_INFO: `/v3/projects/95bf45d183e24d6ab51cb23c2b8e0b91` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:50.648842 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7a95c4-cdec-4c59-8bcb-9267d7c06998 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95bf45d183e24d6ab51cb23c2b8e0b91)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:50.650749 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7a95c4-cdec-4c59-8bcb-9267d7c06998 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:50.697108 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-ce7a95c4-cdec-4c59-8bcb-9267d7c06998 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95bf45d183e24d6ab51cb23c2b8e0b91', 'request_id': 'req-ce7a95c4-cdec-4c59-8bcb-9267d7c06998'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:50.703582 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-ce7a95c4-cdec-4c59-8bcb-9267d7c06998 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95bf45d183e24d6ab51cb23c2b8e0b91', 'request_id': 'req-ce7a95c4-cdec-4c59-8bcb-9267d7c06998'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:50.711065 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-ce7a95c4-cdec-4c59-8bcb-9267d7c06998 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95bf45d183e24d6ab51cb23c2b8e0b91', 'request_id': 'req-ce7a95c4-cdec-4c59-8bcb-9267d7c06998'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:50.721757 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-ce7a95c4-cdec-4c59-8bcb-9267d7c06998 admin admin] The token cache is being invalidate because project 95bf45d183e24d6ab51cb23c2b8e0b91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:30:50.722037 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-ce7a95c4-cdec-4c59-8bcb-9267d7c06998 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:50.722658 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-ce7a95c4-cdec-4c59-8bcb-9267d7c06998 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:50.724189 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1414/2822] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:30:50 2022] DELETE /identity/v3/projects/95bf45d183e24d6ab51cb23c2b8e0b91 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:30:50.729108 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c7c528-9d1d-4ec8-8170-2b9a875bf8ed None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:50.729644 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c7c528-9d1d-4ec8-8170-2b9a875bf8ed None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:50.729871 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c7c528-9d1d-4ec8-8170-2b9a875bf8ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:50.749337 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-f6c7c528-9d1d-4ec8-8170-2b9a875bf8ed None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:30:50.750836 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-f6c7c528-9d1d-4ec8-8170-2b9a875bf8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:50.810373 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1409/2823] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:30:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:30:50.818937 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5704d-da46-4598-bba0-fbed34f4b65b None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:50.819227 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5704d-da46-4598-bba0-fbed34f4b65b None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:50.819504 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5704d-da46-4598-bba0-fbed34f4b65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:50.839370 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-81a5704d-da46-4598-bba0-fbed34f4b65b None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:30:50.841217 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-81a5704d-da46-4598-bba0-fbed34f4b65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:50.852633 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1415/2824] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:30:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:30:50.857825 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c7c528-9d1d-4ec8-8170-2b9a875bf8ed None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:50.868042 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c7c528-9d1d-4ec8-8170-2b9a875bf8ed None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:50.872827 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9151f7f1-6931-4934-970e-d689ca1ed6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:50.873796 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151f7f1-6931-4934-970e-d689ca1ed6f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:50.874073 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151f7f1-6931-4934-970e-d689ca1ed6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:50.874597 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9151f7f1-6931-4934-970e-d689ca1ed6f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:50.875318 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9151f7f1-6931-4934-970e-d689ca1ed6f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:30:50.876419 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9151f7f1-6931-4934-970e-d689ca1ed6f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:50.878180 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9151f7f1-6931-4934-970e-d689ca1ed6f8 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:50.889842 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1410/2825] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 17 18:30:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:30:50.894362 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a5704d-da46-4598-bba0-fbed34f4b65b None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:50.903887 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a5704d-da46-4598-bba0-fbed34f4b65b None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:50.908525 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e30056-bde3-4dfe-8e47-c90b828afe91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:50.909165 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e30056-bde3-4dfe-8e47-c90b828afe91 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:50.909449 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e30056-bde3-4dfe-8e47-c90b828afe91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:50.909759 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e30056-bde3-4dfe-8e47-c90b828afe91 admin admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:50.910495 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e30056-bde3-4dfe-8e47-c90b828afe91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:50.912380 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e30056-bde3-4dfe-8e47-c90b828afe91 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:50.937025 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1416/2826] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:30:50 2022] POST /identity/v3/projects => generated 379 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:30:50.941132 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9151f7f1-6931-4934-970e-d689ca1ed6f8 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:50.951085 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9151f7f1-6931-4934-970e-d689ca1ed6f8 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:51.009415 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c42b0e-ea7e-41b3-bcb3-f10acbd4c2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:51.010119 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c42b0e-ea7e-41b3-bcb3-f10acbd4c2b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:51.010396 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c42b0e-ea7e-41b3-bcb3-f10acbd4c2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:51.010720 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c42b0e-ea7e-41b3-bcb3-f10acbd4c2b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:51.011479 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c42b0e-ea7e-41b3-bcb3-f10acbd4c2b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:51.013449 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c42b0e-ea7e-41b3-bcb3-f10acbd4c2b6 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:51.033121 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1411/2827] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:30:50 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:30:51.037524 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e30056-bde3-4dfe-8e47-c90b828afe91 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:51.048837 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e30056-bde3-4dfe-8e47-c90b828afe91 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:51.053404 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec8dfc-0baf-4138-8bbc-62d6c514bcf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:51.054076 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec8dfc-0baf-4138-8bbc-62d6c514bcf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:51.054351 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec8dfc-0baf-4138-8bbc-62d6c514bcf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:51.054615 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec8dfc-0baf-4138-8bbc-62d6c514bcf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:51.055359 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfec8dfc-0baf-4138-8bbc-62d6c514bcf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:51.056930 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfec8dfc-0baf-4138-8bbc-62d6c514bcf0 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:51.067100 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1417/2828] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:30:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:30:51.071034 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c42b0e-ea7e-41b3-bcb3-f10acbd4c2b6 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:51.081324 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c42b0e-ea7e-41b3-bcb3-f10acbd4c2b6 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:51.085884 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcd7082-d0da-4140-ae4e-839564a17dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:51.086521 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd7082-d0da-4140-ae4e-839564a17dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:51.086798 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd7082-d0da-4140-ae4e-839564a17dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:51.087070 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd7082-d0da-4140-ae4e-839564a17dd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:51.087784 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcd7082-d0da-4140-ae4e-839564a17dd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:51.089384 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcd7082-d0da-4140-ae4e-839564a17dd9 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:51.101335 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1412/2829] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:30:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:30:51.105522 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec8dfc-0baf-4138-8bbc-62d6c514bcf0 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:51.115220 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec8dfc-0baf-4138-8bbc-62d6c514bcf0 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:51.119841 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e834829-f24b-40d8-81ce-609f0e65b653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:51.120696 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e834829-f24b-40d8-81ce-609f0e65b653 admin admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:51.120974 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e834829-f24b-40d8-81ce-609f0e65b653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:51.121245 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e834829-f24b-40d8-81ce-609f0e65b653 admin admin] PATH_INFO: `/v3/projects/9ca64116b22442f0a8f76f10f0cf0d97/users/5920bb7253cf4994a4110a189466c800/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:51.135367 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e834829-f24b-40d8-81ce-609f0e65b653 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ca64116b22442f0a8f76f10f0cf0d97, user_id=5920bb7253cf4994a4110a189466c800, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:51.138538 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e834829-f24b-40d8-81ce-609f0e65b653 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:51.151119 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1418/2830] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:30:51 2022] PUT /identity/v3/projects/9ca64116b22442f0a8f76f10f0cf0d97/users/5920bb7253cf4994a4110a189466c800/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:30:51.163402 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45383c8f-bfcb-4510-9831-1751baef829b None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:51.163691 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45383c8f-bfcb-4510-9831-1751baef829b None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:51.163970 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45383c8f-bfcb-4510-9831-1751baef829b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:51.188948 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-45383c8f-bfcb-4510-9831-1751baef829b None None] MFA Rules not processed for user `5920bb7253cf4994a4110a189466c800`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:30:51.190178 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-45383c8f-bfcb-4510-9831-1751baef829b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:51.251546 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1413/2831] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:30:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:30:51.256211 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e834829-f24b-40d8-81ce-609f0e65b653 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:51.315249 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e834829-f24b-40d8-81ce-609f0e65b653 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:51.319878 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351fb738-425b-4910-8678-1a174c37f7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:51.320516 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351fb738-425b-4910-8678-1a174c37f7b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:51.320795 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351fb738-425b-4910-8678-1a174c37f7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:51.321066 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351fb738-425b-4910-8678-1a174c37f7b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:51.321791 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351fb738-425b-4910-8678-1a174c37f7b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:51.323678 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351fb738-425b-4910-8678-1a174c37f7b7 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:51.348346 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1419/2832] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:30:51 2022] POST /identity/v3/projects => generated 381 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:30:51.352344 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45383c8f-bfcb-4510-9831-1751baef829b None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:51.362665 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45383c8f-bfcb-4510-9831-1751baef829b None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:51.416912 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f2ca78-f76e-4cfc-918a-596e4962d7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:51.417587 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2ca78-f76e-4cfc-918a-596e4962d7f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:51.417872 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2ca78-f76e-4cfc-918a-596e4962d7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:51.418147 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2ca78-f76e-4cfc-918a-596e4962d7f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:51.418824 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f2ca78-f76e-4cfc-918a-596e4962d7f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:51.420713 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f2ca78-f76e-4cfc-918a-596e4962d7f1 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:51.440287 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1414/2833] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:30:51 2022] POST /identity/v3/users => generated 297 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:30:51.444268 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351fb738-425b-4910-8678-1a174c37f7b7 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:51.455460 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351fb738-425b-4910-8678-1a174c37f7b7 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:51.460013 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c447134-5e3f-4a6d-a060-36d0d0415768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:51.460662 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c447134-5e3f-4a6d-a060-36d0d0415768 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:51.460939 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c447134-5e3f-4a6d-a060-36d0d0415768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:51.461206 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c447134-5e3f-4a6d-a060-36d0d0415768 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:51.461947 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c447134-5e3f-4a6d-a060-36d0d0415768 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:51.463556 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c447134-5e3f-4a6d-a060-36d0d0415768 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:51.478371 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1420/2834] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:30:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:30:51.479562 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f2ca78-f76e-4cfc-918a-596e4962d7f1 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:51.489562 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f2ca78-f76e-4cfc-918a-596e4962d7f1 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:51.494948 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f22a7-d943-4505-bc47-d0131aacfe4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:51.495814 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f22a7-d943-4505-bc47-d0131aacfe4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:51.496089 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f22a7-d943-4505-bc47-d0131aacfe4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:51.496362 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f22a7-d943-4505-bc47-d0131aacfe4a admin admin] PATH_INFO: `/v3/projects/e5cf2cd2efe4450093c3903e62ade39d/users/c91a677eab654e3f9feed51429ba6cc6/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:51.511033 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2f22a7-d943-4505-bc47-d0131aacfe4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5cf2cd2efe4450093c3903e62ade39d, user_id=c91a677eab654e3f9feed51429ba6cc6, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:51.514357 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2f22a7-d943-4505-bc47-d0131aacfe4a admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:51.526615 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1415/2835] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:30:51 2022] PUT /identity/v3/projects/e5cf2cd2efe4450093c3903e62ade39d/users/c91a677eab654e3f9feed51429ba6cc6/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:30:51.530588 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c447134-5e3f-4a6d-a060-36d0d0415768 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:51.540213 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c447134-5e3f-4a6d-a060-36d0d0415768 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:51.594400 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4742113-899f-4986-b88d-31291eb30087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:51.595055 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4742113-899f-4986-b88d-31291eb30087 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:51.595338 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4742113-899f-4986-b88d-31291eb30087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:51.595615 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4742113-899f-4986-b88d-31291eb30087 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:51.596328 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4742113-899f-4986-b88d-31291eb30087 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:51.598173 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4742113-899f-4986-b88d-31291eb30087 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:51.607675 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1421/2836] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:30:51 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:30:51.611779 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f22a7-d943-4505-bc47-d0131aacfe4a admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:51.622332 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f22a7-d943-4505-bc47-d0131aacfe4a admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:51.626889 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f72732c-c184-4af3-8935-0419dd36279c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:51.627747 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72732c-c184-4af3-8935-0419dd36279c admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:51.628027 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72732c-c184-4af3-8935-0419dd36279c admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:51.628300 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72732c-c184-4af3-8935-0419dd36279c admin admin] PATH_INFO: `/v3/projects/e5cf2cd2efe4450093c3903e62ade39d/users/c91a677eab654e3f9feed51429ba6cc6/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:51.630257 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f72732c-c184-4af3-8935-0419dd36279c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5cf2cd2efe4450093c3903e62ade39d, user_id=c91a677eab654e3f9feed51429ba6cc6, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:51.632860 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f72732c-c184-4af3-8935-0419dd36279c admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:51.644361 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1416/2837] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:30:51 2022] PUT /identity/v3/projects/e5cf2cd2efe4450093c3903e62ade39d/users/c91a677eab654e3f9feed51429ba6cc6/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:30:51.654356 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c854d4-89c3-405a-a531-66e210303da0 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:51.654819 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c854d4-89c3-405a-a531-66e210303da0 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:51.654956 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c854d4-89c3-405a-a531-66e210303da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:51.679956 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-c5c854d4-89c3-405a-a531-66e210303da0 None None] MFA Rules not processed for user `c91a677eab654e3f9feed51429ba6cc6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:30:51.681084 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-c5c854d4-89c3-405a-a531-66e210303da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:51.748902 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1422/2838] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:30:51 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:30:51.759723 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f72732c-c184-4af3-8935-0419dd36279c admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:51.761399 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-9f72732c-c184-4af3-8935-0419dd36279c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:51.838630 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f72732c-c184-4af3-8935-0419dd36279c admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:51.842308 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e829108a-9543-47a7-ad3d-e5c3b394fbc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:51.842984 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829108a-9543-47a7-ad3d-e5c3b394fbc8 service cinder] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:51.843246 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829108a-9543-47a7-ad3d-e5c3b394fbc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:51.843525 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829108a-9543-47a7-ad3d-e5c3b394fbc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:51.852441 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e829108a-9543-47a7-ad3d-e5c3b394fbc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:51.853915 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e829108a-9543-47a7-ad3d-e5c3b394fbc8 service cinder] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:51.863548 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1417/2839] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:30:51 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:30:51.908130 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c854d4-89c3-405a-a531-66e210303da0 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:51.909626 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-c5c854d4-89c3-405a-a531-66e210303da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:51.974123 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c854d4-89c3-405a-a531-66e210303da0 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:51.978678 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1864f1f6-932d-46b5-974c-391c90fb5169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:51.979569 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864f1f6-932d-46b5-974c-391c90fb5169 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:51.979848 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864f1f6-932d-46b5-974c-391c90fb5169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:51.980125 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1864f1f6-932d-46b5-974c-391c90fb5169 admin admin] PATH_INFO: `/v3/users/9b4b2a3a7a5446869aaafb2a4f80a600` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:51.982218 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1864f1f6-932d-46b5-974c-391c90fb5169 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b4b2a3a7a5446869aaafb2a4f80a600)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:51.984115 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1864f1f6-932d-46b5-974c-391c90fb5169 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:52.036446 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-1864f1f6-932d-46b5-974c-391c90fb5169 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b4b2a3a7a5446869aaafb2a4f80a600'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:52.049407 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-1864f1f6-932d-46b5-974c-391c90fb5169 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b4b2a3a7a5446869aaafb2a4f80a600'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:52.050250 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-1864f1f6-932d-46b5-974c-391c90fb5169 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b4b2a3a7a5446869aaafb2a4f80a600'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:52.050919 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-1864f1f6-932d-46b5-974c-391c90fb5169 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b4b2a3a7a5446869aaafb2a4f80a600'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:52.058517 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-1864f1f6-932d-46b5-974c-391c90fb5169 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b4b2a3a7a5446869aaafb2a4f80a600'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:52.071552 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1423/2840] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:30:51 2022] DELETE /identity/v3/users/9b4b2a3a7a5446869aaafb2a4f80a600 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:30:52.076074 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e6194-e957-4d75-9bae-ffb0d2b75601 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:52.076524 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e6194-e957-4d75-9bae-ffb0d2b75601 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:52.076890 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e6194-e957-4d75-9bae-ffb0d2b75601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:52.097277 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-9f7e6194-e957-4d75-9bae-ffb0d2b75601 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:30:52.098527 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-9f7e6194-e957-4d75-9bae-ffb0d2b75601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:52.159398 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1418/2841] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:30:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:30:52.169612 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1864f1f6-932d-46b5-974c-391c90fb5169 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:52.171078 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-1864f1f6-932d-46b5-974c-391c90fb5169 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:52.218158 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e6194-e957-4d75-9bae-ffb0d2b75601 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:52.219612 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-9f7e6194-e957-4d75-9bae-ffb0d2b75601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:52.231881 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e6194-e957-4d75-9bae-ffb0d2b75601 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:52.234435 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1864f1f6-932d-46b5-974c-391c90fb5169 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:52.236605 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7036453-9a80-4a7c-b661-1f4aa650034c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:52.237487 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7036453-9a80-4a7c-b661-1f4aa650034c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:52.237795 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7036453-9a80-4a7c-b661-1f4aa650034c admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:52.238070 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7036453-9a80-4a7c-b661-1f4aa650034c admin admin] PATH_INFO: `/v3/users/5920bb7253cf4994a4110a189466c800` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:52.238306 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c57ff74-b873-480c-af02-8e22f8e8c530 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:52.238940 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c57ff74-b873-480c-af02-8e22f8e8c530 service neutron] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:52.239223 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c57ff74-b873-480c-af02-8e22f8e8c530 service neutron] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:52.239348 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7036453-9a80-4a7c-b661-1f4aa650034c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5920bb7253cf4994a4110a189466c800)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:52.239524 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c57ff74-b873-480c-af02-8e22f8e8c530 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:52.241191 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7036453-9a80-4a7c-b661-1f4aa650034c admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:52.248620 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c57ff74-b873-480c-af02-8e22f8e8c530 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:52.250074 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c57ff74-b873-480c-af02-8e22f8e8c530 service neutron] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:52.259582 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1424/2842] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:30:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:30:52.288716 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-a7036453-9a80-4a7c-b661-1f4aa650034c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5920bb7253cf4994a4110a189466c800'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:52.296733 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-a7036453-9a80-4a7c-b661-1f4aa650034c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5920bb7253cf4994a4110a189466c800'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:52.297543 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-a7036453-9a80-4a7c-b661-1f4aa650034c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5920bb7253cf4994a4110a189466c800'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:52.305271 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-a7036453-9a80-4a7c-b661-1f4aa650034c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5920bb7253cf4994a4110a189466c800'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:52.306010 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-a7036453-9a80-4a7c-b661-1f4aa650034c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5920bb7253cf4994a4110a189466c800'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:52.324634 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1419/2843] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:30:52 2022] DELETE /identity/v3/users/5920bb7253cf4994a4110a189466c800 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:30:52.331082 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f97e5-e91d-4801-9277-329f530dc618 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:52.331364 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f97e5-e91d-4801-9277-329f530dc618 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:52.331635 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f97e5-e91d-4801-9277-329f530dc618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:52.350386 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-f78f97e5-e91d-4801-9277-329f530dc618 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:30:52.351579 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-f78f97e5-e91d-4801-9277-329f530dc618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:52.411684 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1425/2844] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:30:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:30:52.422619 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7036453-9a80-4a7c-b661-1f4aa650034c admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:52.424009 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-a7036453-9a80-4a7c-b661-1f4aa650034c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:52.480467 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7036453-9a80-4a7c-b661-1f4aa650034c admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:52.484086 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f753b24c-e013-4a7e-9130-a2329b2f66e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:52.484748 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753b24c-e013-4a7e-9130-a2329b2f66e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:52.485021 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753b24c-e013-4a7e-9130-a2329b2f66e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:52.485291 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f753b24c-e013-4a7e-9130-a2329b2f66e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:52.494241 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f753b24c-e013-4a7e-9130-a2329b2f66e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:52.495690 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f753b24c-e013-4a7e-9130-a2329b2f66e3 service neutron] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:52.505889 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1420/2845] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:30:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:30:52.531208 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f97e5-e91d-4801-9277-329f530dc618 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:52.533117 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-f78f97e5-e91d-4801-9277-329f530dc618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:52.546920 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f97e5-e91d-4801-9277-329f530dc618 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:52.552351 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b4fd1f-c223-44a4-9f1c-3677fe55dfe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:52.553497 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b4fd1f-c223-44a4-9f1c-3677fe55dfe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:52.553956 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b4fd1f-c223-44a4-9f1c-3677fe55dfe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:52.554544 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b4fd1f-c223-44a4-9f1c-3677fe55dfe4 admin admin] PATH_INFO: `/v3/projects/aeffb9525ab24cefafa2971221ec61de` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:52.556182 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b4fd1f-c223-44a4-9f1c-3677fe55dfe4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aeffb9525ab24cefafa2971221ec61de)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:52.558946 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b4fd1f-c223-44a4-9f1c-3677fe55dfe4 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:52.605712 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-a6b4fd1f-c223-44a4-9f1c-3677fe55dfe4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aeffb9525ab24cefafa2971221ec61de', 'request_id': 'req-a6b4fd1f-c223-44a4-9f1c-3677fe55dfe4'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:52.613468 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-a6b4fd1f-c223-44a4-9f1c-3677fe55dfe4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aeffb9525ab24cefafa2971221ec61de', 'request_id': 'req-a6b4fd1f-c223-44a4-9f1c-3677fe55dfe4'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:52.621375 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-a6b4fd1f-c223-44a4-9f1c-3677fe55dfe4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aeffb9525ab24cefafa2971221ec61de', 'request_id': 'req-a6b4fd1f-c223-44a4-9f1c-3677fe55dfe4'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:52.632681 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-a6b4fd1f-c223-44a4-9f1c-3677fe55dfe4 admin admin] The token cache is being invalidate because project aeffb9525ab24cefafa2971221ec61de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:30:52.632968 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-a6b4fd1f-c223-44a4-9f1c-3677fe55dfe4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:52.633994 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-a6b4fd1f-c223-44a4-9f1c-3677fe55dfe4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:52.635373 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1426/2846] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:30:52 2022] DELETE /identity/v3/projects/aeffb9525ab24cefafa2971221ec61de => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:30:52.640569 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a134cf-1ea3-4343-ba42-06fbd05a4055 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:52.640878 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a134cf-1ea3-4343-ba42-06fbd05a4055 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:52.641154 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a134cf-1ea3-4343-ba42-06fbd05a4055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:52.659145 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-41a134cf-1ea3-4343-ba42-06fbd05a4055 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:30:52.660348 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-41a134cf-1ea3-4343-ba42-06fbd05a4055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:52.723368 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1421/2847] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:30:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:30:52.787820 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34400dd0-b2b0-4df7-a8c6-abdbfbe07c6a None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:52.788320 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34400dd0-b2b0-4df7-a8c6-abdbfbe07c6a None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:52.788320 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34400dd0-b2b0-4df7-a8c6-abdbfbe07c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:52.792798 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a134cf-1ea3-4343-ba42-06fbd05a4055 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:52.795051 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-41a134cf-1ea3-4343-ba42-06fbd05a4055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:52.809714 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-34400dd0-b2b0-4df7-a8c6-abdbfbe07c6a None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:30:52.811164 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-34400dd0-b2b0-4df7-a8c6-abdbfbe07c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:52.814267 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a134cf-1ea3-4343-ba42-06fbd05a4055 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:52.819536 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ac36d6-13ba-4045-a3c4-d4260a06df71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:52.819883 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1427/2848] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:30:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:30:52.821580 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac36d6-13ba-4045-a3c4-d4260a06df71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:52.821580 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac36d6-13ba-4045-a3c4-d4260a06df71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:52.821580 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac36d6-13ba-4045-a3c4-d4260a06df71 admin admin] PATH_INFO: `/v3/projects/9ca64116b22442f0a8f76f10f0cf0d97` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:52.822930 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ac36d6-13ba-4045-a3c4-d4260a06df71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ca64116b22442f0a8f76f10f0cf0d97)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:52.824319 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34400dd0-b2b0-4df7-a8c6-abdbfbe07c6a None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:52.825357 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ac36d6-13ba-4045-a3c4-d4260a06df71 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:52.837214 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34400dd0-b2b0-4df7-a8c6-abdbfbe07c6a None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:52.842614 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829f2fa-11f6-40fc-a27d-b961f6d15659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:52.843295 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829f2fa-11f6-40fc-a27d-b961f6d15659 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:52.843776 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829f2fa-11f6-40fc-a27d-b961f6d15659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:52.844048 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829f2fa-11f6-40fc-a27d-b961f6d15659 admin admin] PATH_INFO: `/v3/domains` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:52.844955 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5829f2fa-11f6-40fc-a27d-b961f6d15659 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80018) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:30:52.845434 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5829f2fa-11f6-40fc-a27d-b961f6d15659 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:52.847233 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5829f2fa-11f6-40fc-a27d-b961f6d15659 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:52.864268 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1428/2849] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 17 18:30:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:30:52.865360 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829f2fa-11f6-40fc-a27d-b961f6d15659 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:52.874840 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-f3ac36d6-13ba-4045-a3c4-d4260a06df71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ca64116b22442f0a8f76f10f0cf0d97', 'request_id': 'req-f3ac36d6-13ba-4045-a3c4-d4260a06df71'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:52.875873 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829f2fa-11f6-40fc-a27d-b961f6d15659 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:52.881327 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-f3ac36d6-13ba-4045-a3c4-d4260a06df71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ca64116b22442f0a8f76f10f0cf0d97', 'request_id': 'req-f3ac36d6-13ba-4045-a3c4-d4260a06df71'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:52.889179 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-f3ac36d6-13ba-4045-a3c4-d4260a06df71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ca64116b22442f0a8f76f10f0cf0d97', 'request_id': 'req-f3ac36d6-13ba-4045-a3c4-d4260a06df71'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:52.900057 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-f3ac36d6-13ba-4045-a3c4-d4260a06df71 admin admin] The token cache is being invalidate because project 9ca64116b22442f0a8f76f10f0cf0d97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80017) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:30:52.900424 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-f3ac36d6-13ba-4045-a3c4-d4260a06df71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:52.901133 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-f3ac36d6-13ba-4045-a3c4-d4260a06df71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:52.902752 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1422/2850] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:30:52 2022] DELETE /identity/v3/projects/9ca64116b22442f0a8f76f10f0cf0d97 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:30:52.907126 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ac36d6-13ba-4045-a3c4-d4260a06df71 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:52.908409 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-f3ac36d6-13ba-4045-a3c4-d4260a06df71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:52.934836 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8b364-3fe0-4609-b71a-f05bdcdfb7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:52.935491 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8b364-3fe0-4609-b71a-f05bdcdfb7c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:52.935773 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8b364-3fe0-4609-b71a-f05bdcdfb7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:52.936049 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8b364-3fe0-4609-b71a-f05bdcdfb7c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:52.936741 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb8b364-3fe0-4609-b71a-f05bdcdfb7c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:52.938679 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb8b364-3fe0-4609-b71a-f05bdcdfb7c8 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:52.967465 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1429/2851] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:30:52 2022] POST /identity/v3/projects => generated 371 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:30:52.968370 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8b364-3fe0-4609-b71a-f05bdcdfb7c8 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:52.969992 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-9bb8b364-3fe0-4609-b71a-f05bdcdfb7c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:52.972525 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ac36d6-13ba-4045-a3c4-d4260a06df71 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:53.026963 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb4cb47-e472-4a97-83f0-5c28d443b510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:53.027853 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb4cb47-e472-4a97-83f0-5c28d443b510 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:53.028133 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb4cb47-e472-4a97-83f0-5c28d443b510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:53.028921 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb4cb47-e472-4a97-83f0-5c28d443b510 admin admin] PATH_INFO: `/v3/users/c91a677eab654e3f9feed51429ba6cc6` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:53.029619 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb4cb47-e472-4a97-83f0-5c28d443b510 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c91a677eab654e3f9feed51429ba6cc6)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:53.031544 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb4cb47-e472-4a97-83f0-5c28d443b510 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:53.032097 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8b364-3fe0-4609-b71a-f05bdcdfb7c8 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:53.036877 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c05a9-7435-442d-9594-8df3d6cab791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:53.037568 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c05a9-7435-442d-9594-8df3d6cab791 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:53.037853 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c05a9-7435-442d-9594-8df3d6cab791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:53.038131 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c05a9-7435-442d-9594-8df3d6cab791 admin admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:53.038845 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c05a9-7435-442d-9594-8df3d6cab791 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:53.040798 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c05a9-7435-442d-9594-8df3d6cab791 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:53.061312 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1430/2852] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:30:52 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:30:53.065323 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c05a9-7435-442d-9594-8df3d6cab791 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:53.074713 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c05a9-7435-442d-9594-8df3d6cab791 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:53.077024 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-6bb4cb47-e472-4a97-83f0-5c28d443b510 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c91a677eab654e3f9feed51429ba6cc6'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:53.080552 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c1c1c7-c47e-41b0-87f0-612e45f8bf61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:53.081299 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1c1c7-c47e-41b0-87f0-612e45f8bf61 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:53.081641 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1c1c7-c47e-41b0-87f0-612e45f8bf61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:53.081921 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1c1c7-c47e-41b0-87f0-612e45f8bf61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:53.082641 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c1c1c7-c47e-41b0-87f0-612e45f8bf61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:53.084010 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-6bb4cb47-e472-4a97-83f0-5c28d443b510 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c91a677eab654e3f9feed51429ba6cc6'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:53.084293 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c1c1c7-c47e-41b0-87f0-612e45f8bf61 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:53.084711 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-6bb4cb47-e472-4a97-83f0-5c28d443b510 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c91a677eab654e3f9feed51429ba6cc6'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:53.092266 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-6bb4cb47-e472-4a97-83f0-5c28d443b510 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c91a677eab654e3f9feed51429ba6cc6'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:53.092952 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-6bb4cb47-e472-4a97-83f0-5c28d443b510 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c91a677eab654e3f9feed51429ba6cc6'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:53.094778 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1431/2853] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:30:53.098666 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c1c1c7-c47e-41b0-87f0-612e45f8bf61 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:53.100480 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-71c1c1c7-c47e-41b0-87f0-612e45f8bf61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:53.109945 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1423/2854] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:30:52 2022] DELETE /identity/v3/users/c91a677eab654e3f9feed51429ba6cc6 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:30:53.112817 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c1c1c7-c47e-41b0-87f0-612e45f8bf61 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:53.170399 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a9ff2c-bf65-4cd4-a577-f8c85f8fec2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:53.171265 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9ff2c-bf65-4cd4-a577-f8c85f8fec2e admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:53.171546 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9ff2c-bf65-4cd4-a577-f8c85f8fec2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:53.171820 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9ff2c-bf65-4cd4-a577-f8c85f8fec2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:53.172548 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a9ff2c-bf65-4cd4-a577-f8c85f8fec2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:53.174352 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a9ff2c-bf65-4cd4-a577-f8c85f8fec2e admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:53.185674 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1432/2855] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:30:53.190288 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb4cb47-e472-4a97-83f0-5c28d443b510 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:53.201022 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb4cb47-e472-4a97-83f0-5c28d443b510 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:53.206116 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324611e5-af68-4ba5-9cc5-8618c921f35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:53.206799 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324611e5-af68-4ba5-9cc5-8618c921f35e admin admin] REQUEST_METHOD: `PUT` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:53.207101 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324611e5-af68-4ba5-9cc5-8618c921f35e admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:53.207411 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324611e5-af68-4ba5-9cc5-8618c921f35e admin admin] PATH_INFO: `/v3/projects/ebc3e65ea59f43f6b93e5fc5aec51e85/users/2cf9a51b16fd4bfcab91dcd7e4b27492/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:53.222487 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324611e5-af68-4ba5-9cc5-8618c921f35e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebc3e65ea59f43f6b93e5fc5aec51e85, user_id=2cf9a51b16fd4bfcab91dcd7e4b27492, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:53.225045 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324611e5-af68-4ba5-9cc5-8618c921f35e admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:53.237667 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1424/2856] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:30:53 2022] PUT /identity/v3/projects/ebc3e65ea59f43f6b93e5fc5aec51e85/users/2cf9a51b16fd4bfcab91dcd7e4b27492/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:30:53.242700 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a46686-5685-4483-9c35-180181bcec87 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:53.243176 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a46686-5685-4483-9c35-180181bcec87 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:53.243454 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a46686-5685-4483-9c35-180181bcec87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:53.263818 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-d2a46686-5685-4483-9c35-180181bcec87 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:30:53.264899 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-d2a46686-5685-4483-9c35-180181bcec87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:53.326983 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1433/2857] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:30:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:30:53.336612 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324611e5-af68-4ba5-9cc5-8618c921f35e admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:53.338510 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-324611e5-af68-4ba5-9cc5-8618c921f35e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:53.379094 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a46686-5685-4483-9c35-180181bcec87 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:53.380696 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-d2a46686-5685-4483-9c35-180181bcec87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:53.393134 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a46686-5685-4483-9c35-180181bcec87 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:53.399335 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc0cc0-4edc-4ddf-bd8f-b52817d79bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:53.400351 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc0cc0-4edc-4ddf-bd8f-b52817d79bd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:53.400638 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc0cc0-4edc-4ddf-bd8f-b52817d79bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:53.400923 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc0cc0-4edc-4ddf-bd8f-b52817d79bd7 admin admin] PATH_INFO: `/v3/projects/e5cf2cd2efe4450093c3903e62ade39d` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:53.402296 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fc0cc0-4edc-4ddf-bd8f-b52817d79bd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5cf2cd2efe4450093c3903e62ade39d)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:53.404397 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fc0cc0-4edc-4ddf-bd8f-b52817d79bd7 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:53.409962 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324611e5-af68-4ba5-9cc5-8618c921f35e admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:53.414119 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8a79de-8938-442d-a811-acd35b25456b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:53.415063 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a79de-8938-442d-a811-acd35b25456b service neutron] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:53.415399 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a79de-8938-442d-a811-acd35b25456b service neutron] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:53.415630 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a79de-8938-442d-a811-acd35b25456b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:53.425516 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8a79de-8938-442d-a811-acd35b25456b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:53.427030 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8a79de-8938-442d-a811-acd35b25456b service neutron] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:53.437335 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1425/2858] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:30:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:30:53.456168 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-59fc0cc0-4edc-4ddf-bd8f-b52817d79bd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5cf2cd2efe4450093c3903e62ade39d', 'request_id': 'req-59fc0cc0-4edc-4ddf-bd8f-b52817d79bd7'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:53.462454 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-59fc0cc0-4edc-4ddf-bd8f-b52817d79bd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5cf2cd2efe4450093c3903e62ade39d', 'request_id': 'req-59fc0cc0-4edc-4ddf-bd8f-b52817d79bd7'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:53.470288 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-59fc0cc0-4edc-4ddf-bd8f-b52817d79bd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5cf2cd2efe4450093c3903e62ade39d', 'request_id': 'req-59fc0cc0-4edc-4ddf-bd8f-b52817d79bd7'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:53.480264 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-59fc0cc0-4edc-4ddf-bd8f-b52817d79bd7 admin admin] The token cache is being invalidate because project e5cf2cd2efe4450093c3903e62ade39d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:30:53.480559 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-59fc0cc0-4edc-4ddf-bd8f-b52817d79bd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:53.481749 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-59fc0cc0-4edc-4ddf-bd8f-b52817d79bd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:53.483591 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1434/2859] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:30:53 2022] DELETE /identity/v3/projects/e5cf2cd2efe4450093c3903e62ade39d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:30:53.488192 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c5d17-6754-443b-b723-8c141f8a7a19 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:53.488679 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c5d17-6754-443b-b723-8c141f8a7a19 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:53.488978 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c5d17-6754-443b-b723-8c141f8a7a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:53.507776 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-360c5d17-6754-443b-b723-8c141f8a7a19 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:30:53.509076 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-360c5d17-6754-443b-b723-8c141f8a7a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:53.579257 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1426/2860] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:30:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:30:53.587447 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa8945-aaa0-45fd-ac2a-8a4af56938f3 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:53.587716 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa8945-aaa0-45fd-ac2a-8a4af56938f3 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:53.587982 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa8945-aaa0-45fd-ac2a-8a4af56938f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:53.608744 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-72fa8945-aaa0-45fd-ac2a-8a4af56938f3 None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:30:53.609697 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-72fa8945-aaa0-45fd-ac2a-8a4af56938f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:53.618687 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1435/2861] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:30:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:30:53.623318 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360c5d17-6754-443b-b723-8c141f8a7a19 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:53.632768 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360c5d17-6754-443b-b723-8c141f8a7a19 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:53.637437 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a10d07-5b17-427a-a3e2-a089285fcbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:53.638113 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a10d07-5b17-427a-a3e2-a089285fcbf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:53.638391 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a10d07-5b17-427a-a3e2-a089285fcbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:53.638664 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a10d07-5b17-427a-a3e2-a089285fcbf4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:53.639390 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a10d07-5b17-427a-a3e2-a089285fcbf4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80017) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:30:53.639695 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a10d07-5b17-427a-a3e2-a089285fcbf4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:53.641488 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a10d07-5b17-427a-a3e2-a089285fcbf4 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:53.653729 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1427/2862] 10.222.0.65 () {58 vars in 1152 bytes} [Tue May 17 18:30:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:30:53.659385 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa8945-aaa0-45fd-ac2a-8a4af56938f3 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:53.668337 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa8945-aaa0-45fd-ac2a-8a4af56938f3 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:53.674138 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a2646-60a7-44d4-a8b1-2acbf101d5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:53.675075 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a2646-60a7-44d4-a8b1-2acbf101d5c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:53.675358 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a2646-60a7-44d4-a8b1-2acbf101d5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:53.675629 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584a2646-60a7-44d4-a8b1-2acbf101d5c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:53.676440 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a2646-60a7-44d4-a8b1-2acbf101d5c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:53.678702 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584a2646-60a7-44d4-a8b1-2acbf101d5c2 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:53.708155 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1436/2863] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:30:53 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:30:53.709712 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a10d07-5b17-427a-a3e2-a089285fcbf4 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:53.720664 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a10d07-5b17-427a-a3e2-a089285fcbf4 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:53.797690 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dc3023-31db-4d87-b831-db7080d5b628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:53.798507 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc3023-31db-4d87-b831-db7080d5b628 admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:53.798780 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc3023-31db-4d87-b831-db7080d5b628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:53.799055 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc3023-31db-4d87-b831-db7080d5b628 admin admin] PATH_INFO: `/v3/users` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:53.799747 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dc3023-31db-4d87-b831-db7080d5b628 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:53.801715 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dc3023-31db-4d87-b831-db7080d5b628 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:53.829490 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1428/2864] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:30:53 2022] POST /identity/v3/users => generated 287 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:30:53.831692 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a2646-60a7-44d4-a8b1-2acbf101d5c2 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:53.844385 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584a2646-60a7-44d4-a8b1-2acbf101d5c2 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:53.852562 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b1264-2454-49e3-ab44-4a80e690c557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:53.853219 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b1264-2454-49e3-ab44-4a80e690c557 admin admin] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:53.853774 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b1264-2454-49e3-ab44-4a80e690c557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:53.854135 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609b1264-2454-49e3-ab44-4a80e690c557 admin admin] PATH_INFO: `/v3/roles` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:53.854885 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b1264-2454-49e3-ab44-4a80e690c557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:53.856545 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609b1264-2454-49e3-ab44-4a80e690c557 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:53.867966 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1437/2865] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:30:53.872125 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dc3023-31db-4d87-b831-db7080d5b628 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:53.881951 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dc3023-31db-4d87-b831-db7080d5b628 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:53.887088 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab58f3d-c790-4840-8acb-8b1be1191579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:53.887531 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab58f3d-c790-4840-8acb-8b1be1191579 admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:53.887992 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab58f3d-c790-4840-8acb-8b1be1191579 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:53.888263 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab58f3d-c790-4840-8acb-8b1be1191579 admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:53.888988 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab58f3d-c790-4840-8acb-8b1be1191579 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:53.890931 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab58f3d-c790-4840-8acb-8b1be1191579 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:53.904935 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1429/2866] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:30:53.906486 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b1264-2454-49e3-ab44-4a80e690c557 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:53.918367 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609b1264-2454-49e3-ab44-4a80e690c557 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:53.923651 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f9517-999e-4c6a-9e97-e1e6e76af6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:53.924526 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f9517-999e-4c6a-9e97-e1e6e76af6cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:53.924800 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f9517-999e-4c6a-9e97-e1e6e76af6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:53.925068 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f9517-999e-4c6a-9e97-e1e6e76af6cf admin admin] PATH_INFO: `/v3/projects/bf1cb72936c2472ea87095a18cdbc34d/users/45c80be1ae13435ea500927475270671/roles/2af599fd3ad74031901ea2d9e0408884` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:53.940101 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404f9517-999e-4c6a-9e97-e1e6e76af6cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf1cb72936c2472ea87095a18cdbc34d, user_id=45c80be1ae13435ea500927475270671, role_id=2af599fd3ad74031901ea2d9e0408884)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:53.942777 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404f9517-999e-4c6a-9e97-e1e6e76af6cf admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:53.955349 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1438/2867] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:30:53 2022] PUT /identity/v3/projects/bf1cb72936c2472ea87095a18cdbc34d/users/45c80be1ae13435ea500927475270671/roles/2af599fd3ad74031901ea2d9e0408884 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:30:53.967051 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dce0cc-94ef-4d5d-a144-d34c67fc703a None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:53.967359 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dce0cc-94ef-4d5d-a144-d34c67fc703a None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:53.967632 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dce0cc-94ef-4d5d-a144-d34c67fc703a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:53.995034 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-f9dce0cc-94ef-4d5d-a144-d34c67fc703a None None] MFA Rules not processed for user `45c80be1ae13435ea500927475270671`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:30:53.996358 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-f9dce0cc-94ef-4d5d-a144-d34c67fc703a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:54.086151 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1430/2868] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:30:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:30:54.098457 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f9517-999e-4c6a-9e97-e1e6e76af6cf admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:54.103087 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-404f9517-999e-4c6a-9e97-e1e6e76af6cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:54.166551 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f9517-999e-4c6a-9e97-e1e6e76af6cf admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:54.170919 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a0b6c7-1606-45c2-811f-3e6225af866d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '769f675c28e34902a079c70dab44dbf8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:54.171161 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a0b6c7-1606-45c2-811f-3e6225af866d service cinder] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:54.171483 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a0b6c7-1606-45c2-811f-3e6225af866d service cinder] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:54.171762 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a0b6c7-1606-45c2-811f-3e6225af866d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:54.181193 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a0b6c7-1606-45c2-811f-3e6225af866d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:54.182676 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a0b6c7-1606-45c2-811f-3e6225af866d service cinder] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:54.191830 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1439/2869] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:30:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:30:54.219784 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dce0cc-94ef-4d5d-a144-d34c67fc703a None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:54.287515 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dce0cc-94ef-4d5d-a144-d34c67fc703a None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:54.293109 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b59ce5-a34e-4ac9-afe4-ec3b6a806316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:54.295077 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b59ce5-a34e-4ac9-afe4-ec3b6a806316 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:54.295684 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b59ce5-a34e-4ac9-afe4-ec3b6a806316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:54.296138 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b59ce5-a34e-4ac9-afe4-ec3b6a806316 admin admin] PATH_INFO: `/v3/users/45c80be1ae13435ea500927475270671` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:54.298622 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b59ce5-a34e-4ac9-afe4-ec3b6a806316 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45c80be1ae13435ea500927475270671)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:54.301439 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b59ce5-a34e-4ac9-afe4-ec3b6a806316 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:54.357069 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-09b59ce5-a34e-4ac9-afe4-ec3b6a806316 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45c80be1ae13435ea500927475270671'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:54.364711 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-09b59ce5-a34e-4ac9-afe4-ec3b6a806316 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45c80be1ae13435ea500927475270671'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:54.365648 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-09b59ce5-a34e-4ac9-afe4-ec3b6a806316 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45c80be1ae13435ea500927475270671'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:54.375171 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-09b59ce5-a34e-4ac9-afe4-ec3b6a806316 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45c80be1ae13435ea500927475270671'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:54.376072 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-09b59ce5-a34e-4ac9-afe4-ec3b6a806316 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45c80be1ae13435ea500927475270671'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:54.395074 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1431/2870] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:30:54 2022] DELETE /identity/v3/users/45c80be1ae13435ea500927475270671 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:30:54.399863 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf73bc6-be41-4c24-ad1d-3047fd83b80b None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:54.400143 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf73bc6-be41-4c24-ad1d-3047fd83b80b None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:54.400421 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf73bc6-be41-4c24-ad1d-3047fd83b80b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:54.420037 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-daf73bc6-be41-4c24-ad1d-3047fd83b80b None None] MFA Rules not processed for user `8763b2e915c44d8688900867e35dfda6`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:30:54.421496 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-daf73bc6-be41-4c24-ad1d-3047fd83b80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:54.486276 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1440/2871] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:30:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:30:54.498249 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b59ce5-a34e-4ac9-afe4-ec3b6a806316 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:54.499846 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-09b59ce5-a34e-4ac9-afe4-ec3b6a806316 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:54.566400 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b59ce5-a34e-4ac9-afe4-ec3b6a806316 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:54.571124 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c81f24a-15cf-42cc-9e1c-792f4b8c93a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:54.571876 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81f24a-15cf-42cc-9e1c-792f4b8c93a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:54.572163 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81f24a-15cf-42cc-9e1c-792f4b8c93a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:54.572435 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81f24a-15cf-42cc-9e1c-792f4b8c93a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:54.582396 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c81f24a-15cf-42cc-9e1c-792f4b8c93a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:54.583821 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c81f24a-15cf-42cc-9e1c-792f4b8c93a9 service neutron] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:54.595921 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1432/2872] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:30:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:30:55.026874 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf73bc6-be41-4c24-ad1d-3047fd83b80b None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:55.028775 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-daf73bc6-be41-4c24-ad1d-3047fd83b80b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:55.042048 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf73bc6-be41-4c24-ad1d-3047fd83b80b None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:55.046907 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17275f03-35ce-4f5b-808f-fa61c7d5dba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:55.048182 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17275f03-35ce-4f5b-808f-fa61c7d5dba1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:55.048182 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17275f03-35ce-4f5b-808f-fa61c7d5dba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:55.048415 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17275f03-35ce-4f5b-808f-fa61c7d5dba1 admin admin] PATH_INFO: `/v3/projects/bf1cb72936c2472ea87095a18cdbc34d` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:55.049994 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17275f03-35ce-4f5b-808f-fa61c7d5dba1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf1cb72936c2472ea87095a18cdbc34d)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:55.051518 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17275f03-35ce-4f5b-808f-fa61c7d5dba1 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:55.108421 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-17275f03-35ce-4f5b-808f-fa61c7d5dba1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf1cb72936c2472ea87095a18cdbc34d', 'request_id': 'req-17275f03-35ce-4f5b-808f-fa61c7d5dba1'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:55.114803 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-17275f03-35ce-4f5b-808f-fa61c7d5dba1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf1cb72936c2472ea87095a18cdbc34d', 'request_id': 'req-17275f03-35ce-4f5b-808f-fa61c7d5dba1'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:55.122444 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-17275f03-35ce-4f5b-808f-fa61c7d5dba1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf1cb72936c2472ea87095a18cdbc34d', 'request_id': 'req-17275f03-35ce-4f5b-808f-fa61c7d5dba1'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:55.132954 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-17275f03-35ce-4f5b-808f-fa61c7d5dba1 admin admin] The token cache is being invalidate because project bf1cb72936c2472ea87095a18cdbc34d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:30:55.133236 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-17275f03-35ce-4f5b-808f-fa61c7d5dba1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:55.133883 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-17275f03-35ce-4f5b-808f-fa61c7d5dba1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:30:55.135420 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1441/2873] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:30:55 2022] DELETE /identity/v3/projects/bf1cb72936c2472ea87095a18cdbc34d => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:30:56.691295 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c81f24a-15cf-42cc-9e1c-792f4b8c93a9 service neutron] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:56.692864 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-0c81f24a-15cf-42cc-9e1c-792f4b8c93a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:56.835606 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c81f24a-15cf-42cc-9e1c-792f4b8c93a9 service neutron] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:56.960035 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca32abb2-b647-4de6-80c9-15f953f7b141 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b430b739cb54fc7911bc89f8ea2df72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:56.961123 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca32abb2-b647-4de6-80c9-15f953f7b141 service nova] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:56.961690 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca32abb2-b647-4de6-80c9-15f953f7b141 service nova] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:56.963009 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca32abb2-b647-4de6-80c9-15f953f7b141 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:56.965258 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-ca32abb2-b647-4de6-80c9-15f953f7b141 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:57.019446 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca32abb2-b647-4de6-80c9-15f953f7b141 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:57.023323 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca32abb2-b647-4de6-80c9-15f953f7b141 service nova] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:57.039418 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1433/2874] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:30:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:30:58.555150 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7997da-bc5f-49a7-871d-03c552a24e23 None None] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:58.555728 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7997da-bc5f-49a7-871d-03c552a24e23 None None] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:58.555728 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7997da-bc5f-49a7-871d-03c552a24e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:58.585996 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.auth.core [None req-9f7997da-bc5f-49a7-871d-03c552a24e23 None None] MFA Rules not processed for user `2cf9a51b16fd4bfcab91dcd7e4b27492`. Rule list: `[]` (Enabled: `True`). {{(pid=80018) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:30:58.587313 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-9f7997da-bc5f-49a7-871d-03c552a24e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:58.655077 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1442/2875] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:30:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:30:58.659556 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca32abb2-b647-4de6-80c9-15f953f7b141 service nova] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:58.661107 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-ca32abb2-b647-4de6-80c9-15f953f7b141 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:30:58.729507 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca32abb2-b647-4de6-80c9-15f953f7b141 service nova] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:58.737148 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feeb880-ab99-4d7c-abcc-9107536b0d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:58.737856 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feeb880-ab99-4d7c-abcc-9107536b0d0d admin admin] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:58.738130 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feeb880-ab99-4d7c-abcc-9107536b0d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:58.738399 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feeb880-ab99-4d7c-abcc-9107536b0d0d admin admin] PATH_INFO: `/v3/projects` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:58.739087 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feeb880-ab99-4d7c-abcc-9107536b0d0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:58.740989 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feeb880-ab99-4d7c-abcc-9107536b0d0d admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:58.775147 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1434/2876] 10.222.0.65 () {60 vars in 1152 bytes} [Tue May 17 18:30:58 2022] POST /identity/v3/projects => generated 371 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:30:58.776304 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7997da-bc5f-49a7-871d-03c552a24e23 None None] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:58.788541 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7997da-bc5f-49a7-871d-03c552a24e23 None None] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:58.853917 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b420bb2-ff2b-4db5-bd64-fcdb0c6f2f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:58.854540 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b420bb2-ff2b-4db5-bd64-fcdb0c6f2f32 admin admin] REQUEST_METHOD: `POST` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:58.854821 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b420bb2-ff2b-4db5-bd64-fcdb0c6f2f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:58.855085 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b420bb2-ff2b-4db5-bd64-fcdb0c6f2f32 admin admin] PATH_INFO: `/v3/users` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:58.855811 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b420bb2-ff2b-4db5-bd64-fcdb0c6f2f32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:58.857810 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b420bb2-ff2b-4db5-bd64-fcdb0c6f2f32 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:58.879855 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1443/2877] 10.222.0.65 () {60 vars in 1143 bytes} [Tue May 17 18:30:58 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:30:58.886030 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feeb880-ab99-4d7c-abcc-9107536b0d0d admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:58.897237 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feeb880-ab99-4d7c-abcc-9107536b0d0d admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:58.902386 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4fdd5e-0910-42a0-b0ef-cce91b1e09ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:58.903678 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4fdd5e-0910-42a0-b0ef-cce91b1e09ba admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:58.903959 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4fdd5e-0910-42a0-b0ef-cce91b1e09ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:58.904220 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4fdd5e-0910-42a0-b0ef-cce91b1e09ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:58.905192 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4fdd5e-0910-42a0-b0ef-cce91b1e09ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:58.907312 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4fdd5e-0910-42a0-b0ef-cce91b1e09ba admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:58.918846 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1435/2878] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:30:58.922877 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b420bb2-ff2b-4db5-bd64-fcdb0c6f2f32 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:58.933537 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b420bb2-ff2b-4db5-bd64-fcdb0c6f2f32 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:58.938906 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27537a2e-7cd0-4418-8b3e-4ee5f0267146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:58.939798 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27537a2e-7cd0-4418-8b3e-4ee5f0267146 admin admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:58.940073 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27537a2e-7cd0-4418-8b3e-4ee5f0267146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:58.940353 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27537a2e-7cd0-4418-8b3e-4ee5f0267146 admin admin] PATH_INFO: `/v3/projects/2f9658f52e2a4b6b998d18029d820c53/users/7a1ac82b83b64f01b91603bd15374e91/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:58.958171 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27537a2e-7cd0-4418-8b3e-4ee5f0267146 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f9658f52e2a4b6b998d18029d820c53, user_id=7a1ac82b83b64f01b91603bd15374e91, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:58.960827 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27537a2e-7cd0-4418-8b3e-4ee5f0267146 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:58.977157 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1444/2879] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:30:58 2022] PUT /identity/v3/projects/2f9658f52e2a4b6b998d18029d820c53/users/7a1ac82b83b64f01b91603bd15374e91/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:30:58.980902 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4fdd5e-0910-42a0-b0ef-cce91b1e09ba admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:58.990834 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4fdd5e-0910-42a0-b0ef-cce91b1e09ba admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:59.054961 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ab7f1f-bb36-423c-ac8e-10cc424ac05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:59.055645 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab7f1f-bb36-423c-ac8e-10cc424ac05d admin admin] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:59.055926 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab7f1f-bb36-423c-ac8e-10cc424ac05d admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:59.056196 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab7f1f-bb36-423c-ac8e-10cc424ac05d admin admin] PATH_INFO: `/v3/roles` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:59.056923 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ab7f1f-bb36-423c-ac8e-10cc424ac05d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:59.058727 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ab7f1f-bb36-423c-ac8e-10cc424ac05d admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:59.070230 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1436/2880] 10.222.0.65 () {58 vars in 1121 bytes} [Tue May 17 18:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:30:59.074407 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27537a2e-7cd0-4418-8b3e-4ee5f0267146 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:30:59.085219 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27537a2e-7cd0-4418-8b3e-4ee5f0267146 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:30:59.090198 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7fb8f0-58f0-4162-8bc9-b4529dfabcb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:30:59.091227 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7fb8f0-58f0-4162-8bc9-b4529dfabcb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:30:59.091621 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7fb8f0-58f0-4162-8bc9-b4529dfabcb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:30:59.091988 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7fb8f0-58f0-4162-8bc9-b4529dfabcb8 admin admin] PATH_INFO: `/v3/projects/2f9658f52e2a4b6b998d18029d820c53/users/7a1ac82b83b64f01b91603bd15374e91/roles/332c8d70fd0f41e2beea20aaead5daa5` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:30:59.094160 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7fb8f0-58f0-4162-8bc9-b4529dfabcb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f9658f52e2a4b6b998d18029d820c53, user_id=7a1ac82b83b64f01b91603bd15374e91, role_id=332c8d70fd0f41e2beea20aaead5daa5)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:30:59.096920 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7fb8f0-58f0-4162-8bc9-b4529dfabcb8 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:30:59.109021 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1445/2881] 10.222.0.65 () {60 vars in 1482 bytes} [Tue May 17 18:30:59 2022] PUT /identity/v3/projects/2f9658f52e2a4b6b998d18029d820c53/users/7a1ac82b83b64f01b91603bd15374e91/roles/332c8d70fd0f41e2beea20aaead5daa5 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:31:03.757707 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03521803-6a15-40cf-ae70-77de3fae9113 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:31:03.758591 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03521803-6a15-40cf-ae70-77de3fae9113 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:31:03.759015 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03521803-6a15-40cf-ae70-77de3fae9113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:31:03.789219 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-03521803-6a15-40cf-ae70-77de3fae9113 None None] MFA Rules not processed for user `7a1ac82b83b64f01b91603bd15374e91`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:31:03.791214 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-03521803-6a15-40cf-ae70-77de3fae9113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:31:03.880049 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1437/2882] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:31:03 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:31:03.896267 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7fb8f0-58f0-4162-8bc9-b4529dfabcb8 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:31:03.898706 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-7f7fb8f0-58f0-4162-8bc9-b4529dfabcb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:31:04.012732 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7fb8f0-58f0-4162-8bc9-b4529dfabcb8 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:31:04.035639 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9204a8-995b-4f6d-a7f5-f09de1ce2bf9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b430b739cb54fc7911bc89f8ea2df72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:31:04.036323 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9204a8-995b-4f6d-a7f5-f09de1ce2bf9 service nova] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:31:04.036608 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9204a8-995b-4f6d-a7f5-f09de1ce2bf9 service nova] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:31:04.036884 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9204a8-995b-4f6d-a7f5-f09de1ce2bf9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:31:04.129994 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9204a8-995b-4f6d-a7f5-f09de1ce2bf9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:31:04.131964 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9204a8-995b-4f6d-a7f5-f09de1ce2bf9 service nova] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:31:04.146726 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1446/2883] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:31:03 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:31:05.493153 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e2ff3-5bda-4ed5-9b10-0e2f75c2c7c8 None None] REQUEST_METHOD: `POST` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:31:05.493651 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e2ff3-5bda-4ed5-9b10-0e2f75c2c7c8 None None] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:31:05.493765 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e2ff3-5bda-4ed5-9b10-0e2f75c2c7c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:31:05.514793 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.auth.core [None req-422e2ff3-5bda-4ed5-9b10-0e2f75c2c7c8 None None] MFA Rules not processed for user `2cf9a51b16fd4bfcab91dcd7e4b27492`. Rule list: `[]` (Enabled: `True`). {{(pid=80017) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:31:05.516150 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-422e2ff3-5bda-4ed5-9b10-0e2f75c2c7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:31:05.526422 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1438/2884] 10.222.0.65 () {58 vars in 957 bytes} [Tue May 17 18:31:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:31:08.571735 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9204a8-995b-4f6d-a7f5-f09de1ce2bf9 service nova] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:31:08.573845 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-be9204a8-995b-4f6d-a7f5-f09de1ce2bf9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:31:08.633599 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9204a8-995b-4f6d-a7f5-f09de1ce2bf9 service nova] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:31:08.637772 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99478ad3-856a-4dbd-9ce0-4a78bae7628c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:31:08.638505 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99478ad3-856a-4dbd-9ce0-4a78bae7628c service neutron] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:31:08.638784 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99478ad3-856a-4dbd-9ce0-4a78bae7628c service neutron] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:31:08.639056 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99478ad3-856a-4dbd-9ce0-4a78bae7628c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:31:08.640865 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-99478ad3-856a-4dbd-9ce0-4a78bae7628c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:31:08.706295 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99478ad3-856a-4dbd-9ce0-4a78bae7628c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:31:08.707729 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99478ad3-856a-4dbd-9ce0-4a78bae7628c service neutron] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:31:08.717346 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1447/2885] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:31:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:31:14.942913 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422e2ff3-5bda-4ed5-9b10-0e2f75c2c7c8 None None] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:31:14.944355 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-422e2ff3-5bda-4ed5-9b10-0e2f75c2c7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:31:14.958812 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422e2ff3-5bda-4ed5-9b10-0e2f75c2c7c8 None None] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:31:14.963228 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ffb6f2-3a1c-4e34-a091-74abe081e880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:31:14.964083 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ffb6f2-3a1c-4e34-a091-74abe081e880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:31:14.964355 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ffb6f2-3a1c-4e34-a091-74abe081e880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:31:14.964621 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ffb6f2-3a1c-4e34-a091-74abe081e880 admin admin] PATH_INFO: `/v3/users/861ad9a7c63a4d66a1806c4576cddce5` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:31:14.978480 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ffb6f2-3a1c-4e34-a091-74abe081e880 admin admin] RBAC: Authorizing `identity:delete_user(user_id=861ad9a7c63a4d66a1806c4576cddce5)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:31:14.980392 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ffb6f2-3a1c-4e34-a091-74abe081e880 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:31:15.034342 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-d4ffb6f2-3a1c-4e34-a091-74abe081e880 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '861ad9a7c63a4d66a1806c4576cddce5'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:31:15.041219 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-d4ffb6f2-3a1c-4e34-a091-74abe081e880 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '861ad9a7c63a4d66a1806c4576cddce5'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:31:15.041923 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-d4ffb6f2-3a1c-4e34-a091-74abe081e880 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '861ad9a7c63a4d66a1806c4576cddce5'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:31:15.049584 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-d4ffb6f2-3a1c-4e34-a091-74abe081e880 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '861ad9a7c63a4d66a1806c4576cddce5'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:31:15.050206 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-d4ffb6f2-3a1c-4e34-a091-74abe081e880 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '861ad9a7c63a4d66a1806c4576cddce5'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:31:15.066964 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1439/2886] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:31:14 2022] DELETE /identity/v3/users/861ad9a7c63a4d66a1806c4576cddce5 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:31:15.235153 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99478ad3-856a-4dbd-9ce0-4a78bae7628c service neutron] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:31:15.246864 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99478ad3-856a-4dbd-9ce0-4a78bae7628c service neutron] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:31:15.301550 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a646afad-19f6-4e50-b40b-717bb67cbe58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:31:15.302392 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a646afad-19f6-4e50-b40b-717bb67cbe58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:31:15.302668 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a646afad-19f6-4e50-b40b-717bb67cbe58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:31:15.302940 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a646afad-19f6-4e50-b40b-717bb67cbe58 admin admin] PATH_INFO: `/v3/projects/481c26193c6141588dd15fd5c593de86` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:31:15.313327 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a646afad-19f6-4e50-b40b-717bb67cbe58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=481c26193c6141588dd15fd5c593de86)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:31:15.315241 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a646afad-19f6-4e50-b40b-717bb67cbe58 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:31:15.358239 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-a646afad-19f6-4e50-b40b-717bb67cbe58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '481c26193c6141588dd15fd5c593de86', 'request_id': 'req-a646afad-19f6-4e50-b40b-717bb67cbe58'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:31:15.364415 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-a646afad-19f6-4e50-b40b-717bb67cbe58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '481c26193c6141588dd15fd5c593de86', 'request_id': 'req-a646afad-19f6-4e50-b40b-717bb67cbe58'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:31:15.371756 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-a646afad-19f6-4e50-b40b-717bb67cbe58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '481c26193c6141588dd15fd5c593de86', 'request_id': 'req-a646afad-19f6-4e50-b40b-717bb67cbe58'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:31:15.381485 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-a646afad-19f6-4e50-b40b-717bb67cbe58 admin admin] The token cache is being invalidate because project 481c26193c6141588dd15fd5c593de86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:31:15.381771 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-a646afad-19f6-4e50-b40b-717bb67cbe58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:31:15.382395 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-a646afad-19f6-4e50-b40b-717bb67cbe58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:31:15.383908 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1448/2887] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:31:15 2022] DELETE /identity/v3/projects/481c26193c6141588dd15fd5c593de86 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:31:15.387859 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ffb6f2-3a1c-4e34-a091-74abe081e880 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:31:15.389269 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-d4ffb6f2-3a1c-4e34-a091-74abe081e880 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:31:15.401984 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ffb6f2-3a1c-4e34-a091-74abe081e880 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:31:15.455072 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcd82fe-2543-4769-a3ec-5193b9420a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:31:15.455932 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd82fe-2543-4769-a3ec-5193b9420a89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:31:15.456208 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd82fe-2543-4769-a3ec-5193b9420a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:31:15.456478 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd82fe-2543-4769-a3ec-5193b9420a89 admin admin] PATH_INFO: `/v3/users/c2b1e7ccc3d14112b928c3bd3f2c8e1c` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:31:15.470405 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcd82fe-2543-4769-a3ec-5193b9420a89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2b1e7ccc3d14112b928c3bd3f2c8e1c)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:31:15.472319 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcd82fe-2543-4769-a3ec-5193b9420a89 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:31:15.517022 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-2dcd82fe-2543-4769-a3ec-5193b9420a89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2b1e7ccc3d14112b928c3bd3f2c8e1c'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:31:15.523682 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-2dcd82fe-2543-4769-a3ec-5193b9420a89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2b1e7ccc3d14112b928c3bd3f2c8e1c'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:31:15.524338 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-2dcd82fe-2543-4769-a3ec-5193b9420a89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2b1e7ccc3d14112b928c3bd3f2c8e1c'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:31:15.532174 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-2dcd82fe-2543-4769-a3ec-5193b9420a89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2b1e7ccc3d14112b928c3bd3f2c8e1c'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:31:15.532789 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-2dcd82fe-2543-4769-a3ec-5193b9420a89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2b1e7ccc3d14112b928c3bd3f2c8e1c'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:31:15.550089 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1440/2888] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:31:15 2022] DELETE /identity/v3/users/c2b1e7ccc3d14112b928c3bd3f2c8e1c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:31:15.716337 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a646afad-19f6-4e50-b40b-717bb67cbe58 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:31:15.717792 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-a646afad-19f6-4e50-b40b-717bb67cbe58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:31:15.735936 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a646afad-19f6-4e50-b40b-717bb67cbe58 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:31:15.790250 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c37e18a-bf28-4988-be27-1c898cb0ebe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:31:15.791032 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c37e18a-bf28-4988-be27-1c898cb0ebe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:31:15.791307 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c37e18a-bf28-4988-be27-1c898cb0ebe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:31:15.791576 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c37e18a-bf28-4988-be27-1c898cb0ebe4 admin admin] PATH_INFO: `/v3/projects/6edf841a0b4248e195da08dd36e0a2c4` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:31:15.802016 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c37e18a-bf28-4988-be27-1c898cb0ebe4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6edf841a0b4248e195da08dd36e0a2c4)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:31:15.803908 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c37e18a-bf28-4988-be27-1c898cb0ebe4 admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:31:15.851994 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-5c37e18a-bf28-4988-be27-1c898cb0ebe4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6edf841a0b4248e195da08dd36e0a2c4', 'request_id': 'req-5c37e18a-bf28-4988-be27-1c898cb0ebe4'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:31:15.858337 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-5c37e18a-bf28-4988-be27-1c898cb0ebe4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6edf841a0b4248e195da08dd36e0a2c4', 'request_id': 'req-5c37e18a-bf28-4988-be27-1c898cb0ebe4'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:31:15.865329 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-5c37e18a-bf28-4988-be27-1c898cb0ebe4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6edf841a0b4248e195da08dd36e0a2c4', 'request_id': 'req-5c37e18a-bf28-4988-be27-1c898cb0ebe4'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:31:15.876011 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-5c37e18a-bf28-4988-be27-1c898cb0ebe4 admin admin] The token cache is being invalidate because project 6edf841a0b4248e195da08dd36e0a2c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:31:15.876295 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-5c37e18a-bf28-4988-be27-1c898cb0ebe4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:31:15.876913 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-5c37e18a-bf28-4988-be27-1c898cb0ebe4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:31:15.878483 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1449/2889] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:31:15 2022] DELETE /identity/v3/projects/6edf841a0b4248e195da08dd36e0a2c4 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:31:26.297286 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcd82fe-2543-4769-a3ec-5193b9420a89 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:31:26.299057 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-2dcd82fe-2543-4769-a3ec-5193b9420a89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:31:26.355741 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcd82fe-2543-4769-a3ec-5193b9420a89 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:31:26.401288 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf787a4-9196-4190-8ed8-4e79f4d2c475 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:31:26.401950 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf787a4-9196-4190-8ed8-4e79f4d2c475 service neutron] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:31:26.402227 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf787a4-9196-4190-8ed8-4e79f4d2c475 service neutron] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:31:26.402499 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf787a4-9196-4190-8ed8-4e79f4d2c475 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:31:26.404246 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-aaf787a4-9196-4190-8ed8-4e79f4d2c475 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:31:26.413081 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf787a4-9196-4190-8ed8-4e79f4d2c475 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:31:26.414531 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf787a4-9196-4190-8ed8-4e79f4d2c475 service neutron] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:31:26.422780 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1441/2890] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:31:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:31:42.144269 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c37e18a-bf28-4988-be27-1c898cb0ebe4 admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:31:42.145693 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-5c37e18a-bf28-4988-be27-1c898cb0ebe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:31:42.157419 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c37e18a-bf28-4988-be27-1c898cb0ebe4 admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:31:42.160922 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff7009-2724-4788-9aaa-e4f2f23ef3cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:31:42.161578 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff7009-2724-4788-9aaa-e4f2f23ef3cb service neutron] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:31:42.161856 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff7009-2724-4788-9aaa-e4f2f23ef3cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:31:42.162128 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff7009-2724-4788-9aaa-e4f2f23ef3cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:31:42.163785 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-6cff7009-2724-4788-9aaa-e4f2f23ef3cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:31:42.223865 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff7009-2724-4788-9aaa-e4f2f23ef3cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:31:42.225276 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff7009-2724-4788-9aaa-e4f2f23ef3cb service neutron] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:31:42.235704 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1450/2891] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:31:42 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:33:46.561225 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf787a4-9196-4190-8ed8-4e79f4d2c475 service neutron] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:33:46.562732 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-aaf787a4-9196-4190-8ed8-4e79f4d2c475 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:33:46.573372 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf787a4-9196-4190-8ed8-4e79f4d2c475 service neutron] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:33:46.576983 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d134ba-e245-4b39-b585-f2a239f061a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:33:46.577653 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d134ba-e245-4b39-b585-f2a239f061a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:33:46.577938 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d134ba-e245-4b39-b585-f2a239f061a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:33:46.578212 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d134ba-e245-4b39-b585-f2a239f061a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:33:46.580173 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-40d134ba-e245-4b39-b585-f2a239f061a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:33:46.590462 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d134ba-e245-4b39-b585-f2a239f061a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:33:46.591878 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d134ba-e245-4b39-b585-f2a239f061a6 service neutron] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:33:46.601176 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1442/2892] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:33:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:33:57.768907 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff7009-2724-4788-9aaa-e4f2f23ef3cb service neutron] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:33:57.778145 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff7009-2724-4788-9aaa-e4f2f23ef3cb service neutron] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:33:57.781978 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deac03f-7e06-4376-9baf-c00139ddfc08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:33:57.782604 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deac03f-7e06-4376-9baf-c00139ddfc08 service neutron] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:33:57.782891 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deac03f-7e06-4376-9baf-c00139ddfc08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:33:57.783152 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deac03f-7e06-4376-9baf-c00139ddfc08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:33:57.784915 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-1deac03f-7e06-4376-9baf-c00139ddfc08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:33:57.854412 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deac03f-7e06-4376-9baf-c00139ddfc08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:33:57.855842 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deac03f-7e06-4376-9baf-c00139ddfc08 service neutron] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:33:57.866515 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1451/2893] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:33:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:33:59.042657 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d134ba-e245-4b39-b585-f2a239f061a6 service neutron] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:33:59.051249 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d134ba-e245-4b39-b585-f2a239f061a6 service neutron] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:33:59.054958 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1adea7-4b25-4c1d-a682-915ecef63167 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:33:59.055599 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1adea7-4b25-4c1d-a682-915ecef63167 service neutron] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:33:59.055883 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1adea7-4b25-4c1d-a682-915ecef63167 service neutron] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:33:59.056159 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1adea7-4b25-4c1d-a682-915ecef63167 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:33:59.057988 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-fd1adea7-4b25-4c1d-a682-915ecef63167 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:33:59.071226 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1adea7-4b25-4c1d-a682-915ecef63167 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:33:59.072644 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1adea7-4b25-4c1d-a682-915ecef63167 service neutron] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:33:59.083732 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1443/2894] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:33:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:34:10.871359 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deac03f-7e06-4376-9baf-c00139ddfc08 service neutron] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:34:10.879782 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deac03f-7e06-4376-9baf-c00139ddfc08 service neutron] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:34:10.883345 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9320dea-1fe5-4870-aa60-4c52287aa92b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:34:10.883967 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9320dea-1fe5-4870-aa60-4c52287aa92b service neutron] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:34:10.884247 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9320dea-1fe5-4870-aa60-4c52287aa92b service neutron] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:34:10.884521 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9320dea-1fe5-4870-aa60-4c52287aa92b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:34:10.886299 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-a9320dea-1fe5-4870-aa60-4c52287aa92b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:34:10.895444 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9320dea-1fe5-4870-aa60-4c52287aa92b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:34:10.896867 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9320dea-1fe5-4870-aa60-4c52287aa92b service neutron] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:34:10.905282 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1452/2895] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:34:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:34:10.999041 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1adea7-4b25-4c1d-a682-915ecef63167 service neutron] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:34:11.007519 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1adea7-4b25-4c1d-a682-915ecef63167 service neutron] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:34:11.011164 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796b27a-9d56-4f64-8fdb-bfd8c524b04e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:34:11.011791 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796b27a-9d56-4f64-8fdb-bfd8c524b04e service neutron] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:34:11.012068 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796b27a-9d56-4f64-8fdb-bfd8c524b04e service neutron] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:34:11.012337 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796b27a-9d56-4f64-8fdb-bfd8c524b04e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:34:11.014256 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-5796b27a-9d56-4f64-8fdb-bfd8c524b04e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:34:11.026165 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5796b27a-9d56-4f64-8fdb-bfd8c524b04e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:34:11.027612 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5796b27a-9d56-4f64-8fdb-bfd8c524b04e service neutron] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:34:11.035849 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1444/2896] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:34:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:34:12.118158 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9320dea-1fe5-4870-aa60-4c52287aa92b service neutron] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:34:12.126724 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9320dea-1fe5-4870-aa60-4c52287aa92b service neutron] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:34:12.130299 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560faa2c-7790-4a4c-8a06-c2508644207a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:34:12.130921 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560faa2c-7790-4a4c-8a06-c2508644207a service neutron] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:34:12.131199 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560faa2c-7790-4a4c-8a06-c2508644207a service neutron] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:34:12.131471 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560faa2c-7790-4a4c-8a06-c2508644207a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:34:12.133849 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-560faa2c-7790-4a4c-8a06-c2508644207a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:34:12.147195 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560faa2c-7790-4a4c-8a06-c2508644207a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:34:12.148546 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560faa2c-7790-4a4c-8a06-c2508644207a service neutron] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:34:12.160212 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1453/2897] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:34:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:34:12.219499 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796b27a-9d56-4f64-8fdb-bfd8c524b04e service neutron] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:34:12.220989 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-5796b27a-9d56-4f64-8fdb-bfd8c524b04e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:34:12.289058 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796b27a-9d56-4f64-8fdb-bfd8c524b04e service neutron] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:34:12.294927 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c5700-ff03-4d7b-a94d-11f474402535 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ddf11ac3e14d03b1159868b3b73fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:34:12.295562 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c5700-ff03-4d7b-a94d-11f474402535 service placement] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:34:12.295837 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c5700-ff03-4d7b-a94d-11f474402535 service placement] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:34:12.296105 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c5700-ff03-4d7b-a94d-11f474402535 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:34:12.297891 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-a22c5700-ff03-4d7b-a94d-11f474402535 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:34:12.309052 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22c5700-ff03-4d7b-a94d-11f474402535 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:34:12.310637 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22c5700-ff03-4d7b-a94d-11f474402535 service placement] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:34:12.320126 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1445/2898] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:34:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:34:12.735839 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560faa2c-7790-4a4c-8a06-c2508644207a service neutron] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:34:12.737207 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-560faa2c-7790-4a4c-8a06-c2508644207a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:34:12.753027 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560faa2c-7790-4a4c-8a06-c2508644207a service neutron] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:34:12.758681 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904155c6-67e6-4658-ace1-640377f07e1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b430b739cb54fc7911bc89f8ea2df72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:34:12.759311 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904155c6-67e6-4658-ace1-640377f07e1a service nova] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:34:12.759588 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904155c6-67e6-4658-ace1-640377f07e1a service nova] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:34:12.759859 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904155c6-67e6-4658-ace1-640377f07e1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:34:12.761623 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-904155c6-67e6-4658-ace1-640377f07e1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:34:12.773653 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904155c6-67e6-4658-ace1-640377f07e1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:34:12.775328 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904155c6-67e6-4658-ace1-640377f07e1a service nova] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:34:12.786055 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1454/2899] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:34:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:35:43.786127 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c5700-ff03-4d7b-a94d-11f474402535 service placement] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:35:43.787496 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-a22c5700-ff03-4d7b-a94d-11f474402535 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:35:43.800011 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c5700-ff03-4d7b-a94d-11f474402535 service placement] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:35:43.805056 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5e43d-e5fe-4f19-a027-844fecf0c4c0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ddf11ac3e14d03b1159868b3b73fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:35:43.805692 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5e43d-e5fe-4f19-a027-844fecf0c4c0 service placement] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:35:43.805969 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5e43d-e5fe-4f19-a027-844fecf0c4c0 service placement] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:35:43.806238 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5e43d-e5fe-4f19-a027-844fecf0c4c0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:35:43.807901 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-e6f5e43d-e5fe-4f19-a027-844fecf0c4c0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:35:43.818797 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f5e43d-e5fe-4f19-a027-844fecf0c4c0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:35:43.820380 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f5e43d-e5fe-4f19-a027-844fecf0c4c0 service placement] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:35:43.830569 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1446/2900] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:35:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:35:57.570744 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904155c6-67e6-4658-ace1-640377f07e1a service nova] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:35:57.572148 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-904155c6-67e6-4658-ace1-640377f07e1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:35:57.586328 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904155c6-67e6-4658-ace1-640377f07e1a service nova] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:35:57.592579 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77886b64-5f22-4e08-a64b-390031495e4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b430b739cb54fc7911bc89f8ea2df72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:35:57.593422 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77886b64-5f22-4e08-a64b-390031495e4f service nova] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:35:57.593910 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77886b64-5f22-4e08-a64b-390031495e4f service nova] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:35:57.594256 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77886b64-5f22-4e08-a64b-390031495e4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:35:57.596248 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-77886b64-5f22-4e08-a64b-390031495e4f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:35:57.609685 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77886b64-5f22-4e08-a64b-390031495e4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:35:57.611349 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77886b64-5f22-4e08-a64b-390031495e4f service nova] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:35:57.622306 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1455/2901] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:35:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:35:59.798967 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5e43d-e5fe-4f19-a027-844fecf0c4c0 service placement] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:35:59.811800 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5e43d-e5fe-4f19-a027-844fecf0c4c0 service placement] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:35:59.817651 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0c7fb-d7e0-4dc9-976d-1af6d0f1b911 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5b430b739cb54fc7911bc89f8ea2df72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:35:59.818331 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0c7fb-d7e0-4dc9-976d-1af6d0f1b911 service nova] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:35:59.818606 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0c7fb-d7e0-4dc9-976d-1af6d0f1b911 service nova] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:35:59.818874 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0c7fb-d7e0-4dc9-976d-1af6d0f1b911 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:35:59.821163 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-cbb0c7fb-d7e0-4dc9-976d-1af6d0f1b911 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:35:59.835144 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb0c7fb-d7e0-4dc9-976d-1af6d0f1b911 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:35:59.836759 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb0c7fb-d7e0-4dc9-976d-1af6d0f1b911 service nova] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:35:59.848736 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1447/2902] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:35:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:36:02.389530 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77886b64-5f22-4e08-a64b-390031495e4f service nova] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:36:02.398775 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77886b64-5f22-4e08-a64b-390031495e4f service nova] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:36:02.402346 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee30b9-eaca-42cc-a55f-a7e6d3ee01b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83430939ae474ad6bab37dfb6fc8da78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:36:02.402973 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee30b9-eaca-42cc-a55f-a7e6d3ee01b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:36:02.403249 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee30b9-eaca-42cc-a55f-a7e6d3ee01b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:36:02.403518 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee30b9-eaca-42cc-a55f-a7e6d3ee01b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:36:02.405790 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-aaee30b9-eaca-42cc-a55f-a7e6d3ee01b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:36:02.465485 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaee30b9-eaca-42cc-a55f-a7e6d3ee01b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:36:02.467465 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaee30b9-eaca-42cc-a55f-a7e6d3ee01b3 service neutron] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:36:02.476744 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1456/2903] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:36:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:36:08.219999 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0c7fb-d7e0-4dc9-976d-1af6d0f1b911 service nova] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:36:08.222052 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-cbb0c7fb-d7e0-4dc9-976d-1af6d0f1b911 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:36:08.235783 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0c7fb-d7e0-4dc9-976d-1af6d0f1b911 service nova] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:36:08.240720 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df93df-5997-40fb-9007-13281b41fe1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:36:08.242542 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df93df-5997-40fb-9007-13281b41fe1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:36:08.242850 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df93df-5997-40fb-9007-13281b41fe1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:36:08.243265 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df93df-5997-40fb-9007-13281b41fe1f admin admin] PATH_INFO: `/v3/users/2cf9a51b16fd4bfcab91dcd7e4b27492` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:36:08.244521 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9df93df-5997-40fb-9007-13281b41fe1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cf9a51b16fd4bfcab91dcd7e4b27492)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:36:08.246503 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9df93df-5997-40fb-9007-13281b41fe1f admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:36:08.297431 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-c9df93df-5997-40fb-9007-13281b41fe1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cf9a51b16fd4bfcab91dcd7e4b27492'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:36:08.305994 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-c9df93df-5997-40fb-9007-13281b41fe1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cf9a51b16fd4bfcab91dcd7e4b27492'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:36:08.306630 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-c9df93df-5997-40fb-9007-13281b41fe1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cf9a51b16fd4bfcab91dcd7e4b27492'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:36:08.317261 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-c9df93df-5997-40fb-9007-13281b41fe1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cf9a51b16fd4bfcab91dcd7e4b27492'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:36:08.321693 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-c9df93df-5997-40fb-9007-13281b41fe1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cf9a51b16fd4bfcab91dcd7e4b27492'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:36:08.341171 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1448/2904] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:36:08 2022] DELETE /identity/v3/users/2cf9a51b16fd4bfcab91dcd7e4b27492 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:36:08.515421 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee30b9-eaca-42cc-a55f-a7e6d3ee01b3 service neutron] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:36:08.525084 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee30b9-eaca-42cc-a55f-a7e6d3ee01b3 service neutron] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:36:08.579342 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb963d53-f63d-4719-8fba-1ba21b2ad14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:36:08.580179 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb963d53-f63d-4719-8fba-1ba21b2ad14f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:36:08.580456 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb963d53-f63d-4719-8fba-1ba21b2ad14f admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:36:08.580732 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb963d53-f63d-4719-8fba-1ba21b2ad14f admin admin] PATH_INFO: `/v3/projects/ebc3e65ea59f43f6b93e5fc5aec51e85` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:36:08.582171 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb963d53-f63d-4719-8fba-1ba21b2ad14f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebc3e65ea59f43f6b93e5fc5aec51e85)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:36:08.584036 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb963d53-f63d-4719-8fba-1ba21b2ad14f admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:36:08.628710 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-fb963d53-f63d-4719-8fba-1ba21b2ad14f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebc3e65ea59f43f6b93e5fc5aec51e85', 'request_id': 'req-fb963d53-f63d-4719-8fba-1ba21b2ad14f'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:36:08.634642 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-fb963d53-f63d-4719-8fba-1ba21b2ad14f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebc3e65ea59f43f6b93e5fc5aec51e85', 'request_id': 'req-fb963d53-f63d-4719-8fba-1ba21b2ad14f'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:36:08.641808 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-fb963d53-f63d-4719-8fba-1ba21b2ad14f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebc3e65ea59f43f6b93e5fc5aec51e85', 'request_id': 'req-fb963d53-f63d-4719-8fba-1ba21b2ad14f'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:36:08.651858 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-fb963d53-f63d-4719-8fba-1ba21b2ad14f admin admin] The token cache is being invalidate because project ebc3e65ea59f43f6b93e5fc5aec51e85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:36:08.652143 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-fb963d53-f63d-4719-8fba-1ba21b2ad14f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:36:08.652809 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-fb963d53-f63d-4719-8fba-1ba21b2ad14f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:36:08.654425 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1457/2905] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:36:08 2022] DELETE /identity/v3/projects/ebc3e65ea59f43f6b93e5fc5aec51e85 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:36:08.658293 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df93df-5997-40fb-9007-13281b41fe1f admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:36:08.659728 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-c9df93df-5997-40fb-9007-13281b41fe1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:36:08.672759 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df93df-5997-40fb-9007-13281b41fe1f admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:36:08.726909 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d965d55-0ebf-4ee7-b420-69886b60d514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:36:08.727761 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d965d55-0ebf-4ee7-b420-69886b60d514 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:36:08.728032 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d965d55-0ebf-4ee7-b420-69886b60d514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:36:08.728298 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d965d55-0ebf-4ee7-b420-69886b60d514 admin admin] PATH_INFO: `/v3/users/7a1ac82b83b64f01b91603bd15374e91` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:36:08.729480 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d965d55-0ebf-4ee7-b420-69886b60d514 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a1ac82b83b64f01b91603bd15374e91)` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:36:08.731376 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d965d55-0ebf-4ee7-b420-69886b60d514 admin admin] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:36:08.775663 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-1d965d55-0ebf-4ee7-b420-69886b60d514 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a1ac82b83b64f01b91603bd15374e91'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:36:08.782185 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-1d965d55-0ebf-4ee7-b420-69886b60d514 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a1ac82b83b64f01b91603bd15374e91'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:36:08.782840 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-1d965d55-0ebf-4ee7-b420-69886b60d514 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a1ac82b83b64f01b91603bd15374e91'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:36:08.789816 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-1d965d55-0ebf-4ee7-b420-69886b60d514 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a1ac82b83b64f01b91603bd15374e91'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:36:08.790419 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.notifications [None req-1d965d55-0ebf-4ee7-b420-69886b60d514 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a1ac82b83b64f01b91603bd15374e91'} {{(pid=80017) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:36:08.807572 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1449/2906] 10.222.0.65 () {58 vars in 1223 bytes} [Tue May 17 18:36:08 2022] DELETE /identity/v3/users/7a1ac82b83b64f01b91603bd15374e91 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:36:08.974933 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb963d53-f63d-4719-8fba-1ba21b2ad14f admin admin] Authenticating user token {{(pid=80018) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:36:08.976486 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.fernet_utils [None req-fb963d53-f63d-4719-8fba-1ba21b2ad14f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80018) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:36:08.989738 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb963d53-f63d-4719-8fba-1ba21b2ad14f admin admin] Validating token access rules against request {{(pid=80018) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:36:09.045389 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a44f2a5-9804-4500-807a-70ca206ca84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8763b2e915c44d8688900867e35dfda6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22a045ecfd2045b79def0497d463b2a3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80018) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:36:09.046197 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44f2a5-9804-4500-807a-70ca206ca84e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:36:09.046480 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44f2a5-9804-4500-807a-70ca206ca84e admin admin] SCRIPT_NAME: `/identity` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:36:09.046751 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44f2a5-9804-4500-807a-70ca206ca84e admin admin] PATH_INFO: `/v3/projects/2f9658f52e2a4b6b998d18029d820c53` {{(pid=80018) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:36:09.047922 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a44f2a5-9804-4500-807a-70ca206ca84e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f9658f52e2a4b6b998d18029d820c53)` {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:36:09.049870 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a44f2a5-9804-4500-807a-70ca206ca84e admin admin] RBAC: Authorization granted {{(pid=80018) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:36:09.096019 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-5a44f2a5-9804-4500-807a-70ca206ca84e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f9658f52e2a4b6b998d18029d820c53', 'request_id': 'req-5a44f2a5-9804-4500-807a-70ca206ca84e'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:36:09.102163 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-5a44f2a5-9804-4500-807a-70ca206ca84e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f9658f52e2a4b6b998d18029d820c53', 'request_id': 'req-5a44f2a5-9804-4500-807a-70ca206ca84e'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:36:09.109713 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-5a44f2a5-9804-4500-807a-70ca206ca84e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f9658f52e2a4b6b998d18029d820c53', 'request_id': 'req-5a44f2a5-9804-4500-807a-70ca206ca84e'} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:36:09.119296 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-5a44f2a5-9804-4500-807a-70ca206ca84e admin admin] The token cache is being invalidate because project 2f9658f52e2a4b6b998d18029d820c53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80018) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:36:09.119559 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-5a44f2a5-9804-4500-807a-70ca206ca84e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:36:09.120164 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: DEBUG keystone.notifications [None req-5a44f2a5-9804-4500-807a-70ca206ca84e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80018) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:36:09.121873 dv-cinder-837362-2-iscsi devstack@keystone.service[80018]: [pid: 80018|app: 0|req: 1458/2907] 10.222.0.65 () {58 vars in 1232 bytes} [Tue May 17 18:36:08 2022] DELETE /identity/v3/projects/2f9658f52e2a4b6b998d18029d820c53 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:40:48.779274 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d965d55-0ebf-4ee7-b420-69886b60d514 admin admin] Authenticating user token {{(pid=80017) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:40:48.780650 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-1d965d55-0ebf-4ee7-b420-69886b60d514 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:40:48.918575 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d965d55-0ebf-4ee7-b420-69886b60d514 admin admin] Validating token access rules against request {{(pid=80017) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:40:48.974056 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535a017e-158c-4f3a-ae60-d8b58f61b1b0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ddf11ac3e14d03b1159868b3b73fa4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf165918c1f46cb96d4b54409862659', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80017) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:40:48.974695 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a017e-158c-4f3a-ae60-d8b58f61b1b0 service placement] REQUEST_METHOD: `GET` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:40:48.974972 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a017e-158c-4f3a-ae60-d8b58f61b1b0 service placement] SCRIPT_NAME: `/identity` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:40:48.975242 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a017e-158c-4f3a-ae60-d8b58f61b1b0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80017) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:40:48.977570 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.fernet_utils [None req-535a017e-158c-4f3a-ae60-d8b58f61b1b0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80017) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:40:48.988339 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535a017e-158c-4f3a-ae60-d8b58f61b1b0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:40:48.989945 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535a017e-158c-4f3a-ae60-d8b58f61b1b0 service placement] RBAC: Authorization granted {{(pid=80017) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:40:49.000222 dv-cinder-837362-2-iscsi devstack@keystone.service[80017]: [pid: 80017|app: 0|req: 1450/2908] 10.222.0.65 () {60 vars in 1365 bytes} [Tue May 17 18:40:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)